Presentation/Demo : Couchbase in Containers with Bare-Metal Performance and Triton’s Remarkable Elastic Provisioning

Virtualization is a key aspect of modern computing architectures. Often the choice to go to hardware-level virtualization induces a damage to the performance characteristics of our virtual machines. As I have mentioned before – SmartOS zones and Docker offer a better way to go.  In this presentation, Bryan Cantrill of Joyent provides a rapid-fire and humorous presentation highlighting the history of virtualization and the advantages of running Couchbase containers leveraging Triton, SmartOS and Docker. Also demonstrated is a remarkable display of Triton elasticity – easily creating a number of Couchbase servers on-the-fly all within lightweight virtualized containers running across a datacenter.  What is  offered is a sophisticated,highly scalable, highly performant, elastic solution for a datacenter.

Also can be found here.

It gets better.  If you are interested in deploying the Couchbase containers yourself it is fairly straightforward and you can get the “recipe” from the following blog :

screenshot_605

 

Improving Performance on Solaris, Linux and SmartOS

For many commercial companies the center of the Solaris world is at Oracle. However, for many of us that have lived and breathed Solaris, that center has shifted quite a while back to Joyent.  Oracle’s high licensing costs around a Solaris x86 license makes it uninteresting to many. Meanwhile, Joyent offers an open-source version of Solaris that actually offers a number of significant improvements. Joyent’s SmartOS has become one the most innovative operating systems available on the scene today.  A derivative of OpenSolaris – it has vastly improved on it, creating an excellent cloud-centric operating system with a wealth of features.  Improved are all the compelling Solaris technologies – zones, ZFS, dtrace, SMF, etc – but more important is how they have added new technologies (KVM) and offered a wealth of new features. One of the big wins with SmartOS is improved performance.  If you are interested you can find more information on SmartOS here :

smartos99

One of the areas where Solaris and SmartOS excel is dtrace – a framework that allows  observation of the running operating system and it’s applications and processes at a very deep level. On more than one occasion I was able to observe the details of applications running in production by using dtrace.  It is typical to see huge performance wins by using dtrace to diagnose performance issues or simply examine running applications.  Twenty examples of performance wins – with the bulk coming from use of dtrace :

bgregg01

bgregg02

Brendan Gregg is a performance guru and he is really well worth listening to. One of the more interesting articles he has written compared Solaris Zones, KVM and Xen and looked at in detail at them.

bgregg03

He recently presented SCaLE 12x and his presentation is, as usual, informative. Discussing what Linux can learn from Solaris-based systems and vice-versa when it comes to performance.
Brendan Gregg has written a number of books on the topic of performance.  He co-authored a book on DTrace :

bgreggdtraceand also authored a comprehensive book on performance :

bgreggdtrace02

 

Recommended Reading : Systems Performance, SmartOS and the Cloud

There is a new book out, Systems Performance : Enterprise and the Cloud by Brenden Gregg, and if you have to put up with slow software, book_brendenthen on a Monday, you need this book.  If you don’t know who Brenden Gregg is, then you haven’t been paying attention to a revolution in some of he  software that came from his team at Sun just a few years back. And this book constitutes an excellent way at  looking at system performance.  As described on Amazon : “Large-scale enterprise, cloud, and virtualized computing systems have introduced serious performance challenges. Now, internationally renowned performance expert Brendan Gregg has brought together proven methodologies, tools, and metrics for analyzing and tuning even the most complex environments. Systems Performance: Enterprise and the Cloud focuses on Linux® and Unix® performance, while illuminating performance issues that are relevant to all operating systems. You’ll gain deep insight into how systems work and perform, and learn methodologies for analyzing and improving system and application performance. Gregg presents examples from bare-metal systems and virtualized cloud tenants running Linux-based Ubuntu®, Fedora®, CentOS, and the illumos-based Joyent® SmartOS™ and OmniTI OmniOS®. He systematically covers modern systems performance, including the “traditional” analysis of CPUs, memory, disks, and networks, and new areas including cloud computing and dynamic tracing. This book also helps you identify and fix the “unknown unknowns” of complex performance: bottlenecks that emerge from elements and interactions you were not aware of. The text concludes with a detailed case study, showing how a real cloud customer issue was analyzed from start to finish.”   You can get a quick overview of the book by looking at his presentation and for the first time being introduced to the DTrace pony (page 6, but we will come back to the DTrace pony later) you can experience modern performance tools.

gregg02

Any so begins your magical mystery tour if you don’t know DTrace. If you haven’t experienced it you have missed out on a tool capable of literally

DTracegiving you deep observability into your system.  Though the best versions of DTrace run on open-source Solaris-based operating systems like SmartOS and illumos-based variants, their are also versions that run on Linux.  Couple with DTrace are utilization and latency heat maps and flame graphs which offer a visual view of what DTrace is reporting. As you get more interested in this tool you may want to examine what people like Brendan Gregg and Joyent are doing with DTrace in the Cloud –

gregg05

Joyent is using a forked version of OpenSolaris based on the illumos (open source) version.  Joyent’s open source version, SmartOS,  which they have customized around cloud deployments provides a large number of features unavailable on Oracle’s version of Solaris. And because SmartOS leverages OpenSolaris, one more thing becomes useful, ZFS, one of the most sophisticated file systems available.

gregg06

Another virtualization aspect of SmartOS is that it leverages Solaris zones (extremely lightweight) and Linux KVM (ported, debugged and tuned via DTrace).  And this all has given Joyent very special insight into dense virtualization and the architectures that virtualized clouds are built on.

gregg08

All of this is very interesting and offers an alternative to the usual VMware cloud, it also offers very strong open source enterprise-tested features of virtualization, file systems, tracing software and a suite of great features both server, storage and software-centric.  You can learn more about Joyent’s cloud version of Solaris at SmartOS.org.