Architecture : SSD-Based Solutions Show Advantages In the NoSQL DB Tier (Video)

Today we look at the NoSQL database tier.  Some of this is taken from notes from a work-in-progressAn Introduction to Using High-Performance Flash-Based Storage in Constructing High Volume Transaction Architectures – A Manager’s Guide to Selecting Flash Storage.  This is not a complete look at Big Data, rather a partial look at some of the things Aerospike, one of the more interesting NoSQL databases, is doing. 

Aerospike and the NoSQL Database Tier.  An alternative or in addition to the relational database tier, there is a NoSQL database tier. With the arrival in recent years of Big Data architectures, new elements of a new architecture for dealing with both structured and unstructured data has arrived and with it some databases, like Aerospike, offer an extreme high performance solution in transaction-oriented environments.  Quite a bit different from typical Hadoop implementations as one of Aerospike’s real differentiators is that Aerospike was built as an in-memory database. Traditionally, in the past, this tier we have seen a number of spinning disks.  However, in the past few years, especially with the need for real-time information there has been a move to SSDs and PCIe-based flash cards.  Using Aerospike’s NoSQL database provides a means to get those high performance results. It is built to be run in-memory or in-flash. A partial glimpse into an architecture.  It is built to run on relatively low cost clustered hardware with either lots of memory and/or flash storage.  It supports ACID properties and as a NoSQL database also leverages a key-value store. If we look at an example in this tier – you can see the an example architecture where various transactions are occurring within applications and Aerospike interacts with these. It should be noted that with App tier, Aerospike uses a Smart Client to communicate to the Aerospike cluster.

nosqlarch

Of course, the producing/consuming sources may vary dramatically – from applications, web services, hadoop clusters, mobile devices, weblogs, marketing data repositories and many more.   Aerospike  is a best-of-breed of the NoSQL databases. You can see an example of a typical deployment is (from the Aerospike presentation below) :

aerospike100

And some of the Aerospike server deployments :

aerospike101

Aerospike offers support for the ACID standard and support for a high performance, clustered architecture.

aero_ssd

Of course, there are other databases such as MongoDB, Cassandra and HBase to name a few. You may choose  to use NoSQL database over relational databases. It depends wholly on what you are doing. The NoSQL database tier’s storage on these servers can use SSDs, flash PCIe cards and flash arrays.  Traditionally this tier has adopted a “share-nothing” philosophy using traditional spinning disks, SSDs or flash PCIe cards. Up to recently, flash arrays seemed like not only over-kill but also seemingly moving against the grain of the “share-nothing” philosophy.  SSDs and cards, like Micron’s P320h offer excellent performance and offer a price/performance advantage over arrays.  As prices of flash drops flash arrays are becoming a consideration in this tier and there are a number of recent deployments leveraging flash arrays for the NoSQL DB tier.  Recently, Aerospike tested Micron’s P320h (SLC SSD) PCIe card.  It “blew away the competition” according to people doing the testing.  You can read more here:

aero_ssd

More information on the P320h :

tomshwp320h

It should be noted that there are two versions of this from Micron. Micron offers a 2.5″ Flash PCIe form-factor which is hot-swappable.  You can read more here :

digimicron

It should be noted that competitors are not standing still and Virident, Fusion-IO and others have and are coming out with new cards that are worth looking at.

To understand what Aerospike is doing it is worth watching this video :

Aerospike_video

If you want to learn more, it is worth visiting Aerospike’s BrightTalk site

brighttalk_aerospike

 


gotostorageGo to more posts on storage and flash storage at http://digitalcld.com/cld/category/storage.


 

Recommended Viewing : Tuning MongoDB for Next Generation Storage Systems (Video)

The video, Tuning MongoDB for Next Generation (Flash) Storage, is now available.

Storage architecture can have a direct impact on MongoDB performance. Traditional relational databases were designed around legacy SAN devices and required that the storage systems were dedicated to the database. If you wanted more performance you purchased a larger array. With NoSQL databases, the model has been flipped upside down. These databases are designed from the ground up to be distributed. More hosts equals more performance. By leveraging solid-state drive technology with concepts like storage virtualization, quality of service and horizontal scaling, next generation storage systems like SolidFire are able to combine the comforts of traditional dedicated storage performance with the simplicity and scalability expected in a MongoDB environment.

In this video a real-world clustered deployment of MongoDB on SolidFire is discussed. This deployment a private densely virtualized cloud. This is an ecommerce back-end.  They use the QoS and cluster features of SolidFire.  They go over the architecture.  Very good video.

mongodb_tuning

 


gotostorageGo to more posts on storage and flash storage at http://digitalcld.com/cld/category/storage.


 

Use-Case Webinar : Tuning MongoDB for Next Generation (Flash) Storage

mongodb03SolidFire, who has announced a strategic relationship with MongoDB, has scheduled a seminar for November 6th on Tuning MongoDB for the Next-Generation Storage System.  You can register for it here. Chris Merz, Chief Database Strategist and Sr. Database App engineer will provide a real-world example to show how to :

  • Architect MongoDB with SolidFire storage for a large scale production cloud environment
  • Traverse the technology stack to identify performance bottlenecks
  • Optimize IO performance and latency
  • Normalize performance under load
  • Maintain performance at scale

Happy learning.

 


gotostorageGo to more posts on storage and flash storage at http://digitalcld.com/cld/category/storage.