Loading…
This event has ended. Create your own event → Check it out
This event has ended. Create your own
View analytic
Monday, October 26 • 4:20pm - 5:10pm
Linux System enabling Distributed Key-Value(KV) Store (Hbase, Cassandra, Accumulo, Hypertable, Aerospike) for hosting TeraBytes of data - Kunal Gautam

Sign up or log in to save this to your schedule and see who's attending!

Identifying a KV store to host terabytes of data, from wide range of choices, for a set of given use cases, is a daunting proposition. Even after crossing the fearsome first step and narrowing down the candidates, it is non-trivial to explain and reason the actual results of benchmarking experiments with the expected results. However, it is often possible to analyze the metrics and parameters of the individual nodes to get some key insights on the overall limitations of the distributed system. In this talk, we present our experiences and methodology of how to analyze and effectively benchmark a distributed KV store. This involves monitoring and characterizing key server parameters like RAM, CPU, network, storage, page cache, IO scheduler, JVM size, GC tuning through use of utilities like iostat, dstat, iftop, jstat and cachestat. This provides a system level explanation of each feature

Speakers
avatar for Kunal Gautam

Kunal Gautam

Senior Software Engineer, Inmobi
Kunal Gautam is a strong thought leader in the field of Big data and has hands on experience in using Hadoop framework. Very talented and received several awards for providing ideas and implementing them to working product.Kunal has been working with distributed architectures over last 5+ years. He has expertise in using BigData to build from scratch User Profiling(RealTime/Batch) at scale(handles about 2 billion users , 200+TB of data ). | He... Read More →


Monday October 26, 2015 4:20pm - 5:10pm
Park Ballroom 3

Attendees (4)