YCSB

The Yahoo! Cloud Serving Benchmark (YCSB) is an open-source specification and program suite for evaluating retrieval and maintenance capabilities of computer programs. It is often used to compare relative performance of NoSQL database management systems.

The original benchmark was developed by workers in the research division of Yahoo! who released it in 2010 with the stated goal of "facilitating performance comparisons of the new generation of cloud data serving systems", particularly for transaction-processing workloads which differed from ones measured by benchmarks designed for more traditional database management systems. [1]

YCSB has been contrasted with a benchmark from the Transaction Processing Performance Council (TPC-H), with YCSB being called a "Big Data" benchmark while TPC-H is a "Decision Support" benchmark. [2]

YCSB has been used by DBMS vendors for "benchmark marketing".[3] It has been used in scholarly or tutorial discussions, particularly for Apache HBase.[4][5] It has been used for multiple-product comparisons by industry observers such as Network World (comparing Cassandra, MongoDB, and Riak),[6] Thumbtack Technologies (comparing Aerospike, Cassandra, Couchbase, and MongoDB), [7] and the Polytechnic Institute and University of Coimbra (comparing Cassandra, HBase, Elasticsearch, MongoDB, Oracle NoSQL, OrientDB, Redis, Scalaris, Tarantool, and Voldemort. [8]


References

  1. ↑ Cooper, Brian F et al. "Benchmarking cloud serving systems with YCSB". Yahoo Research.
  2. ↑ Barata, M et al. "YCSB and TPC-H: Big Data and Decision Support Benchmarks". IEEE.
  3. ↑ Monash, Curt. "YCSB benchmark notes". Monash Research.
  4. ↑ "YCSB+T: Benchmarking web-scale transactional databases". IEEE.
  5. ↑ Jiang, Lifeng (2012). HBase Administration Cookbook. Packt Publishing.
  6. ↑ Bushik, Sergey. "A vendor-independent comparison of NoSQL databases". Network World.
  7. ↑ Abel, Avram. "NoSQL Benchmark Compares Aerospike, Cassandra, Couchbase and MongoDB". InfoQ.
  8. ↑ Abramova, Veronika; Bernardino, Jorge; Furtado, Pedro. "Experimental Evaluation of NoSQL Databases". International Journal of Database Management Systems.