Apache HBase

Apache HBase
Original author(s)Powerset
Developer(s)Apache Software Foundation
Initial release28 March 2008; 16 years ago (2008-03-28)
Stable release
2.4.x2.4.14 / 29 August 2022; 2 years ago (2022-08-29)[1]
2.5.x2.5.3 / 5 February 2023; 21 months ago (2023-02-05)[1]
Preview release
3.0.0-alpha-3 / 27 June 2022; 2 years ago (2022-06-27)[1]
RepositoryGitHub Repository, Gitbox Repository
Written inJava
Operating systemCross-platform
TypeDistributed database
LicenseApache License 2.0
Websitehbase.apache.org

HBase is an open-source non-relational distributed database modeled after Google's Bigtable and written in Java. It is developed as part of Apache Software Foundation's Apache Hadoop project and runs on top of HDFS (Hadoop Distributed File System) or Alluxio, providing Bigtable-like capabilities for Hadoop. That is, it provides a fault-tolerant way of storing large quantities of sparse data (small amounts of information caught within a large collection of empty or unimportant data, such as finding the 50 largest items in a group of 2 billion records, or finding the non-zero items representing less than 0.1% of a huge collection).

HBase features compression, in-memory operation, and Bloom filters on a per-column basis as outlined in the original Bigtable paper.[2] Tables in HBase can serve as the input and output for MapReduce jobs run in Hadoop, and may be accessed through the Java API but also through REST, Avro or Thrift gateway APIs. HBase is a wide-column store and has been widely adopted because of its lineage with Hadoop and HDFS. HBase runs on top of HDFS and is well-suited for fast read and write operations on large datasets with high throughput and low input/output latency.

HBase is not a direct replacement for a classic SQL database, however Apache Phoenix project provides a SQL layer for HBase as well as JDBC driver that can be integrated with various analytics and business intelligence applications. The Apache Trafodion project provides a SQL query engine with ODBC and JDBC drivers and distributed ACID transaction protection across multiple statements, tables and rows that use HBase as a storage engine.

HBase is now serving several data-driven websites[3] but Facebook's Messaging Platform migrated from HBase to MyRocks in 2018.[4][5] Unlike relational and traditional databases, HBase does not support SQL scripting; instead the equivalent is written in Java, employing similarity with a MapReduce application.

In the parlance of Eric Brewer's CAP Theorem, HBase is a CP type system.[6]

  1. ^ a b c "Apache HBase – Apache HBase Downloads". Retrieved 27 September 2022.
  2. ^ Chang, et al. (2006). Bigtable: A Distributed Storage System for Structured Data
  3. ^ "Apache HBase – Powered By Apache HBase". hbase.apache.org. Retrieved 8 April 2018.
  4. ^ "Migrating Messenger storage to optimize performance". www.facebook.com. 26 June 2018. Retrieved 5 July 2018.
  5. ^ Facebook: Why our 'next-gen' comms ditched MySQL Retrieved: 17 December 2010
  6. ^ "Consistency Tradeoffs in Modern Distributed Database System Design" (PDF). February 2012. Retrieved 23 October 2024.