The Tao in database [To be continue…]

The Tao in database [To be continue…]

2018, Jan 23    

Let’s begin with some existed databases:

X-DB

The X-DB is TaoBao’s database in Alibaba, the following is from TaoBao’s blog, which could handle 325K OPS (Operations Per Second) http://jm.taobao.org/2017/12/27/20172701/:

Tao bao

X-DB is a SQL database in the biggest e-commerce company in china, so the cluster size and maintenance effect is not quiet realistic for small business. But how can we achieve the same performance database with little cost? Use No-SQL database!!!

Cassandra

Netflix has a benchmark of Cassandra Cassandra benchmark:

Cassandra

To achieve the same IOPS, only need around 40 m1.xlarge EC2 instance. Which is more acceptable (less than 30$ / hour).

Scylla

So can it be more quick? Use Scylla, see the benchmark of the new database which rewrite Cassandra Syclla VS Cassandra

Scylla

Scylla only use 10% nodes to achieve same performance of Cassandra clusters.

FiloDB

But what’s more powerful database is based on Stream job of No-SQL.

The following architecture is from Evan Chan ‘s FiloDB FiloDB:

Filo1

The benchmark as below 2017-high-performance-database-with-scala-akka-spark:

Filo2

That FiloDB will achieve billion level OPS with “single thread”!!

The above databases tell:

  1. To achieve high OPS, use No-SQL

  2. Using stream to powerup No-SQL will achieve no-limited performance [Similar idea in the-tao-in-web-service/]

Tao in database [To be continue…]

Is there any defect in present database? What’s the future of database?

Yes, present database (both SQL or No-SQL) is just “real time snapshot” of real world, which hidden the history of data.

The future of database may have the “time travel” ability.

[To be continue…]