sysbench

sysbench is a popular tool for benchmarking databases like PostgreSQL and MySQL, as well as system capabilities like CPU, memory, and I/O. The YugabyteDB version of sysbench is forked from the official version with a few modifications to better reflect YugabyteDB's distributed nature.

Running the benchmark

Prerequisites

To ensure the recommended hardware requirements are met and the database is correctly configured before benchmarking, review the deployment checklist.

Install sysbench using the following steps:

$ cd $HOME
$ git clone https://github.com/yugabyte/sysbench.git
$ cd sysbench
$ ./autogen.sh && ./configure --with-pgsql && make -j && sudo make install

This installs the sysbench utility in /usr/local/bin.

Make sure you have the YSQL shell ysqlsh exported to the PATH variable.

$ export PATH=$PATH:/path/to/ysqlsh

Start YugabyteDB

Start your YugabyteDB cluster by following the steps in Manual deployment.

Run the benchmark

Run the run_sysbench.sh shell script to load the data and run the various workloads:

./run_sysbench.sh --ip <ip>

This script runs all 8 workloads using 64 threads with the number of tables as 10 and the table size as 100k.

If you want to run the benchmark with a different count of tables and tablesize, do the following:

./run_sysbench.sh --ip <ip> --numtables <number of tables> --tablesize <number of rows in each table>

Run individual workloads (optional)

You can choose to run the following workloads individually:

• oltp_insert
• oltp_point_select
• oltp_write_only
• oltp_read_only
• oltp_read_write
• oltp_update_index
• oltp_update_non_index
• oltp_delete

Before starting the workload, load the data as follows:

$ sysbench <workload>               \
      --tables=10                   \
      --table-size=100000           \
      --range_key_partitioning=true \
      --db-driver=pgsql             \
      --pgsql-host=127.0.0.1        \
      --pgsql-port=5433             \
      --pgsql-user=yugabyte         \
      --pgsql-db=yugabyte           \
      prepare

Run a workload as follows:

$ sysbench <workload>               \
      --tables=10                   \
      --table-size=100000           \
      --range_key_partitioning=true \
      --db-driver=pgsql             \
      --pgsql-host=127.0.0.1        \
      --pgsql-port=5433             \
      --pgsql-user=yugabyte         \
      --pgsql-db=yugabyte           \
      --threads=64                  \
      --time=120                    \
      --warmup-time=120             \
      run

Expected results

The following results are for a 3-node cluster with each node on a c5.4xlarge AWS instance (16 cores, 32 GB of RAM, and 2 EBS volumes), all in the same AZ with the client VM running in the same AZ.

10 tables each with 100k rows