MySQLCluster7.2.15安装部署性能测试

1 下载 Download the cluster tar.gz
wget http://dev.mysql.com/get/Downloads/MySQL-Cluster-7.2/mysql-cluster-gpl-7.2.15.tar.gz

MySQL Cluster 7.2.15
Select Version: 下拉框选择 7.2.15
Select Platform: 下拉框选择 Linux Generic
然后再下面连接一栏里面选择：
Linux - Generic 2.6 (x86, 64-bit), Compressed TAR Archive
(mysql-cluster-gpl-7.2.15-linux2.6-x86_64.tar.gz)

2 cp to other 3 host
scp mysql-cluster-gpl-7.2.15-linux2.6-x86_64.tar.gz 10.88.49.124:/root
10.88.49.119
10.88.49.122
10.88.49.123
10.88.49.124

3 install management node
tar -xvf mysql-cluster-gpl-7.2.15-linux2.6-x86_64.tar.gz


3.1 install the directory of install
mkdir -p /usr/local/mysql/bin
mkdir -p /usr/local/mysql/ndbdata


3.2 set the path of file run
[root@mysql mysql-cluster-gpl-7.2.15-linux2.6-x86_64]# vi ~/.bash_profile
PATH=$PATH:$HOME/bin:/usr/local/mysql/bin


3.3 copy the run files
cd mysql-cluster-gpl-7.2.15-linux2.6-x86_64
cp bin/ndb_mgmd /usr/local/mysql/bin
cp bin/ndb_mgm /usr/local/mysql/bin


3.4 create the file of log file store
mkdir -p /var/lib/mysql-cluster

3.5 create the config file and reset it
mkdir -p /usr/local/mysql/cluster-conf
vi /usr/local/mysql/cluster-conf/config.ini
[NDBD DEFAULT]
#TotalSendBufferMemory= 256M
NoOfReplicas=2
DataMemory=2500M
IndexMemory=500M
DataDir=/var/lib/mysql-cluster
#FileSystemPath=/data/dbdata
#Redolog
FragmentLogFileSize=32M
InitFragmentLogFiles=SPARSE
NoOfFragmentLogFiles=8
RedoBuffer=1024M
StringMemory=25
LockPagesInMainMemory=1
MaxNoOfTables=4096
MaxNoOfOrderedIndexes=2048
MaxNoOfUniqueHashIndexes=1024
MaxNoOfAttributes=24576
MaxNoOfTriggers=14336
ODirect=1


MaxNoOfConcurrentTransactions=10000
MaxNoOfConcurrentOperations=50000
MaxNoOfLocalOperations=55000
TimeBetweenGlobalCheckpoints=1000
TimeBetweenEpochs=100
TimeBetweenWatchdogCheckInitial=60000
TransactionBufferMemory=10M
DiskCheckpointSpeed=10M
DiskCheckpointSpeedInRestart=100M
TimeBetweenLocalCheckpoints=20
SchedulerSpinTimer=400
SchedulerExecutionTimer=100
RealTimeScheduler=1
BackupMaxWriteSize=1M
BackupDataBufferSize=16M
BackupLogBufferSize=4M
BackupMemory=20M


MaxNoOfExecutionThreads=4
TransactionDeadLockDetectionTimeOut=10000
BatchSizePerLocalScan=512
###Increasing the LongMessageBufferb/c of a bug (20090903)
LongMessageBuffer=8M
###Heartbeating
HeartbeatIntervalDbDb=15000
HeartbeatIntervalDbApi=15000
[MGM DEFAULT]
PortNumber:1186
DataDir:/var/lib/mysql-cluster1
[TCP DEFAULT]
SendBufferMemory:64M


#######################################
#Change HOST1 to the name of the NDB_MGMD host
#Change HOST8 to the name of the NDBD host
#Change HOST9 to the name of the NDBD host
#######################################
[NDB_MGMD]
NodeId:1
HostName:10.88.49.119
ArbitrationRank:1
[NDBD]
NodeId:4
HostName:10.88.49.124


######################################################
#Note: The following can be MySQLDconnections or #
# NDB API application connecting to thecluster #
######################################################
[API]
NodeId:10
HostName:10.88.49.122
ArbitrationRank:2


[API]
NodeId:11
HostName:10.88.49.123
ArbitrationRank:2


4 install data node (10.88.49.124)
4.1 install the directory of install
mkdir -p /usr/local/mysql/bin
mkdir -p /usr/local/mysql/ndbdata


4.2 copy the run command file
cd mysql-cluster-gpl-7.2.15-linux2.6-x86_64
cp ./bin/ndbd /usr/local/mysql/bin
chown -R mysql:mysql /usr/local/mysql


4.3 set the path
vim ~/.bash_profile
PATH=$PATH:$HOME/bin:/usr/local/mysql/bin


4.4 set the config file
vim /etc/mycluster.cnf
[mysql_cluster]

4.5 配置数据节点连接管理节点
ndb-connectstring=10.88.49.119

5 install sql node (10.88.49.122,10.88.49.123)
compress the tar.gz file
tar -zxvf mysql-cluster-gpl-7.2.15-linux2.6-x86_64.tar.gz

5.1 copy the directory
mv mysql-cluster-gpl-7.2.15-linux2.6-x86_64 /usr/local/mysqlndb

5.2 add mysql accounts
group add mysql
useradd -g mysql mysql

5.3 add the permission
chown -R mysql:mysql /usr/local/mysqlndb

5.4 copy the config file
cp /usr/local/mysqlndb/my.cnf /etc/my.cnf

5.5 init the database
cd /usr/local/mysqlndb
scripts/mysql_install_db --basedir=/usr/local/mysqlndb/ --datadir=/data/ --defaults-file =/etc/myndb.cnf --user=mysql
[root@localhost mysqlndb]# scripts/mysql_install_db --user=mysql
Installing MySQL system tables...
2014-02-27 01:55:16 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).

Installation of system tables failed! Examine the logs in
/app/mysql for more information.

You can try to start the mysqld daemon with:

shell> /usr/local/mysql5615/bin/mysqld --skip-grant &

and use the command line tool /usr/local/mysql5615/bin/mysql
to connect to the mysql database and look at the grant tables:

shell> /usr/local/mysql5615/bin/mysql -u root mysql
mysql> show tables

Try 'mysqld --help' if you have problems with paths. Using --log
gives you a log in /app/mysql that may be helpful.

Please consult the MySQL manual section
'Problems running mysql_install_db', and the manual section that
describes problems on your OS. Another information source are the
MySQL email archives available at http://lists.mysql.com/.

Please check all of the above before mailing us! And remember, if
you do mail us, you MUST use the /usr/local/mysql5615/scripts/mysqlbug script!


[]必须使用全路径/usr/local/mysqlndb/scripts/mysql_install_db，不然识别，就会自动调用为原来的初始化路径。
[root@localhost mysqlndb]# cp /etc/myndb.cnf /usr/local/mysqlndb/my.cnf
[root@localhost mysqlndb]# /usr/local/mysqlndb/scripts/mysql_install_db --defaults-file=/usr/local/mysqlndb/my.cnf --user=mysql
Installing MySQL system tables...
OK
Filling help tables...
OK


To start mysqld at boot time you have to copy
support-files/mysql.server to the right place for your system


PLEASE REMEMBER TO SET A PASSWORD FOR THE MySQL root USER !
To do so, start the server, then issue the following commands:


/usr/local/mysqlndb//bin/mysqladmin -u root password 'new-password'
/usr/local/mysqlndb//bin/mysqladmin -u root -h localhost password 'new-password'


Alternatively you can run:
/usr/local/mysqlndb//bin/mysql_secure_installation


which will also give you the option of removing the test
databases and anonymous user created by default. This is
strongly recommended for production servers.


See the manual for more instructions.


You can start the MySQL daemon with:
cd /usr/local/mysqlndb/ ; /usr/local/mysqlndb//bin/mysqld_safe &


You can test the MySQL daemon with mysql-test-run.pl
cd /usr/local/mysqlndb//mysql-test ; perl mysql-test-run.pl


Please report any problems with the /usr/local/mysqlndb//scripts/mysqlbug script!



5.7 copy the protect process
cp /usr/local/mysqlndb/support-files/mysql.server /etc/init.d/ndbdsql
配置守护进程
chkconfig --add ndbdsql
chkconfig --level 35 ndbdsql on
添加执行文件路径
vim ~/.bash_profile
PATH=$PATH:$HOME/bin:/usr/local/mysqlndb/bin
更改配置文件
vim /etc/my.cnf
分别编辑如下信息：
[mysqld]#配置SQL节点与管理节点连接
port= 3307
socket= /tmp/mysql.sock
ndbcluster
ndb-connectstring=10.88.49.119

[root@localhost mysqlndb]# /etc/init.d/mysqldndbd status
ERROR! MySQL is not running, but lock file (/var/lock/subsys/mysql) exists
[root@localhost mysqlndb]# /etc/init.d/mysqldndbd status
ERROR! MySQL is not running, but lock file (/var/lock/subsys/mysql) exists
[root@localhost mysqlndb]# mv /var/lock/subsys/mysql /var/lock/subsys/mysql.bak
[root@localhost mysqlndb]# /etc/init.d/mysqldndbd start
Starting MySQL... SUCCESS!

6 start the cluster
6.1 start the management node
ndb_mgmd -f /usr/local/mysql/cluster-conf/config.ini

[root@mysql ~]# ndb_mgmd -f /usr/local/mysql/cluster-conf/config.ini
MySQL Cluster Management Server mysql-5.5.35 ndb-7.2.15
2014-02-25 18:57:04 [MgmtSrvr] ERROR -- at line 1: Value specified outside section
2014-02-25 18:57:04 [MgmtSrvr] ERROR -- at line 1: Could not parse name-value pair in config file.
2014-02-25 18:57:04 [MgmtSrvr] ERROR -- Could not load configuration from '/usr/local/mysql/cluster-conf/config.ini'
2014-02-25 18:57:04 [MgmtSrvr] ERROR -- Could not determine which nodeid to use for this node. Specify it with --ndb-nodeid=<nodeid> on command line


检查是从window下copy到liux下，某些空格失效了。
修改/usr/local/mysql/cluster-conf/config.ini，将[NDBDDEFAULT]换成[NDBD DEFAULT]，中间少了一个空格。




6.2 start the data node
ndbd –initial #(第一次启动必须添加选项，另外备份/恢复，修改配置文件也需要执行)
ndbd #不是第一次启动需要执行的命令


/usr/local/mysql/bin/ndbd --defaults-file=/etc/mycluster.cnf --initial
启动时候指定读取的my.cnf配置文件。

去check下状态
[root@mysql ~]# ndb_mgm
-- NDB Cluster -- Management Client --
ndb_mgm> show
Connected to Management Server at: localhost:1186
Cluster Configuration
---------------------
[ndbd(NDB)] 1 node(s)
id=4 (not connected, accepting connect from 10.88.49.124)


[ndb_mgmd(MGM)] 1 node(s)
id=1 @10.88.49.119 (mysql-5.5.35 ndb-7.2.15)


[mysqld(API)] 2 node(s)
id=10 (not connected, accepting connect from 10.88.49.122)
id=11 (not connected, accepting connect from 10.88.49.123)


ndb_mgm>
data node没有show出来，再去check下data node的日志：
more /var/lib/mysql-cluster/ndb_4_out.log


报错如下
Started thread, index = 33, id = 27480, type = NdbfsThread
WOPool::init(61, 9)
RWPool::init(22, 14)
LCPFragWatchdog : WarnElapsed : 20000(ms) MaxElapsed 60000(ms) : period millis : 10000
2014-02-25 10:03:10 [ndbd] WARNING -- timerHandlingLab, expected 10ms sleep, not scheduled for: 2638 (ms)
2014-02-25 10:03:10 [ndbd] WARNING -- Time moved forward with 3688 ms
blockSz: 800, wpp: 8188 -> 624 (76)
RWPool::init(29, 624)
RWPool::init(42, 16)
RWPool::init(62, 12)2014-02-25 10:03:11 [ndbd] WARNING -- Ndb kernel thread 0 is stuck in: Job Handling elapsed=100


2014-02-25 10:03:11 [ndbd] INFO -- Watchdog: User time: 27 System time: 439
2014-02-25 10:03:11 [ndbd] INFO -- Watchdog: User time: 27 System time: 441
2014-02-25 10:03:11 [ndbd] WARNING -- Watchdog: Warning overslept 453 ms, expected 100 ms.
2014-02-25 10:03:11 [ndbd] WARNING -- Ndb kernel thread 0 is stuck in: Job Handling elapsed=554
2014-02-25 10:03:11 [ndbd] INFO -- Watchdog: User time: 27 System time: 441
2014-02-25 10:03:11 [ndbd] WARNING -- Ndb kernel thread 0 is stuck in: Job Handling elapsed=749
2014-02-25 10:03:14 [ndbd] ALERT -- Node 4: Forced node shutdown completed. Occured during startphase 0. Initiated by signal 9.


一直在调整/usr/local/mysql/cluster-conf/config.ini的参数值，但是一直报同样的错误。
内存和索引参数都调整100M以下了，依然报同样的错误，肯定不是内存不足，去看管理节点的日志信息
[root@mysql mysql-cluster1]# tail -f ndb_1_cluster.log
2014-02-25 20:08:25 [MgmtSrvr] ALERT -- Node 4: Forced node shutdown completed. Occured during startphase 0. Initiated by signal 9.
2014-02-25 20:19:00 [MgmtSrvr] INFO -- Loaded config from '/usr/local/mysql/mysql-cluster/ndb_1_config.bin.1'
2014-02-25 20:19:00 [MgmtSrvr] INFO -- Id: 1, Command port: *:1186
2014-02-25 20:19:00 [MgmtSrvr] INFO -- Node 1: Node 1 Connected
2014-02-25 20:19:00 [MgmtSrvr] INFO -- MySQL Cluster Management Server mysql-5.5.35 ndb-7.2.15 started
2014-02-25 20:19:00 [MgmtSrvr] INFO -- Node 1 connected
2014-02-25 20:19:18 [MgmtSrvr] INFO -- Nodeid 4 allocated for NDB at 10.88.49.124
2014-02-25 20:19:19 [MgmtSrvr] INFO -- Node 1: Node 4 Connected
2014-02-25 20:19:31 [MgmtSrvr] ALERT -- Node 1: Node 4 Disconnected
2014-02-25 20:19:33 [MgmtSrvr] ALERT -- Node 4: Forced node shutdown completed. Occured during startphase 0. Initiated by signal 9.


/usr/local/mysql/mysql-cluster/ndb_1_config.bin.1这个是干什么用的？貌似理论上没有这个，删除试试。
rm -rf /usr/local/mysql/mysql-cluster/ndb_1_config.bin.1

然后重新启动管理节点以及数据节点。
[root@mysql mysql-cluster1]# ndb_mgmd -f /usr/local/mysql/cluster-conf/config.ini
MySQL Cluster Management Server mysql-5.5.35 ndb-7.2.15
[root@monitor01 ~]# /usr/local/mysql/bin/ndbd --defaults-file=/etc/mycluster.cnf --initial
2014-02-25 10:42:29 [ndbd] INFO -- Angel connected to '10.88.49.119:1186'
2014-02-25 10:42:29 [ndbd] INFO -- Angel allocated nodeid: 4


去管理节点上show下，查看数据节点状态：
[root@mysql mysql-cluster1]# ndb_mgm
-- NDB Cluster -- Management Client --
ndb_mgm> show
Connected to Management Server at: localhost:1186
Cluster Configuration
---------------------
[ndbd(NDB)] 1 node(s)
id=4 @10.88.49.124 (mysql-5.5.35 ndb-7.2.15, Nodegroup: 0, *)


[ndb_mgmd(MGM)] 1 node(s)
id=1 @10.88.49.119 (mysql-5.5.35 ndb-7.2.15)


[mysqld(API)] 2 node(s)
id=10 (not connected, accepting connect from 10.88.49.122)
id=11 (not connected, accepting connect from 10.88.49.123)


ndb_mgm>

OK，数据节点已经启动起来了。


6.3 start the sql node.
[root@localhost mysql5615]# /etc/init.d/ndbdsql start
/etc/init.d/ndbdsql: line 276: cd: /usr/local/mysql: No such file or directory
Starting MySQL ERROR! Couldn't find MySQL server (/usr/local/mysql/bin/mysqld_safe)


vi /etc/init.d/ndbdsql
将/usr/local/mysql/bin改成/usr/local/mysqlndb/bin


[root@localhost data]# /etc/init.d/ndbdsql start
Starting MySQL..... ERROR! The server quit without updating PID file (/data/mysql.pid).
[root@localhost data]#
[root@localhost data]# more mysql.err
140227 02:47:51 mysqld_safe Starting mysqld daemon with databases from /data/
140227 2:47:51 [Warning] Using unique option prefix myisam_recover instead of myisam-recover-options is deprecated and will be removed in a future release. Please use
the full name instead.
140227 2:47:51 [Note] Plugin 'FEDERATED' is disabled.
140227 2:47:51 InnoDB: The InnoDB memory heap is disabled
140227 2:47:51 InnoDB: Mutexes and rw_locks use GCC atomic builtins
140227 2:47:51 InnoDB: Compressed tables use zlib 1.2.3
140227 2:47:51 InnoDB: Using Linux native AIO
140227 2:47:51 InnoDB: Initializing buffer pool, size = 256.0M
140227 2:47:51 InnoDB: Completed initialization of buffer pool
InnoDB: Error: auto-extending data file ./ibdata1 is of a different size
InnoDB: 1152 pages (rounded down to MB) than specified in the .cnf file:
InnoDB: initial 65536 pages, max 0 (relevant if non-zero) pages!
140227 2:47:51 InnoDB: Could not open or create data files.
140227 2:47:51 InnoDB: If you tried to add new data files, and it failed here,
140227 2:47:51 InnoDB: you should now edit innodb_data_file_path in my.cnf back
140227 2:47:51 InnoDB: to what it was, and remove the new ibdata files InnoDB created
140227 2:47:51 InnoDB: in this failed attempt. InnoDB only wrote those files full of
140227 2:47:51 InnoDB: zeros, but did not yet use them in any way. But be careful: do not
140227 2:47:51 InnoDB: remove old data files which contain your precious data!
140227 2:47:51 [ERROR] Plugin 'InnoDB' init function returned error.
140227 2:47:51 [ERROR] Plugin 'InnoDB' registration as a STORAGE ENGINE failed.
140227 2:47:51 [Note] NDB: NodeID is 10, management server '10.88.49.119:1186'
140227 2:47:52 [Note] NDB[0]: NodeID: 10, all storage nodes connected
140227 2:47:52 [Note] Starting Cluster Binlog Thread
140227 2:47:52 [ERROR] Unknown/unsupported storage engine: innodb
140227 2:47:52 [ERROR] Aborting


140227 2:47:52 [Note] Stopping Cluster Utility thread
140227 2:47:53 [Note] Stopping Cluster Binlog
140227 2:47:53 [Note] Stopping Cluster Index Stats thread
140227 2:47:53 [Note] Stopping Cluster Index Statistics thread
140227 2:47:53 [Note] /usr/local/mysqlndb/bin/mysqld: Shutdown complete


140227 02:47:53 mysqld_safe mysqld from pid file /data/mysql.pid ended


[]删除数据目录/data/ibdata1文件
[root@localhost data]# /etc/init.d/ndbdsql start
Starting MySQL..... ERROR! The server quit without updating PID file (/data/mysql.pid).
[root@localhost data]#


140227 2:49:38 [Note] Plugin 'FEDERATED' is disabled.
140227 2:49:38 InnoDB: The InnoDB memory heap is disabled
140227 2:49:38 InnoDB: Mutexes and rw_locks use GCC atomic builtins
140227 2:49:38 InnoDB: Compressed tables use zlib 1.2.3
140227 2:49:38 InnoDB: Using Linux native AIO
140227 2:49:38 InnoDB: Initializing buffer pool, size = 256.0M
140227 2:49:38 InnoDB: Completed initialization of buffer pool
InnoDB: The first specified data file ./ibdata1 did not exist:
InnoDB: a new database to be created!
140227 2:49:38 InnoDB: Setting file ./ibdata1 size to 1024 MB
InnoDB: Database physically writes the file full: wait...
InnoDB: Progress in MB: 100 200 300 400 500 600 700 800 900 1000
InnoDB: Error: log file ./ib_logfile0 is of different size 0 5242880 bytes
InnoDB: than specified in the .cnf file 0 268435456 bytes!
140227 2:49:40 [ERROR] Plugin 'InnoDB' init function returned error.
140227 2:49:40 [ERROR] Plugin 'InnoDB' registration as a STORAGE ENGINE failed.
140227 2:49:40 [Note] NDB: NodeID is 10, management server '10.88.49.119:1186'
140227 2:49:40 [Note] NDB[0]: NodeID: 10, all storage nodes connected
140227 2:49:40 [Note] Starting Cluster Binlog Thread
140227 2:49:40 [ERROR] Unknown/unsupported storage engine: innodb
140227 2:49:40 [ERROR] Aborting


140227 2:49:40 [Note] Stopping Cluster Utility thread
140227 2:49:41 [Note] Stopping Cluster Binlog
140227 2:49:41 [Note] Stopping Cluster Index Stats thread
140227 2:49:41 [Note] Stopping Cluster Index Statistics thread
140227 2:49:42 [Note] /usr/local/mysqlndb/bin/mysqld: Shutdown complete
[]删除/data/ib_logfile* 文件


[root@localhost data]# /etc/init.d/ndbdsql start
Starting MySQL...................... SUCCESS!
[root@localhost data]#




[root@localhost data]# /usr/local/mysqlndb/bin/mysql -uroot -p -P3307 --socket=/data/mysql.socket
Enter password:
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 3
Server version: 5.5.35-ndb-7.2.15-cluster-gpl-log MySQL Cluster Community Server (GPL)

Copyright (c) 2000, 2013, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql>
mysql> show engines; -- 检测ndbcluster存储引擎是否已经生效。
+--------------------+---------+----------------------------------------------------------------+--------------+------+------------+
| Engine | Support | Comment | Transactions | XA | Savepoints |
+--------------------+---------+----------------------------------------------------------------+--------------+------+------------+
| ndbcluster | YES | Clustered, fault-tolerant tables | YES | NO | NO |
| MRG_MYISAM | YES | Collection of identical MyISAM tables | NO | NO | NO |
| CSV | YES | CSV storage engine | NO | NO | NO |
| BLACKHOLE | YES | /dev/null storage engine (anything you write to it disappears) | NO | NO | NO |
| PERFORMANCE_SCHEMA | YES | Performance Schema | NO | NO | NO |
| MyISAM | YES | MyISAM storage engine | NO | NO | NO |
| ARCHIVE | YES | Archive storage engine | NO | NO | NO |
| InnoDB | DEFAULT | Supports transactions, row-level locking, and foreign keys | YES | YES | YES |
| FEDERATED | NO | Federated MySQL storage engine | NULL | NULL | NULL |
| ndbinfo | YES | MySQL Cluster system information storage engine | NO | NO | NO |
| MEMORY | YES | Hash based, stored in memory, useful for temporary tables | NO | NO | NO |
+--------------------+---------+----------------------------------------------------------------+--------------+------+------------+
11 rows in set (0.11 sec)




7 功能测试 TPCC-mysql
mysql> create logfile group NDB_LOGGRP ADD UNDOFILE 'NDB_UNDO_01.dbf'
-> INITIAL_SIZE=1024M ENGINE=NDBCLUSTER;
Query OK, 0 rows affected (1 min 16.75 sec)


mysql> alter logfile group NDB_LOGGRP ADD UNDOFILE 'NDB_UNDO_02.dbf'
-> INITIAL_SIZE=1024M ENGINE=NDBCLUSTER;
Query OK, 0 rows affected (1 min 25.30 sec)


基准测试工具之tpcc-mysql
http://imysql.cn/2012/08/04/tpcc-for-mysql-manual.html
rpm -Uvh http://dl.fedoraproject.org/pub/epel/5/i386/epel-release-5-4.noarch.rpm
[root@localhost ~]# rpm -Uvh http://dl.fedoraproject.org/pub/epel/5/i386/epel-release-5-4.noarch.rpm
Retrieving http://dl.fedoraproject.org/pub/epel/5/i386/epel-release-5-4.noarch.rpm
warning: /var/tmp/rpm-tmp.GZF4dV: Header V3 DSA/SHA1 Signature, key ID 217521f6: NOKEY
Preparing... ########################################### [100%]
package epel-release-6-8.noarch (which is newer than epel-release-5-4.noarch) is already installed
[root@localhost ~]#


然后就可以开始安装bzr客户端了:
yum install bzr


之后，就可以开始用bzr客户端下载tpcc-mysql源码了。
cd tmp
bzr branch lp:~percona-dev/perconatools/tpcc-mysql


[root@localhost ~]# bzr branch lp:~percona-dev/perconatools/tpcc-mysql
You have not informed bzr of your Launchpad ID, and you must do this to
write to Launchpad or access private data. See "bzr help launchpad-login".
bzr: ERROR: Target directory "tpcc-mysql" already exists.
这个错误，需要登录，去https://launchpad.net/bzr 注册帐号并登录，这样之后再执行bzr branch lp:~percona-dev/perconatools/tpcc-mysql
[root@localhost tmp]# bzr branch lp:~percona-dev/perconatools/tpcc-mysql
You have not informed bzr of your Launchpad ID, and you must do this to
write to Launchpad or access private data. See "bzr help launchpad-login".
Branched 48 revision(s).


[]check，tpcc-mysql目录就有了
[root@localhost tmp]# ll
total 72
drwx------. 2 root root 4096 Apr 16 2013 lp71h5jPt_
-rwxr-xr-x. 1 root root 10899 Feb 26 13:19 mysql
-rwxr-xr-x. 1 root root 10869 Feb 25 16:42 mysqld
-rwx------. 1 root root 10646 Apr 16 2013 mysqld55
-rwxrwx---. 1 root root 10646 Feb 18 2013 mysqld56
-rwxr-xr-x. 1 root root 10880 Feb 27 02:00 mysqldndbd
-rw-r--r--. 1 root root 101 Feb 23 17:12 percona-version-check
drwxr-xr-x. 6 root root 4096 Feb 27 17:12 tpcc-mysql
-rw-------. 1 root root 0 Feb 18 2013 yum.log


进入/tmp/tpcc-mysql/src目录
[root@localhost src]# make
cc -w -O2 -g -I. `mysql_config --include` -c load.c
load.c:18:19: error: mysql.h: No such file or directory
In file included from load.c:20:
spt_proc.h:1: error: expected 鈥鈥before 鈥鈥token
load.c:26: error: expected 鈥鈥 鈥鈥 鈥鈥 鈥榓sm鈥or 鈥榑_attribute__鈥before 鈥鈥token
......
[]设置变量：export C_INCLUDE_PATH=/usr/local/mysqlndb/include/
[root@localhost src]# export C_INCLUDE_PATH=/usr/local/mysqlndb/include/
[root@localhost src]#
[root@localhost src]#
[root@localhost src]# make
cc -w -O2 -g -I. `mysql_config --include` -c load.c
cc -w -O2 -g -I. `mysql_config --include` -c support.c
cc load.o support.o `mysql_config --libs_r` -lrt -o ../tpcc_load
/usr/bin/ld: cannot find -lmysqlclient_r
collect2: ld returned 1 exit status
make: *** [../tpcc_load] Error 1
[]继续设置变量：export LD_LIBRARY_PATH=/usr/local/mysqlndb/lib, export PATH=/usr/local/mysqlndb/bin:$PATH, export LD_LIBRARY_PATH=/usr/local/mysqlndb/lib


[]总结：连续设置如下3个变量：
export C_INCLUDE_PATH=/usr/local/mysqlndb/include/
export LD_LIBRARY_PATH=/usr/local/mysqlndb/lib
export PATH=/usr/local/mysqlndb/bin:$PATH
此处参考：http://blog.csdn.net/songxixi/article/details/8506796


[root@localhost src]# make
cc load.o support.o `mysql_config --libs_r` -lrt -o ../tpcc_load
cc -w -O2 -g -I. `mysql_config --include` -c main.c
cc -w -O2 -g -I. `mysql_config --include` -c spt_proc.c
cc -w -O2 -g -I. `mysql_config --include` -c driver.c
cc -w -O2 -g -I. `mysql_config --include` -c sequence.c
cc -w -O2 -g -I. `mysql_config --include` -c rthist.c
cc -w -O2 -g -I. `mysql_config --include` -c neword.c
cc -w -O2 -g -I. `mysql_config --include` -c payment.c
cc -w -O2 -g -I. `mysql_config --include` -c ordstat.c
cc -w -O2 -g -I. `mysql_config --include` -c delivery.c
cc -w -O2 -g -I. `mysql_config --include` -c slev.c
cc main.o spt_proc.o driver.o support.o sequence.o rthist.o neword.o payment.o ordstat.o delivery.o slev.o `mysql_config --libs_r` -lrt -o ../tpcc_start
[root@localhost src]#


[]check 生成的脚本
[root@localhost tpcc-mysql]# ll
total 248
-rw-r--r--. 1 root root 1621 Feb 27 17:12 add_fkey_idx.sql
-rw-r--r--. 1 root root 317 Feb 27 17:12 count.sql
-rw-r--r--. 1 root root 3105 Feb 27 17:12 create_table.sql
-rw-r--r--. 1 root root 763 Feb 27 17:12 drop_cons.sql
-rw-r--r--. 1 root root 477 Feb 27 17:12 load.sh
-rw-r--r--. 1 root root 851 Feb 27 17:12 README
drwxr-xr-x. 2 root root 4096 Feb 27 17:12 schema2
drwxr-xr-x. 5 root root 4096 Feb 27 17:12 scripts
drwxr-xr-x. 2 root root 4096 Feb 27 17:29 src
-rwxr-xr-x. 1 root root 60281 Feb 27 17:29 tpcc_load
-rwxr-xr-x. 1 root root 154208 Feb 27 17:29 tpcc_start


[]建库，建表，添加索引
/usr/local/mysqlndb/bin/mysql -uroot -p -P3307 --socket=/data/mysql.socket -e "CREATE DATABASE tpcc100;"
/usr/local/mysqlndb/bin/mysql -uroot -p -P3307 --socket=/data/mysql.socket tpcc100 <./create_table_ndb.sql
/usr/local/mysqlndb/bin/mysql -uroot -p -P3307 --socket=/data/mysql.socket tpcc100 <./add_fkey_idx.sql


[]导入数据
[root@localhost tpcc-mysql]# ./tpcc_load localhost tpcc1000 root "" 20
*************************************
*** ###easy### TPC-C Data Loader ***
*************************************
<Parameters>
[server]: localhost
[port]: 3306
[DBname]: tpcc1000
[user]: root
[pass]:
[warehouse]: 20


2002, HY000, Can't connect to local MySQL server through socket '/tmp/mysql.sock' (2)

软连接
ln -s /data/mysql.socket /tmp/mysql.sock
在这里，需要注意的是 tpcc 默认会读取 /tmp/mysql.sock这个socket位置，因此如果你的socket不在相应路径的话，就需要做个软连接，或者通过TCP/IP的方式连接测试服务器。


[root@localhost tpcc-mysql]# ./tpcc_load localhost tpcc100 root "" 20
*************************************
*** ###easy### TPC-C Data Loader ***
*************************************
<Parameters>
[server]: localhost
[port]: 3306
[DBname]: tpcc100
[user]: root
[pass]:
[warehouse]: 20
TPCC Data Load Started...
Loading Item
.....
1297, HY000, Got temporary error 233 'Out of operation records in transaction coordinator (increase MaxNoOfConcurrentOperations)' from NDBCLUSTER
Retrying ...
.....
1297, HY000, Got temporary error 233 'Out of operation records in transaction coordinator (increase MaxNoOfConcurrentOperations)' from NDBCLUSTER
Retrying ...
.....
1297, HY000, Got temporary error 233 'Out of operation records in transaction coordinator (increase MaxNoOfConcurrentOperations)' from NDBCLUSTER
Retrying ...
.....
1297, HY000, Got temporary error 233 'Out of operation records in transaction coordinator (increase MaxNoOfConcurrentOperations)' from NDBCLUSTER
Retrying ...






./tpcc_start -hlocalhost -d tpcc1000 -u root -p '' -w 1000 -c 32 -r 120 -l 3600 -ftpcc_mysql_20120314


一直卡在这里，所以暂时放弃用tpcc测试，用mysqlslap来进行测试。




7 功能测试 mysqlslap
mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=8 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=ndbcluster --number-of-queries=500 --debug-info


-- ndbcluster
[root@localhost mysqlndb]#
mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=8 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=ndbcluster --number-of-queries=500 --debug-info


Benchmark
Running for engine ndbcluster
Average number of seconds to run all queries: 0.308 seconds
Minimum number of seconds to run all queries: 0.308 seconds
Maximum number of seconds to run all queries: 0.308 seconds
Number of clients running queries: 8
Average number of queries per client: 62


[root@localhost mysqlndb]#
mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=16 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=ndbcluster --number-of-queries=500 --debug-info

[root@localhost mysqlndb]# mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=16 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=ndbcluster --number-of-queries=500 --debug-info
Benchmark
Running for engine ndbcluster
Average number of seconds to run all queries: 0.353 seconds
Minimum number of seconds to run all queries: 0.353 seconds
Maximum number of seconds to run all queries: 0.353 seconds
Number of clients running queries: 16
Average number of queries per client: 31


mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=32 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=ndbcluster --number-of-queries=500 --debug-info


[root@localhost mysqlndb]# mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=24 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=ndbcluster --number-of-queries=500 --debug-info
Benchmark
Running for engine ndbcluster
Average number of seconds to run all queries: 0.346 seconds
Minimum number of seconds to run all queries: 0.346 seconds
Maximum number of seconds to run all queries: 0.346 seconds
Number of clients running queries: 24
Average number of queries per client: 20



-- innodb
mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=8 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=innodb --number-of-queries=500 --debug-info
[root@localhost mysqlndb]# mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=8 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=innodb --number-of-queries=500 --debug-info
Benchmark
Running for engine innodb
Average number of seconds to run all queries: 0.460 seconds
Minimum number of seconds to run all queries: 0.460 seconds
Maximum number of seconds to run all queries: 0.460 seconds
Number of clients running queries: 8
Average number of queries per client: 62


mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=16 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=innodb --number-of-queries=500 --debug-info
[root@localhost mysqlndb]# mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=16 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=innodb --number-of-queries=500 --debug-info
Benchmark
Running for engine innodb
Average number of seconds to run all queries: 0.266 seconds
Minimum number of seconds to run all queries: 0.266 seconds
Maximum number of seconds to run all queries: 0.266 seconds
Number of clients running queries: 16
Average number of queries per client: 31


mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=32 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=innodb --number-of-queries=500 --debug-info
[root@localhost mysqlndb]# mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=24 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=innodb --number-of-queries=500 --debug-info
Benchmark
Running for engine innodb
Average number of seconds to run all queries: 0.203 seconds
Minimum number of seconds to run all queries: 0.203 seconds
Maximum number of seconds to run all queries: 0.203 seconds
Number of clients running queries: 24
Average number of queries per client: 20


mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=32 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=innodb --number-of-queries=500 --debug-info




============================================================================================================================
-- ndbcluster
[root@localhost mysqlndb]#
mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=8 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=ndbcluster --number-of-queries=1000 --debug-info
[root@localhost mysqlndb]# mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=8 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=ndbcluster --number-of-queries=1000 --debug-info
Benchmark
Running for engine ndbcluster
Average number of seconds to run all queries: 0.558 seconds
Minimum number of seconds to run all queries: 0.558 seconds
Maximum number of seconds to run all queries: 0.558 seconds
Number of clients running queries: 8
Average number of queries per client: 125

mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=16 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=ndbcluster --number-of-queries=1000 --debug-info
[root@localhost mysqlndb]# mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=16 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=ndbcluster --number-of-queries=1000 --debug-info
Benchmark
Running for engine ndbcluster
Average number of seconds to run all queries: 0.564 seconds
Minimum number of seconds to run all queries: 0.564 seconds
Maximum number of seconds to run all queries: 0.564 seconds
Number of clients running queries: 16
Average number of queries per client: 62
mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=32 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=ndbcluster --number-of-queries=1000 --debug-info
mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=64 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=ndbcluster --number-of-queries=1000 --debug-info
mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=8 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=ndbcluster --number-of-queries=2000 --debug-info


mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=8 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=innodb --number-of-queries=1000 --debug-info
[root@localhost mysqlndb]# mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=8 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=innodb --number-of-queries=1000 --debug-info
Benchmark
Running for engine innodb
Average number of seconds to run all queries: 0.710 seconds
Minimum number of seconds to run all queries: 0.710 seconds
Maximum number of seconds to run all queries: 0.710 seconds
Number of clients running queries: 8
Average number of queries per client: 125
mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=16 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=innodb --number-of-queries=1000 --debug-info
[root@localhost mysqlndb]# mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=16 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=innodb --number-of-queries=1000 --debug-info
Benchmark
Running for engine innodb
Average number of seconds to run all queries: 0.453 seconds
Minimum number of seconds to run all queries: 0.453 seconds
Maximum number of seconds to run all queries: 0.453 seconds
Number of clients running queries: 16
Average number of queries per client: 62
mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=32 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=innodb --number-of-queries=1000 --debug-info
[root@localhost mysqlndb]# mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=32 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=innodb --number-of-queries=1000 --debug-info
Benchmark
Running for engine innodb
Average number of seconds to run all queries: 0.541 seconds
Minimum number of seconds to run all queries: 0.541 seconds
Maximum number of seconds to run all queries: 0.541 seconds
Number of clients running queries: 32
Average number of queries per client: 31
mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=64 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=innodb --number-of-queries=1000 --debug-info
[root@localhost mysqlndb]# mysqlslap --defaults-file=/usr/local/mysqlndb/my.cnf --concurrency=64 --iterations=1 --number-int-cols=4 --number-char-cols=35 --auto-generate-sql --auto-generate-sql-add-autoincrement --auto-generate-sql-load-type=mixed --engine=innodb --number-of-queries=1000 --debug-info
Benchmark
Running for engine innodb
Average number of seconds to run all queries: 0.388 seconds
Minimum number of seconds to run all queries: 0.388 seconds
Maximum number of seconds to run all queries: 0.388 seconds
Number of clients running queries: 64
Average number of queries per client: 15



8 功能测试 sysbench
8.1 down tar.gz
wget http://downloads.sourceforge.net/project/sysbench/sysbench/0.4.12/sysbench-0.4.12.tar.gz


8.2
tar -xvf sysbench-0.4.12.tar.gz


以上方法适用于 MySQL 安装在标准默认目录下的情况，如果 MySQL 并不是安装在标准目录下的话，那么就需要自己指定 MySQL 的路径了。比如我的 MySQL 喜欢自己安装在 /usr/local/mysql 下，则按照以下方法编译：
8.3
configure
./configure --with-mysql-includes=/usr/local/mysqlndb/include --with-mysql-libs=/usr/local/mysqlndb/lib


make
make install


8.4 ndbcluster测试
[root@localhost sysbench-0.4.12]#
sysbench --test=oltp --mysql-table-engine=ndbcluster --mysql-db=ndb --oltp-table-size=100 --mysql-user=root --mysql-password="" --mysql-socket=/data/mysql.socket --db-driver=mysql --num-threads=16 prepare
sysbench 0.4.12: multi-threaded system evaluation benchmark


Creating table 'sbtest'...
Creating 100 records in table 'sbtest'...


sysbench --test=oltp --mysql-table-engine=ndbcluster --mysql-db=ndb --oltp-table-size=100 --mysql-user=root --mysql-password="" --mysql-socket=/data/mysql.socket --db-driver=mysql --num-threads=16 run
[root@localhost sysbench-0.4.12]# sysbench --test=oltp --mysql-table-engine=ndbcluster --mysql-db=ndb --oltp-table-size=100 --mysql-user=root --mysql-password="" --mysql-socket=/data/mysql.socket --db-driver=mysql --num-threads=16 run
sysbench 0.4.12: multi-threaded system evaluation benchmark


Running the test with following options:
Number of threads: 16


Doing OLTP test.
Running mixed OLTP test
Using Special distribution (12 iterations, 1 pct of values are returned in 75 pct cases)
Using "BEGIN" for starting transactions
Using auto_inc on the id column
Maximum number of requests for OLTP test is limited to 10000

[]run的时候卡在这里了，可能录入的数据量太少了，run不起来
手动自己写一个存储过程录入数据：
DELIMITER $$
DROP PROCEDURE test.wuxin_erp_insert $$
CREATE PROCEDURE test.wuxin_erp_insert()
BEGIN
DECLARE i INT;
SET i=0;
WHILE i< 100000 DO
REPLACE INTO ndb.sbtest SELECT i,0,'','qqqqqqqqqqwwwwwwwwwweeeeeeeeeerrrrrrrrrrtttttttttt';
END WHILE;
COMMIT;
END$$
DELIMITER $$


录入数据： call test.wuxin_erp_insert ();


[]在继续测试，并发线程数量：8
[root@localhost sysbench-0.4.12]# sysbench --test=oltp --mysql-table-engine=ndbcluster --mysql-db=ndb --oltp-table-size=100000 --mysql-user=root --mysql-password="" --mysql-socket=/data/mysql.socket --db-driver=mysql --num-threads=8 run
sysbench 0.4.12: multi-threaded system evaluation benchmark


Running the test with following options:
Number of threads: 8


Doing OLTP test.
Running mixed OLTP test
Using Special distribution (12 iterations, 1 pct of values are returned in 75 pct cases)
Using "BEGIN" for starting transactions
Using auto_inc on the id column
Maximum number of requests for OLTP test is limited to 10000
Threads started!
Done.


OLTP test statistics:
queries performed:
read: 140000
write: 50000
other: 20000
total: 210000
transactions: 10000 (345.75 per sec.)
deadlocks: 0 (0.00 per sec.)
read/write requests: 190000 (6569.20 per sec.)
other operations: 20000 (691.49 per sec.)


Test execution summary:
total time: 28.9228s
total number of events: 10000
total time taken by event execution: 231.2841
per-request statistics:
min: 14.34ms
avg: 23.13ms
max: 402.38ms
approx. 95 percentile: 33.59ms


Threads fairness:
events (avg/stddev): 1250.0000/5.83
execution time (avg/stddev): 28.9105/0.01
[]OK，谢天谢地，有测试数据出来了。

[]16个线程
sysbench --test=oltp --mysql-table-engine=ndbcluster --mysql-db=ndb --oltp-table-size=100000 --mysql-user=root --mysql-password="" --mysql-socket=/data/mysql.socket --db-driver=mysql --num-threads=8 run

[root@localhost sysbench-0.4.12]# sysbench --test=oltp --mysql-table-engine=ndbcluster --mysql-db=ndb --oltp-table-size=100000 --mysql-user=root --mysql-password="" --mysql-socket=/data/mysql.socket --db-driver=mysql --num-threads=16 run
sysbench 0.4.12: multi-threaded system evaluation benchmark


Running the test with following options:
Number of threads: 16


Doing OLTP test.
Running mixed OLTP test
Using Special distribution (12 iterations, 1 pct of values are returned in 75 pct cases)
Using "BEGIN" for starting transactions
Using auto_inc on the id column
Maximum number of requests for OLTP test is limited to 10000
Threads started!
Done.


OLTP test statistics:
queries performed:
read: 140000
write: 50000
other: 20000
total: 210000
transactions: 10000 (437.78 per sec.)
deadlocks: 0 (0.00 per sec.)
read/write requests: 190000 (8317.76 per sec.)
other operations: 20000 (875.55 per sec.)


Test execution summary:
total time: 22.8427s
total number of events: 10000
total time taken by event execution: 365.2217
per-request statistics:
min: 23.03ms
avg: 36.52ms
max: 563.69ms
approx. 95 percentile: 43.03ms


Threads fairness:
events (avg/stddev): 625.0000/5.30
execution time (avg/stddev): 22.8264/0.01

[]32个线程
[root@localhost sysbench-0.4.12]# sysbench --test=oltp --mysql-table-engine=ndbcluster --mysql-db=ndb --oltp-table-size=100000 --mysql-user=root --mysql-password="" --mysql-socket=/data/mysql.socket --db-driver=mysql --num-threads=32 run
sysbench 0.4.12: multi-threaded system evaluation benchmark


Running the test with following options:
Number of threads: 32


Doing OLTP test.
Running mixed OLTP test
Using Special distribution (12 iterations, 1 pct of values are returned in 75 pct cases)
Using "BEGIN" for starting transactions
Using auto_inc on the id column
Maximum number of requests for OLTP test is limited to 10000
Threads started!
ALERT: MySQL error: Got temporary error 4006 'Connect failure - out of connection objects (increase MaxNoOfConcurrentTransactions)' from NDBCLUSTER


FATAL: Error fetching result: ``
ALERT: MySQL error: Got temporary error 4006 'Connect failure - out of connection objects (increase MaxNoOfConcurrentTransactions)' from NDBCLUSTER


FATAL: Error fetching result: `p<`
ALERT: MySQL error: Got temporary error 4006 'Connect failure - out of connection objects (increase MaxNoOfConcurrentTransactions)' from NDBCLUSTER


FATAL: Error fetching result: `0烋`
ALERT: MySQL error: Got temporary error 4006 'Connect failure - out of connection objects (increase MaxNoOfConcurrentTransactions)' from NDBCLUSTER


FATAL: Error fetching result: `橡`
ALERT: MySQL error: Got temporary error 4006 'Connect failure - out of connection objects (increase MaxNoOfConcurrentTransactions)' from NDBCLUSTER


FATAL: Error fetching result: ``
ALERT: MySQL error: Got temporary error 4006 'Connect failure - out of connection objects (increase MaxNoOfConcurrentTransactions)' from NDBCLUSTER


FATAL: Error fetching result: `嘣`
ALERT: MySQL error: Got temporary error 4006 'Connect failure - out of connection objects (increase MaxNoOfConcurrentTransactions)' from NDBCLUSTER


FATAL: Error fetching result: `Pm`
ALERT: MySQL error: Got temporary error 4006 'Connect failure - out of connection objects (increase MaxNoOfConcurrentTransactions)' from NDBCLUSTER


FATAL: Error fetching result: ``
ALERT: MySQL error: Got temporary error 4006 'Connect failure - out of connection objects (increase MaxNoOfConcurrentTransactions)' from NDBCLUSTER


FATAL: Error fetching result: `贞`
ALERT: MySQL error: Got temporary error 4006 'Connect failure - out of connection objects (increase MaxNoOfConcurrentTransactions)' from NDBCLUSTER


FATAL: Error fetching result: `?g`
ALERT: MySQL error: Got temporary error 4006 'Connect failure - out of connection objects (increase MaxNoOfConcurrentTransactions)' from NDBCLUSTER


FATAL: Error fetching result: ``




[]报错了，磁盘空间不足以支撑


8.5 Innodb测试
[]准备数据
sysbench --test=oltp --mysql-table-engine=innodb --mysql-db=test --oltp-table-size=100000 --mysql-user=root --mysql-password="" --mysql-socket=/data/mysql.socket --db-driver=mysql --num-threads=8 prepare
[root@localhost sysbench-0.4.12]# sysbench --test=oltp --mysql-table-engine=innodb --mysql-db=test --oltp-table-size=100000 --mysql-user=root --mysql-password="" --mysql-socket=/data/mysql.socket --db-driver=mysql --num-threads=8 prepare
sysbench 0.4.12: multi-threaded system evaluation benchmark


Creating table 'sbtest'...
Creating 100000 records in table 'sbtest'...


[]开始测试 8线程
sysbench --test=oltp --mysql-table-engine=innodb --mysql-db=test --oltp-table-size=100000 --mysql-user=root --mysql-password="" --mysql-socket=/data/mysql.socket --db-driver=mysql --num-threads=8 run
[root@localhost sysbench-0.4.12]# sysbench --test=oltp --mysql-table-engine=innodb --mysql-db=test --oltp-table-size=100000 --mysql-user=root --mysql-password="" --mysql-socket=/data/mysql.socket --db-driver=mysql --num-threads=8 run
sysbench 0.4.12: multi-threaded system evaluation benchmark


Running the test with following options:
Number of threads: 8


Doing OLTP test.
Running mixed OLTP test
Using Special distribution (12 iterations, 1 pct of values are returned in 75 pct cases)
Using "BEGIN" for starting transactions
Using auto_inc on the id column
Maximum number of requests for OLTP test is limited to 10000
Threads started!
Done.


OLTP test statistics:
queries performed:
read: 140000
write: 50000
other: 20000
total: 210000
transactions: 10000 (382.77 per sec.)
deadlocks: 0 (0.00 per sec.)
read/write requests: 190000 (7272.71 per sec.)
other operations: 20000 (765.55 per sec.)


Test execution summary:
total time: 26.1251s
total number of events: 10000
total time taken by event execution: 208.8009
per-request statistics:
min: 1.25ms
avg: 20.88ms
max: 204.22ms
approx. 95 percentile: 38.38ms


Threads fairness:
events (avg/stddev): 1250.0000/13.32
execution time (avg/stddev): 26.1001/0.01

[]16个线程
[root@localhost sysbench-0.4.12]# sysbench --test=oltp --mysql-table-engine=innodb --mysql-db=test --oltp-table-size=100000 --mysql-user=root --mysql-password="" --mysql-socket=/data/mysql.socket --db-driver=mysql --num-threads=16 run
sysbench 0.4.12: multi-threaded system evaluation benchmark


Running the test with following options:
Number of threads: 16


Doing OLTP test.
Running mixed OLTP test
Using Special distribution (12 iterations, 1 pct of values are returned in 75 pct cases)
Using "BEGIN" for starting transactions
Using auto_inc on the id column
Maximum number of requests for OLTP test is limited to 10000
Threads started!
Done.


OLTP test statistics:
queries performed:
read: 140000
write: 50000
other: 20000
total: 210000
transactions: 10000 (398.89 per sec.)
deadlocks: 0 (0.00 per sec.)
read/write requests: 190000 (7578.88 per sec.)
other operations: 20000 (797.78 per sec.)


Test execution summary:
total time: 25.0697s
total number of events: 10000
total time taken by event execution: 400.5857
per-request statistics:
min: 1.32ms
avg: 40.06ms
max: 212.90ms
approx. 95 percentile: 80.09ms


Threads fairness:
events (avg/stddev): 625.0000/3.46
execution time (avg/stddev): 25.0366/0.01


[]32个线程
[root@localhost sysbench-0.4.12]# sysbench --test=oltp --mysql-table-engine=innodb --mysql-db=test --oltp-table-size=100000 --mysql-user=root --mysql-password="" --mysql-socket=/data/mysql.socket --db-driver=mysql --num-threads=32 run
sysbench 0.4.12: multi-threaded system evaluation benchmark


Running the test with following options:
Number of threads: 32


Doing OLTP test.
Running mixed OLTP test
Using Special distribution (12 iterations, 1 pct of values are returned in 75 pct cases)
Using "BEGIN" for starting transactions
Using auto_inc on the id column
Maximum number of requests for OLTP test is limited to 10000
Threads started!
Done.


OLTP test statistics:
queries performed:
read: 140000
write: 50000
other: 20000
total: 210000
transactions: 10000 (421.68 per sec.)
deadlocks: 0 (0.00 per sec.)
read/write requests: 190000 (8011.90 per sec.)
other operations: 20000 (843.36 per sec.)


Test execution summary:
total time: 23.7147s
total number of events: 10000
total time taken by event execution: 757.1587
per-request statistics:
min: 1.36ms
avg: 75.72ms
max: 365.32ms
approx. 95 percentile: 135.06ms


Threads fairness:
events (avg/stddev): 312.5000/2.69
execution time (avg/stddev): 23.6612/0.02



最后测试结果：

	测试环境： 管理节点：1个，900M内存 数据节点：1个，3.6G内存 SQL节点：2个，900M内存 集群4个点CPU：Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz，单核 集群4个点：Raid1+0
	tpcc-mysql测试
	ERROR，压数据压不进去，ERROR， 资源不足
	mysqlslap测试 500写入操作
	执行每一个写入所花的时间，单位秒
并发线程数量	8	16	32	64
NDB	0.308	0.353	0.346	Error
InnoDB	0.46	0.266	0.203	0.212
	mysqlslap测试 1000写入操作
	执行每一个写入所花的时间，单位秒
并发线程数量	8	16	32	64
NDB	0.558	0.564	90.247	Error
InnoDB	0.701	0.453	0.541	0.388
	总结：mysqlslap测试， 8线程下ndb平均执行一个操作时间少于innodb，当并发越多的情况下，ndb平均执行一个操作时间多于innodb，并发 越多，ndb效率会越来越低。
	sysbench测试 100000记录表
并发线程数量	8	16	32
NDB
transactions:	10000 (345.75 per sec.)	10000 (437.78 per sec.)	Error ，报错了资源不足
deadlocks:	0 (0.00 per sec.)	0 (0.00 per sec.)
read/write requests:	190000 (6569.20 per sec.)	190000 (8317.76 per sec.)
other operations:	20000 (691.49 per sec.)	20000 (875.55 per sec.)
InnoDB
transactions:	10000 (382.77 per sec.)	10000 (398.89 per sec.)	10000 (421.68 per sec.)
deadlocks:	0 (0.00 per sec.)	0 (0.00 per sec.)	0 (0.00 per sec.)
read/write requests:	190000 (7272.71 per sec.)	190000 (7578.88 per sec.)	190000 (8011.90 per sec.)
other operations:	20000 (765.55 per sec.)	20000 (797.78 per sec.)	20000 (843.36 per sec.)
	总结：用sysbench测试，线程次数越多，每秒执行的效率，ndb要高于innodb。

最后归纳总结：由于测试机器的配置过于低端，导致不能进行大数据量的测试，所以这些数据仅供参考而已。

参考：
http://www.mysqlperformanceblog.com/2013/07/01/tpcc-mysql-simple-usage-steps-and-how-to-build-graphs-with-gnuplot/