Registrar performance tests

Testing SER in the role of registrar on sequential usernames in different database modes and different process counts:

• mode = 0 ... no database
• mode = 1 ... write through (written immediately into DB)
• mode = 2 ... write back (delayed write)
• mode = 3 ... readonly (?)

There was generated 100 000 sequential/random usernames used by sipp. Sequential means that they were in the form +14290xxxxxx, x are numbers; random usernames were at the same length but randomly generated. (Note: when using 100k usernames but doing 1M iterations there are 10 contacts registered per user.)

SER used 1240 MB of shared memory.

db_mode_0_sequential.1

Registrar with db_mode 0 with sequential usernames and process count 1.

db_mode_0_sequential.2

Registrar with db_mode 0 with sequential usernames and process count 2.

db_mode_0_sequential.4

Registrar with db_mode 0 with sequential usernames and process count 4.

db_mode_0_sequential.8

Registrar with db_mode 0 with sequential usernames and process count 8.

db_mode_1_sequential.1

Registrar with db_mode 1 with sequential usernames and process count 1.

db_mode_1_sequential.2

Registrar with db_mode 1 with sequential usernames and process count 2.

db_mode_1_sequential.4

Registrar with db_mode 1 with sequential usernames and process count 4.

db_mode_1_sequential.8

Registrar with db_mode 1 with sequential usernames and process count 8.

db_mode_2_sequential.1

Registrar with db_mode 2 with sequential usernames and process count 1.

db_mode_2_sequential.2

Registrar with db_mode 2 with sequential usernames and process count 2.

db_mode_2_sequential.4

Registrar with db_mode 2 with sequential usernames and process count 4.

db_mode_2_sequential.8

Registrar with db_mode 2 with sequential usernames and process count 8.

db_mode_0_sequential.1

Registrar with db_mode 0 with sequential usernames and process count 1.

additional SIPP args: -inf data/sequential_usernames.sipp

Used config file was registrar.cfg (log here), sipp scenario register_users.xml, sipp output screens are in db_mode_0_sequential.1.screen.

SAR statistics: platform dependent binary data, average values, all values.

SIPP command

Test stopped after 1000000 iterations, maximum allowed simultaneous calls were 32; reached average call throughput was 9898 calls per second.

db_mode_0_sequential.2

Registrar with db_mode 0 with sequential usernames and process count 2.

additional SIPP args: -inf data/sequential_usernames.sipp

Used config file was registrar.cfg (log here), sipp scenario register_users.xml, sipp output screens are in db_mode_0_sequential.2.screen.

SAR statistics: platform dependent binary data, average values, all values.

SIPP command

Test stopped after 1000000 iterations, maximum allowed simultaneous calls were 32; reached average call throughput was 9410 calls per second.

db_mode_0_sequential.4

Registrar with db_mode 0 with sequential usernames and process count 4.

additional SIPP args: -inf data/sequential_usernames.sipp

Used config file was registrar.cfg (log here), sipp scenario register_users.xml, sipp output screens are in db_mode_0_sequential.4.screen.

SAR statistics: platform dependent binary data, average values, all values.

SIPP command

Test stopped after 1000000 iterations, maximum allowed simultaneous calls were 32; reached average call throughput was 8548 calls per second.

db_mode_0_sequential.8

Registrar with db_mode 0 with sequential usernames and process count 8.

additional SIPP args: -inf data/sequential_usernames.sipp

Used config file was registrar.cfg (log here), sipp scenario register_users.xml, sipp output screens are in db_mode_0_sequential.8.screen.

SAR statistics: platform dependent binary data, average values, all values.

SIPP command

Test stopped after 1000000 iterations, maximum allowed simultaneous calls were 32; reached average call throughput was 8191 calls per second.

db_mode_1_sequential.1

Registrar with db_mode 1 with sequential usernames and process count 1.

additional SIPP args: -inf data/sequential_usernames.sipp

Used config file was registrar.cfg (log here), sipp scenario register_users.xml, sipp output screens are in db_mode_1_sequential.1.screen.

SAR statistics: platform dependent binary data, average values, all values.

SIPP command

Test stopped after 1000000 iterations, maximum allowed simultaneous calls were 32; reached average call throughput was 3490 calls per second.

db_mode_1_sequential.2

Registrar with db_mode 1 with sequential usernames and process count 2.

additional SIPP args: -inf data/sequential_usernames.sipp

Used config file was registrar.cfg (log here), sipp scenario register_users.xml, sipp output screens are in db_mode_1_sequential.2.screen.

SAR statistics: platform dependent binary data, average values, all values.

SIPP command

Test stopped after 1000000 iterations, maximum allowed simultaneous calls were 32; reached average call throughput was 2794 calls per second.

db_mode_1_sequential.4

Registrar with db_mode 1 with sequential usernames and process count 4.

additional SIPP args: -inf data/sequential_usernames.sipp

Used config file was registrar.cfg (log here), sipp scenario register_users.xml, sipp output screens are in db_mode_1_sequential.4.screen.

SAR statistics: platform dependent binary data, average values, all values.

SIPP command

Test stopped after 1000000 iterations, maximum allowed simultaneous calls were 32; reached average call throughput was 2438 calls per second.

db_mode_1_sequential.8

Registrar with db_mode 1 with sequential usernames and process count 8.

additional SIPP args: -inf data/sequential_usernames.sipp

Used config file was registrar.cfg (log here), sipp scenario register_users.xml, sipp output screens are in db_mode_1_sequential.8.screen.

SAR statistics: platform dependent binary data, average values, all values.

SIPP command

Test stopped after 1000000 iterations, maximum allowed simultaneous calls were 32; reached average call throughput was 2389 calls per second.

db_mode_2_sequential.1

Registrar with db_mode 2 with sequential usernames and process count 1.

additional SIPP args: -inf data/sequential_usernames.sipp

Used config file was registrar.cfg (log here), sipp scenario register_users.xml, sipp output screens are in db_mode_2_sequential.1.screen.

SAR statistics: platform dependent binary data, average values, all values.

SIPP command

Test stopped after 1000000 iterations, maximum allowed simultaneous calls were 32; reached average call throughput was 4566 calls per second.

db_mode_2_sequential.2

Registrar with db_mode 2 with sequential usernames and process count 2.

additional SIPP args: -inf data/sequential_usernames.sipp

Used config file was registrar.cfg (log here), sipp scenario register_users.xml, sipp output screens are in db_mode_2_sequential.2.screen.

SAR statistics: platform dependent binary data, average values, all values.

SIPP command

Test stopped after 1000000 iterations, maximum allowed simultaneous calls were 32; reached average call throughput was 4319 calls per second.

db_mode_2_sequential.4

Registrar with db_mode 2 with sequential usernames and process count 4.

additional SIPP args: -inf data/sequential_usernames.sipp

Used config file was registrar.cfg (log here), sipp scenario register_users.xml, sipp output screens are in db_mode_2_sequential.4.screen.

SAR statistics: platform dependent binary data, average values, all values.

SIPP command

Test stopped after 1000000 iterations, maximum allowed simultaneous calls were 32; reached average call throughput was 2759 calls per second.

db_mode_2_sequential.8

Registrar with db_mode 2 with sequential usernames and process count 8.

additional SIPP args: -inf data/sequential_usernames.sipp

Used config file was registrar.cfg (log here), sipp scenario register_users.xml, sipp output screens are in db_mode_2_sequential.8.screen.

SAR statistics: platform dependent binary data, average values, all values.

SIPP command

Test stopped after 1000000 iterations, maximum allowed simultaneous calls were 32; reached average call throughput was 2789 calls per second.

Test information

Test done by kubartv from jin on Thu Mar 29 10:12:50 CEST 2007.

SIPP version:
Sipp v1.1, version 20060829, built Mar 28 2007, 11:22:45. This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA 02111-1307 USA Author: see source files.

Tested machine

Test done under user kubartv on 213.192.30.219, helping machine (if used) is 213.192.30.237, user kubartv.

Linux pres 2.6.17-2-686-bigmem #1 SMP Sat Sep 23 21:15:25 UTC 2006 i686 GNU/Linux

CPU

processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	: Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.798
cache size	: 2048 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 1
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 6006.58

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	: Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.798
cache size	: 2048 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 1
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 6000.67

Memory

             total       used       free     shared    buffers     cached
Mem:       8312532     232240    8080292          0      14388     154872
-/+ buffers/cache:      62980    8249552
Swap:      7807352          0    7807352

SER version

Graph descriptions

response delay

Time for each response; on X-axis is request time, i.e. when was the request sent, on Y-axis is how long time was between sending request and receiving the response. This value is not the same as values measured by watching network traffic probably due to sipp processing delay.

response delay histogram

Histogram made from time differences between sending request and receiving response. It shows numbers of response times grouped by 10 ms.

CPU usage

Shows sumary for all monitored processes for given time. Monitored processors can be set within variables script when generating the output (not needed in runtime). This output is taken from top which collects this information for one second. It can be more than 100% in the case of more processors (for example tc4 has two hyperthreaded processors thus it can show values up to 400%).

sent request histogram

Shows numbers of sent requests grouped by one second. Sometimes it shows strange jumps (for example in t_relay scenario after shmem is gone)...

Test result notes

SIPP is set to allow at most 32 calls at the same time. This means that when there are 32 pending calls (waiting for response) it doesn't create new ones.