ShopWare 5 vs Magento 2 Performance testing

wget https://releases.shopware.com/install_5.6.2_6cadc5c14bad4ea8839395461ea42dbc359e9666.zip?_ga=2.180327972.187034925.1570749702-1505405565.1570491800unzip 'install_5.6.2_6cadc5c14bad4ea8839395461ea42dbc359e9666.zip?_ga=2.180327972.187034925.1570749702-1505405565.1570491800' -d shopware

Disabling FPC cache all another caches enabled

Test Cases:

  1. Home Page
  2. Category
  3. Product Simple
  4. Product Configurable
  5. Cart With Simple Product
  6. Home Page FPC

1.Home Page

Server Hostname:        ec2-54-215-221-187.us-west-1.compute.amazonaws.com
Server Port: 80
Document Path: /
Document Length: 99835 bytes
Concurrency Level: 1
Time taken for tests: 22.320 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 5020000 bytes
HTML transferred: 4991750 bytes
Requests per second: 2.24 [#/sec] (mean)
Time per request: 446.391 [ms] (mean)
Time per request: 446.391 [ms] (mean, across all concurrent requests)
Transfer rate: 219.64 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 36 54 28.4 43 147
Processing: 259 393 131.5 353 910
Waiting: 112 127 13.0 123 171
Total: 298 446 136.8 400 959
Document Path:          /
Document Length: 27648 bytes
Concurrency Level: 1
Time taken for tests: 13.535 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 1412900 bytes
HTML transferred: 1382400 bytes
Requests per second: 3.69 [#/sec] (mean)
Time per request: 270.701 [ms] (mean)
Time per request: 270.701 [ms] (mean, across all concurrent requests)
Transfer rate: 101.94 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 35 46 24.5 40 197
Processing: 182 225 75.6 202 597
Waiting: 135 148 9.9 147 177
Total: 220 271 92.5 249 794

2. Category

Document Path:          /gear/fitness-equipment.html
Document Length: 123486 bytes
Concurrency Level: 1
Time taken for tests: 36.305 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 6202550 bytes
HTML transferred: 6174300 bytes
Requests per second: 1.38 [#/sec] (mean)
Time per request: 726.092 [ms] (mean)
Time per request: 726.092 [ms] (mean, across all concurrent requests)
Transfer rate: 166.84 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 35 42 6.3 40 62
Processing: 607 684 66.5 669 893
Waiting: 308 348 47.9 336 596
Total: 650 726 66.6 707 930
Document Path:          /clothing/
Document Length: 66739 bytes
Concurrency Level: 1
Time taken for tests: 30.195 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 3367450 bytes
HTML transferred: 3336950 bytes
Requests per second: 1.66 [#/sec] (mean)
Time per request: 603.897 [ms] (mean)
Time per request: 603.897 [ms] (mean, across all concurrent requests)
Transfer rate: 108.91 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 35 50 7.9 50 69
Processing: 469 554 73.8 543 821
Waiting: 274 316 51.0 307 630
Total: 510 604 74.8 597 874

3.Product Simple Page

Document Path:          /sprite-foam-roller.html
Document Length: 82798 bytes
Concurrency Level: 1
Time taken for tests: 37.477 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 4168150 bytes
HTML transferred: 4139900 bytes
Requests per second: 1.33 [#/sec] (mean)
Time per request: 749.537 [ms] (mean)
Time per request: 749.537 [ms] (mean, across all concurrent requests)
Transfer rate: 108.61 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 36 53 11.5 51 95
Processing: 553 696 125.4 667 1047
Waiting: 301 340 30.2 333 487
Total: 593 749 130.8 715 1106
Document Path:          /clothing/men/6/shipping-free-product-with-highlighting
Document Length: 50327 bytes
Concurrency Level: 1
Time taken for tests: 26.055 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 2546850 bytes
HTML transferred: 2516350 bytes
Requests per second: 1.92 [#/sec] (mean)
Time per request: 521.099 [ms] (mean)
Time per request: 521.099 [ms] (mean, across all concurrent requests)
Transfer rate: 95.46 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 37 60 16.2 56 116
Processing: 339 461 89.9 437 740
Waiting: 205 236 15.6 235 268
Total: 376 521 95.4 485 794

4.Product Configurable

Document Path:          /deirdre-relaxed-fit-capri.html
Document Length: 72862 bytes
Concurrency Level: 1
Time taken for tests: 29.131 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 3671350 bytes
HTML transferred: 3643100 bytes
Requests per second: 1.72 [#/sec] (mean)
Time per request: 582.629 [ms] (mean)
Time per request: 582.629 [ms] (mean, across all concurrent requests)
Transfer rate: 123.07 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 36 51 10.3 50 82
Processing: 449 532 53.2 518 672
Waiting: 257 291 30.9 283 448
Total: 487 583 56.3 566 721
Document Path:          /clothing/women/5/variant-product
Document Length: 53412 bytes
Concurrency Level: 1
Time taken for tests: 24.947 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 2701100 bytes
HTML transferred: 2670600 bytes
Requests per second: 2.00 [#/sec] (mean)
Time per request: 498.936 [ms] (mean)
Time per request: 498.936 [ms] (mean, across all concurrent requests)
Transfer rate: 105.74 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 35 55 13.5 53 101
Processing: 346 444 70.7 425 805
Waiting: 225 259 23.8 253 351
Total: 389 499 78.8 477 879

5. Cart With Product

Magento 2 FPC

6. Home Page FPC

Document Path:          /
Document Length: 99835 bytes
Concurrency Level: 1
Time taken for tests: 18.106 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 5020000 bytes
HTML transferred: 4991750 bytes
Requests per second: 2.76 [#/sec] (mean)
Time per request: 362.111 [ms] (mean)
Time per request: 362.111 [ms] (mean, across all concurrent requests)
Transfer rate: 270.77 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 35 79 289.1 37 2082
Processing: 253 283 31.7 275 413
Waiting: 60 71 23.1 65 210
Total: 292 362 307.7 314 2486
Document Path:          /
Document Length: 27648 bytes
Concurrency Level: 1
Time taken for tests: 5.841 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 1414450 bytes
HTML transferred: 1382400 bytes
Requests per second: 8.56 [#/sec] (mean)
Time per request: 116.813 [ms] (mean)
Time per request: 116.813 [ms] (mean, across all concurrent requests)
Transfer rate: 236.50 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 35 38 3.0 37 49
Processing: 74 79 3.7 78 95
Waiting: 36 38 1.9 37 45
Total: 111 117 5.4 116 144

Pivot Results Table:

+-------------------------+----------+-----------+------------+
| | Magento2 | Shopware5 | Difference |
+-------------------------+----------+-----------+------------+
| 1. Main Page | 123 | 147 | -16.33% |
+-------------------------+----------+-----------+------------+
| 2. Category | 336 | 307 | 9.45% |
+-------------------------+----------+-----------+------------+
| 5. Product Simple | 333 | 235 | 41.70% |
+-------------------------+----------+-----------+------------+
| 6. Product Configurable | 283 | 253 | 11.86% |
+-------------------------+----------+-----------+------------+
| 7. Cart Page | 298 | 234 | 27.35% |
+-------------------------+----------+-----------+------------+
| 8. FPC | 65 | 37 | 75.68% |
+-------------------------+----------+-----------+------------+
Performance Magemto 2 vs ShopWare 5

Bonus M2 M1 SW Performance:

+-------------------------+----------+-----------+----------+
| | Magento2 | ShopWare5 | Magento1 |
+-------------------------+----------+-----------+----------+
| 1. Main Page | 123 | 147 | 82 |
+-------------------------+----------+-----------+----------+
| 2. Category | 336 | 307 | 155 |
+-------------------------+----------+-----------+----------+
| 5. Product Simple | 333 | 235 | 141 |
+-------------------------+----------+-----------+----------+
| 6. Product Configurable | 283 | 253 | 160 |
+-------------------------+----------+-----------+----------+
| 7. Cart Page | 298 | 234 | 192 |
+-------------------------+----------+-----------+----------+
| 8. FPC | 65 | 37 | 70 |
+-------------------------+----------+-----------+----------+
Performance M2 vs ShopWare5 vs M1

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store