ShopWare 5 vs Magento 2 Performance testing
7 min readOct 11, 2019
Guys from Mercedes asked me to check performance of old ShopWare 5 (new version is 6 beta) vs innovated super fast Magento 2.3.2
Installing ShopWare:
wget https://releases.shopware.com/install_5.6.2_6cadc5c14bad4ea8839395461ea42dbc359e9666.zip?_ga=2.180327972.187034925.1570749702-1505405565.1570491800unzip 'install_5.6.2_6cadc5c14bad4ea8839395461ea42dbc359e9666.zip?_ga=2.180327972.187034925.1570749702-1505405565.1570491800' -d shopware
For test I have used the same infrastructure and method as per my previous Magento 2 vs Magento 1 test: https://medium.com/@egorshytikov/magento-2-3-2-vs-magento-1-9-4-php-core-performance-test-b267570b8b3
According to Google Trends ShopWare was more popular in Germany than Magento.
Disabling FPC cache all another caches enabled
Why? Because:
ShopWare 5 cache configuration module can be found in Settings->Caches / Performance->Settings->Http-Cache.
Test Cases:
- Home Page
- Category
- Product Simple
- Product Configurable
- Cart With Simple Product
- Home Page FPC
1.Home Page
M2
Server Hostname: ec2-54-215-221-187.us-west-1.compute.amazonaws.com
Server Port: 80Document Path: /
Document Length: 99835 bytesConcurrency Level: 1
Time taken for tests: 22.320 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 5020000 bytes
HTML transferred: 4991750 bytes
Requests per second: 2.24 [#/sec] (mean)
Time per request: 446.391 [ms] (mean)
Time per request: 446.391 [ms] (mean, across all concurrent requests)
Transfer rate: 219.64 [Kbytes/sec] receivedConnection Times (ms)
min mean[+/-sd] median max
Connect: 36 54 28.4 43 147
Processing: 259 393 131.5 353 910
Waiting: 112 127 13.0 123 171
Total: 298 446 136.8 400 959
Result: 123ms
ShopWare
Document Path: /
Document Length: 27648 bytesConcurrency Level: 1
Time taken for tests: 13.535 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 1412900 bytes
HTML transferred: 1382400 bytes
Requests per second: 3.69 [#/sec] (mean)
Time per request: 270.701 [ms] (mean)
Time per request: 270.701 [ms] (mean, across all concurrent requests)
Transfer rate: 101.94 [Kbytes/sec] receivedConnection Times (ms)
min mean[+/-sd] median max
Connect: 35 46 24.5 40 197
Processing: 182 225 75.6 202 597
Waiting: 135 148 9.9 147 177
Total: 220 271 92.5 249 794
Result: 147ms
2. Category
M2
Document Path: /gear/fitness-equipment.html
Document Length: 123486 bytesConcurrency Level: 1
Time taken for tests: 36.305 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 6202550 bytes
HTML transferred: 6174300 bytes
Requests per second: 1.38 [#/sec] (mean)
Time per request: 726.092 [ms] (mean)
Time per request: 726.092 [ms] (mean, across all concurrent requests)
Transfer rate: 166.84 [Kbytes/sec] receivedConnection Times (ms)
min mean[+/-sd] median max
Connect: 35 42 6.3 40 62
Processing: 607 684 66.5 669 893
Waiting: 308 348 47.9 336 596
Total: 650 726 66.6 707 930
Result: 336ms
ShopWare
Document Path: /clothing/
Document Length: 66739 bytesConcurrency Level: 1
Time taken for tests: 30.195 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 3367450 bytes
HTML transferred: 3336950 bytes
Requests per second: 1.66 [#/sec] (mean)
Time per request: 603.897 [ms] (mean)
Time per request: 603.897 [ms] (mean, across all concurrent requests)
Transfer rate: 108.91 [Kbytes/sec] receivedConnection Times (ms)
min mean[+/-sd] median max
Connect: 35 50 7.9 50 69
Processing: 469 554 73.8 543 821
Waiting: 274 316 51.0 307 630
Total: 510 604 74.8 597 874
Result: 307ms
3.Product Simple Page
M2
Document Path: /sprite-foam-roller.html
Document Length: 82798 bytesConcurrency Level: 1
Time taken for tests: 37.477 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 4168150 bytes
HTML transferred: 4139900 bytes
Requests per second: 1.33 [#/sec] (mean)
Time per request: 749.537 [ms] (mean)
Time per request: 749.537 [ms] (mean, across all concurrent requests)
Transfer rate: 108.61 [Kbytes/sec] receivedConnection Times (ms)
min mean[+/-sd] median max
Connect: 36 53 11.5 51 95
Processing: 553 696 125.4 667 1047
Waiting: 301 340 30.2 333 487
Total: 593 749 130.8 715 1106
Result: 333ms
Shopware
Document Path: /clothing/men/6/shipping-free-product-with-highlighting
Document Length: 50327 bytesConcurrency Level: 1
Time taken for tests: 26.055 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 2546850 bytes
HTML transferred: 2516350 bytes
Requests per second: 1.92 [#/sec] (mean)
Time per request: 521.099 [ms] (mean)
Time per request: 521.099 [ms] (mean, across all concurrent requests)
Transfer rate: 95.46 [Kbytes/sec] receivedConnection Times (ms)
min mean[+/-sd] median max
Connect: 37 60 16.2 56 116
Processing: 339 461 89.9 437 740
Waiting: 205 236 15.6 235 268
Total: 376 521 95.4 485 794
Result: 235ms
4.Product Configurable
M2
Document Path: /deirdre-relaxed-fit-capri.html
Document Length: 72862 bytesConcurrency Level: 1
Time taken for tests: 29.131 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 3671350 bytes
HTML transferred: 3643100 bytes
Requests per second: 1.72 [#/sec] (mean)
Time per request: 582.629 [ms] (mean)
Time per request: 582.629 [ms] (mean, across all concurrent requests)
Transfer rate: 123.07 [Kbytes/sec] receivedConnection Times (ms)
min mean[+/-sd] median max
Connect: 36 51 10.3 50 82
Processing: 449 532 53.2 518 672
Waiting: 257 291 30.9 283 448
Total: 487 583 56.3 566 721
Result: 283ms
Shopware
Document Path: /clothing/women/5/variant-product
Document Length: 53412 bytesConcurrency Level: 1
Time taken for tests: 24.947 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 2701100 bytes
HTML transferred: 2670600 bytes
Requests per second: 2.00 [#/sec] (mean)
Time per request: 498.936 [ms] (mean)
Time per request: 498.936 [ms] (mean, across all concurrent requests)
Transfer rate: 105.74 [Kbytes/sec] receivedConnection Times (ms)
min mean[+/-sd] median max
Connect: 35 55 13.5 53 101
Processing: 346 444 70.7 425 805
Waiting: 225 259 23.8 253 351
Total: 389 499 78.8 477 879
Result: 253ms
5. Cart With Product
M2
298 ms
ShopWare
234 ms
Let’s enable FPC. Magneto certified guys always really upset when somebody testing Magneto without FPC.
6. Home Page FPC
M2
Document Path: /
Document Length: 99835 bytesConcurrency Level: 1
Time taken for tests: 18.106 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 5020000 bytes
HTML transferred: 4991750 bytes
Requests per second: 2.76 [#/sec] (mean)
Time per request: 362.111 [ms] (mean)
Time per request: 362.111 [ms] (mean, across all concurrent requests)
Transfer rate: 270.77 [Kbytes/sec] receivedConnection Times (ms)
min mean[+/-sd] median max
Connect: 35 79 289.1 37 2082
Processing: 253 283 31.7 275 413
Waiting: 60 71 23.1 65 210
Total: 292 362 307.7 314 2486
Result: 65ms
ShopWare
Document Path: /
Document Length: 27648 bytesConcurrency Level: 1
Time taken for tests: 5.841 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 1414450 bytes
HTML transferred: 1382400 bytes
Requests per second: 8.56 [#/sec] (mean)
Time per request: 116.813 [ms] (mean)
Time per request: 116.813 [ms] (mean, across all concurrent requests)
Transfer rate: 236.50 [Kbytes/sec] receivedConnection Times (ms)
min mean[+/-sd] median max
Connect: 35 38 3.0 37 49
Processing: 74 79 3.7 78 95
Waiting: 36 38 1.9 37 45
Total: 111 117 5.4 116 144
Result: 37ms
OMG! ShopWare 5 FPC faster than famous Magento 2 FPC …
Waiting for ShopWare 6 stable release to test it …
Pivot Results Table:
Page Response Time (less is better)
+-------------------------+----------+-----------+------------+
| | Magento2 | Shopware5 | Difference |
+-------------------------+----------+-----------+------------+
| 1. Main Page | 123 | 147 | -16.33% |
+-------------------------+----------+-----------+------------+
| 2. Category | 336 | 307 | 9.45% |
+-------------------------+----------+-----------+------------+
| 5. Product Simple | 333 | 235 | 41.70% |
+-------------------------+----------+-----------+------------+
| 6. Product Configurable | 283 | 253 | 11.86% |
+-------------------------+----------+-----------+------------+
| 7. Cart Page | 298 | 234 | 27.35% |
+-------------------------+----------+-----------+------------+
| 8. FPC | 65 | 37 | 75.68% |
+-------------------------+----------+-----------+------------+
Bonus M2 M1 SW Performance:
As a bonus Performance chart with Magneto 1 response time from my previous test.
Page Response Time (less is better)
+-------------------------+----------+-----------+----------+
| | Magento2 | ShopWare5 | Magento1 |
+-------------------------+----------+-----------+----------+
| 1. Main Page | 123 | 147 | 82 |
+-------------------------+----------+-----------+----------+
| 2. Category | 336 | 307 | 155 |
+-------------------------+----------+-----------+----------+
| 5. Product Simple | 333 | 235 | 141 |
+-------------------------+----------+-----------+----------+
| 6. Product Configurable | 283 | 253 | 160 |
+-------------------------+----------+-----------+----------+
| 7. Cart Page | 298 | 234 | 192 |
+-------------------------+----------+-----------+----------+
| 8. FPC | 65 | 37 | 70 |
+-------------------------+----------+-----------+----------+
This material is my personal opinion about web app performance and shouldn’t be treated as advice and don’t guarantee that it’s true or that it’s reliable. Feel free to do your own test using different configuration and testing methodology.
