ShopWare 5 vs Magento 2 Performance testing

Guys from Mercedes asked me to check performance of old ShopWare 5 (new version is 6 beta) vs innovated super fast Magento 2.3.2

Image for post
Image for post

Installing ShopWare:

wget https://releases.shopware.com/install_5.6.2_6cadc5c14bad4ea8839395461ea42dbc359e9666.zip?_ga=2.180327972.187034925.1570749702-1505405565.1570491800unzip 'install_5.6.2_6cadc5c14bad4ea8839395461ea42dbc359e9666.zip?_ga=2.180327972.187034925.1570749702-1505405565.1570491800' -d shopware

For test I have used the same infrastructure and method as per my previous Magento 2 vs Magento 1 test: https://medium.com/@egorshytikov/magento-2-3-2-vs-magento-1-9-4-php-core-performance-test-b267570b8b3

According to Google Trends ShopWare was more popular in Germany than Magento.

Image for post
Image for post

Disabling FPC cache all another caches enabled

Why? Because:

ShopWare 5 cache configuration module can be found in Settings->Caches / Performance->Settings->Http-Cache.

  1. Home Page
  2. Category
  3. Product Simple
  4. Product Configurable
  5. Cart With Simple Product
  6. Home Page FPC

1.Home Page

M2

Server Hostname:        ec2-54-215-221-187.us-west-1.compute.amazonaws.com
Server Port: 80
Document Path: /
Document Length: 99835 bytes
Concurrency Level: 1
Time taken for tests: 22.320 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 5020000 bytes
HTML transferred: 4991750 bytes
Requests per second: 2.24 [#/sec] (mean)
Time per request: 446.391 [ms] (mean)
Time per request: 446.391 [ms] (mean, across all concurrent requests)
Transfer rate: 219.64 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 36 54 28.4 43 147
Processing: 259 393 131.5 353 910
Waiting: 112 127 13.0 123 171
Total: 298 446 136.8 400 959

Result: 123ms

ShopWare

Document Path:          /
Document Length: 27648 bytes
Concurrency Level: 1
Time taken for tests: 13.535 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 1412900 bytes
HTML transferred: 1382400 bytes
Requests per second: 3.69 [#/sec] (mean)
Time per request: 270.701 [ms] (mean)
Time per request: 270.701 [ms] (mean, across all concurrent requests)
Transfer rate: 101.94 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 35 46 24.5 40 197
Processing: 182 225 75.6 202 597
Waiting: 135 148 9.9 147 177
Total: 220 271 92.5 249 794

Result: 147ms

2. Category

M2

Document Path:          /gear/fitness-equipment.html
Document Length: 123486 bytes
Concurrency Level: 1
Time taken for tests: 36.305 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 6202550 bytes
HTML transferred: 6174300 bytes
Requests per second: 1.38 [#/sec] (mean)
Time per request: 726.092 [ms] (mean)
Time per request: 726.092 [ms] (mean, across all concurrent requests)
Transfer rate: 166.84 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 35 42 6.3 40 62
Processing: 607 684 66.5 669 893
Waiting: 308 348 47.9 336 596
Total: 650 726 66.6 707 930

Result: 336ms

ShopWare

Document Path:          /clothing/
Document Length: 66739 bytes
Concurrency Level: 1
Time taken for tests: 30.195 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 3367450 bytes
HTML transferred: 3336950 bytes
Requests per second: 1.66 [#/sec] (mean)
Time per request: 603.897 [ms] (mean)
Time per request: 603.897 [ms] (mean, across all concurrent requests)
Transfer rate: 108.91 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 35 50 7.9 50 69
Processing: 469 554 73.8 543 821
Waiting: 274 316 51.0 307 630
Total: 510 604 74.8 597 874

Result: 307ms

3.Product Simple Page

M2

Document Path:          /sprite-foam-roller.html
Document Length: 82798 bytes
Concurrency Level: 1
Time taken for tests: 37.477 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 4168150 bytes
HTML transferred: 4139900 bytes
Requests per second: 1.33 [#/sec] (mean)
Time per request: 749.537 [ms] (mean)
Time per request: 749.537 [ms] (mean, across all concurrent requests)
Transfer rate: 108.61 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 36 53 11.5 51 95
Processing: 553 696 125.4 667 1047
Waiting: 301 340 30.2 333 487
Total: 593 749 130.8 715 1106

Result: 333ms

Shopware

Document Path:          /clothing/men/6/shipping-free-product-with-highlighting
Document Length: 50327 bytes
Concurrency Level: 1
Time taken for tests: 26.055 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 2546850 bytes
HTML transferred: 2516350 bytes
Requests per second: 1.92 [#/sec] (mean)
Time per request: 521.099 [ms] (mean)
Time per request: 521.099 [ms] (mean, across all concurrent requests)
Transfer rate: 95.46 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 37 60 16.2 56 116
Processing: 339 461 89.9 437 740
Waiting: 205 236 15.6 235 268
Total: 376 521 95.4 485 794

Result: 235ms

4.Product Configurable

M2

Document Path:          /deirdre-relaxed-fit-capri.html
Document Length: 72862 bytes
Concurrency Level: 1
Time taken for tests: 29.131 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 3671350 bytes
HTML transferred: 3643100 bytes
Requests per second: 1.72 [#/sec] (mean)
Time per request: 582.629 [ms] (mean)
Time per request: 582.629 [ms] (mean, across all concurrent requests)
Transfer rate: 123.07 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 36 51 10.3 50 82
Processing: 449 532 53.2 518 672
Waiting: 257 291 30.9 283 448
Total: 487 583 56.3 566 721

Result: 283ms

Shopware

Document Path:          /clothing/women/5/variant-product
Document Length: 53412 bytes
Concurrency Level: 1
Time taken for tests: 24.947 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 2701100 bytes
HTML transferred: 2670600 bytes
Requests per second: 2.00 [#/sec] (mean)
Time per request: 498.936 [ms] (mean)
Time per request: 498.936 [ms] (mean, across all concurrent requests)
Transfer rate: 105.74 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 35 55 13.5 53 101
Processing: 346 444 70.7 425 805
Waiting: 225 259 23.8 253 351
Total: 389 499 78.8 477 879

Result: 253ms

5. Cart With Product

M2

298 ms

ShopWare

234 ms

Let’s enable FPC. Magneto certified guys always really upset when somebody testing Magneto without FPC.

Image for post
Image for post
Magento 2 FPC

6. Home Page FPC

M2

Document Path:          /
Document Length: 99835 bytes
Concurrency Level: 1
Time taken for tests: 18.106 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 5020000 bytes
HTML transferred: 4991750 bytes
Requests per second: 2.76 [#/sec] (mean)
Time per request: 362.111 [ms] (mean)
Time per request: 362.111 [ms] (mean, across all concurrent requests)
Transfer rate: 270.77 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 35 79 289.1 37 2082
Processing: 253 283 31.7 275 413
Waiting: 60 71 23.1 65 210
Total: 292 362 307.7 314 2486

Result: 65ms

ShopWare

Document Path:          /
Document Length: 27648 bytes
Concurrency Level: 1
Time taken for tests: 5.841 seconds
Complete requests: 50
Failed requests: 0
Total transferred: 1414450 bytes
HTML transferred: 1382400 bytes
Requests per second: 8.56 [#/sec] (mean)
Time per request: 116.813 [ms] (mean)
Time per request: 116.813 [ms] (mean, across all concurrent requests)
Transfer rate: 236.50 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 35 38 3.0 37 49
Processing: 74 79 3.7 78 95
Waiting: 36 38 1.9 37 45
Total: 111 117 5.4 116 144

Result: 37ms

OMG! ShopWare 5 FPC faster than famous Magento 2 FPC …

Waiting for ShopWare 6 stable release to test it …

Pivot Results Table:

Page Response Time (less is better)

+-------------------------+----------+-----------+------------+
| | Magento2 | Shopware5 | Difference |
+-------------------------+----------+-----------+------------+
| 1. Main Page | 123 | 147 | -16.33% |
+-------------------------+----------+-----------+------------+
| 2. Category | 336 | 307 | 9.45% |
+-------------------------+----------+-----------+------------+
| 5. Product Simple | 333 | 235 | 41.70% |
+-------------------------+----------+-----------+------------+
| 6. Product Configurable | 283 | 253 | 11.86% |
+-------------------------+----------+-----------+------------+
| 7. Cart Page | 298 | 234 | 27.35% |
+-------------------------+----------+-----------+------------+
| 8. FPC | 65 | 37 | 75.68% |
+-------------------------+----------+-----------+------------+
Image for post
Image for post
Performance Magemto 2 vs ShopWare 5

As a bonus Performance chart with Magneto 1 response time from my previous test.

Page Response Time (less is better)

+-------------------------+----------+-----------+----------+
| | Magento2 | ShopWare5 | Magento1 |
+-------------------------+----------+-----------+----------+
| 1. Main Page | 123 | 147 | 82 |
+-------------------------+----------+-----------+----------+
| 2. Category | 336 | 307 | 155 |
+-------------------------+----------+-----------+----------+
| 5. Product Simple | 333 | 235 | 141 |
+-------------------------+----------+-----------+----------+
| 6. Product Configurable | 283 | 253 | 160 |
+-------------------------+----------+-----------+----------+
| 7. Cart Page | 298 | 234 | 192 |
+-------------------------+----------+-----------+----------+
| 8. FPC | 65 | 37 | 70 |
+-------------------------+----------+-----------+----------+
Image for post
Image for post
Performance M2 vs ShopWare5 vs M1

This material is my personal opinion about web app performance and shouldn’t be treated as advice and don’t guarantee that it’s true or that it’s reliable. Feel free to do your own test using different configuration and testing methodology.

Written by

Magento/APP Cloud Architect. Melting metal server infrastructure into cloud solutions.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store