C:\Installs\DiskSpd\amd64>.\diskspd.exe -t8 -o1 -b4k -r4k -w100 -d900 -Sh -D -L -Zr -c128G D:\diskspd.dat Command Line: .\diskspd.exe -t8 -o1 -b4k -r4k -w100 -d900 -Sh -D -L -Zr -c128G D:\diskspd.dat Input parameters: timespan: 1 ------------- duration: 900s warm up time: 5s cool down time: 0s measuring latency gathering IOPS at intervals of 1000ms random seed: 0 generating random data for each write IO WARNING: this increases the CPU cost of issuing writes and should only be compared to other results using the -Zr flag path: 'D:\diskspd.dat' think time: 0ms burst size: 0 software cache disabled hardware write cache disabled, writethrough on performing write test block size: 4KiB using random I/O (alignment: 4KiB) number of outstanding I/O operations per thread: 1 threads per file: 8 IO priority: normal System information: computer name: winspd-proxmox start time: 2024/11/07 21:15:59 UTC cpu count: 8 core count: 8 group count: 1 node count: 1 socket count: 2 heterogeneous cores: n active power scheme: Balanced (381b4222-f694-41f0-9685-ff5bb260df2e) Results for timespan 1: ******************************************************************************* actual test time: 900.01s thread count: 8 Socket | CPU | Usage | User | Kernel | Idle ------------------------------------------------- 0| 0| 35.09%| 2.50%| 32.59%| 64.91% 0| 1| 33.05%| 2.33%| 30.73%| 66.95% 0| 2| 33.19%| 2.48%| 30.71%| 66.81% 0| 3| 32.95%| 2.07%| 30.88%| 67.05% 1| 4| 32.28%| 2.08%| 30.20%| 67.72% 1| 5| 32.77%| 2.54%| 30.23%| 67.23% 1| 6| 33.57%| 2.43%| 31.14%| 66.43% 1| 7| 33.97%| 2.51%| 31.47%| 66.03% ------------------------------------------------- avg.| 33.36%| 2.37%| 30.99%| 66.64% Total IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | IopsStdDev | LatStdDev | file ------------------------------------------------------------------------------------------------------------------ 0 | 48715755520 | 11893495 | 51.62 | 13214.81 | 0.075 | 1283.60 | 0.046 | D:\diskspd.dat (128GiB) 1 | 51495239680 | 12572080 | 54.57 | 13968.78 | 0.071 | 954.20 | 0.055 | D:\diskspd.dat (128GiB) 2 | 50502963200 | 12329825 | 53.51 | 13699.61 | 0.072 | 1089.96 | 0.085 | D:\diskspd.dat (128GiB) 3 | 51554869248 | 12586638 | 54.63 | 13984.96 | 0.071 | 892.54 | 0.037 | D:\diskspd.dat (128GiB) 4 | 51919974400 | 12675775 | 55.02 | 14084.00 | 0.070 | 993.23 | 0.025 | D:\diskspd.dat (128GiB) 5 | 50203422720 | 12256695 | 53.20 | 13618.36 | 0.073 | 1348.50 | 0.048 | D:\diskspd.dat (128GiB) 6 | 51098144768 | 12475133 | 54.14 | 13861.06 | 0.072 | 1078.09 | 0.033 | D:\diskspd.dat (128GiB) 7 | 50354327552 | 12293537 | 53.36 | 13659.29 | 0.073 | 1127.78 | 0.038 | D:\diskspd.dat (128GiB) ------------------------------------------------------------------------------------------------------------------ total: 405844697088 | 99083178 | 430.04 | 110090.88 | 0.072 | 7112.79 | 0.049 Read IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | IopsStdDev | LatStdDev | file ------------------------------------------------------------------------------------------------------------------ 0 | 0 | 0 | 0.00 | 0.00 | 0.000 | 0.00 | N/A | D:\diskspd.dat (128GiB) 1 | 0 | 0 | 0.00 | 0.00 | 0.000 | 0.00 | N/A | D:\diskspd.dat (128GiB) 2 | 0 | 0 | 0.00 | 0.00 | 0.000 | 0.00 | N/A | D:\diskspd.dat (128GiB) 3 | 0 | 0 | 0.00 | 0.00 | 0.000 | 0.00 | N/A | D:\diskspd.dat (128GiB) 4 | 0 | 0 | 0.00 | 0.00 | 0.000 | 0.00 | N/A | D:\diskspd.dat (128GiB) 5 | 0 | 0 | 0.00 | 0.00 | 0.000 | 0.00 | N/A | D:\diskspd.dat (128GiB) 6 | 0 | 0 | 0.00 | 0.00 | 0.000 | 0.00 | N/A | D:\diskspd.dat (128GiB) 7 | 0 | 0 | 0.00 | 0.00 | 0.000 | 0.00 | N/A | D:\diskspd.dat (128GiB) ------------------------------------------------------------------------------------------------------------------ total: 0 | 0 | 0.00 | 0.00 | 0.000 | 0.00 | N/A Write IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | IopsStdDev | LatStdDev | file ------------------------------------------------------------------------------------------------------------------ 0 | 48715755520 | 11893495 | 51.62 | 13214.81 | 0.075 | 1283.60 | 0.046 | D:\diskspd.dat (128GiB) 1 | 51495239680 | 12572080 | 54.57 | 13968.78 | 0.071 | 954.20 | 0.055 | D:\diskspd.dat (128GiB) 2 | 50502963200 | 12329825 | 53.51 | 13699.61 | 0.072 | 1089.96 | 0.085 | D:\diskspd.dat (128GiB) 3 | 51554869248 | 12586638 | 54.63 | 13984.96 | 0.071 | 892.54 | 0.037 | D:\diskspd.dat (128GiB) 4 | 51919974400 | 12675775 | 55.02 | 14084.00 | 0.070 | 993.23 | 0.025 | D:\diskspd.dat (128GiB) 5 | 50203422720 | 12256695 | 53.20 | 13618.36 | 0.073 | 1348.50 | 0.048 | D:\diskspd.dat (128GiB) 6 | 51098144768 | 12475133 | 54.14 | 13861.06 | 0.072 | 1078.09 | 0.033 | D:\diskspd.dat (128GiB) 7 | 50354327552 | 12293537 | 53.36 | 13659.29 | 0.073 | 1127.78 | 0.038 | D:\diskspd.dat (128GiB) ------------------------------------------------------------------------------------------------------------------ total: 405844697088 | 99083178 | 430.04 | 110090.88 | 0.072 | 7112.79 | 0.049 Total latency distribution: %-ile | Read (ms) | Write (ms) | Total (ms) ---------------------------------------------- min | N/A | 0.043 | 0.043 25th | N/A | 0.064 | 0.064 50th | N/A | 0.071 | 0.071 75th | N/A | 0.078 | 0.078 90th | N/A | 0.086 | 0.086 95th | N/A | 0.091 | 0.091 99th | N/A | 0.103 | 0.103 3-nines | N/A | 0.123 | 0.123 4-nines | N/A | 0.257 | 0.257 5-nines | N/A | 1.226 | 1.226 6-nines | N/A | 5.648 | 5.648 7-nines | N/A | 54.692 | 54.692 8-nines | N/A | 294.896 | 294.896 9-nines | N/A | 294.896 | 294.896 max | N/A | 294.896 | 294.896 C:\Installs\DiskSpd\amd64>.\diskspd.exe -b4K -o16 -d900 -r -w40 -t8 -Sh -D -L -c128G D:\diskspd.dat Command Line: .\diskspd.exe -b4K -o16 -d900 -r -w40 -t8 -Sh -D -L -c128G D:\diskspd.dat Input parameters: timespan: 1 ------------- duration: 900s warm up time: 5s cool down time: 0s measuring latency gathering IOPS at intervals of 1000ms random seed: 0 path: 'D:\diskspd.dat' think time: 0ms burst size: 0 software cache disabled hardware write cache disabled, writethrough on performing mix test (read/write ratio: 60/40) block size: 4KiB using random I/O (alignment: 4KiB) number of outstanding I/O operations per thread: 16 threads per file: 8 using I/O Completion Ports IO priority: normal System information: computer name: winspd-proxmox start time: 2024/11/07 23:13:22 UTC cpu count: 8 core count: 8 group count: 1 node count: 1 socket count: 2 heterogeneous cores: n active power scheme: Balanced (381b4222-f694-41f0-9685-ff5bb260df2e) Results for timespan 1: ******************************************************************************* actual test time: 900.00s thread count: 8 Socket | CPU | Usage | User | Kernel | Idle ------------------------------------------------- 0| 0| 40.17%| 2.09%| 38.08%| 59.83% 0| 1| 40.19%| 2.23%| 37.96%| 59.81% 0| 2| 41.03%| 2.25%| 38.78%| 58.97% 0| 3| 42.04%| 2.29%| 39.75%| 57.96% 1| 4| 40.75%| 2.34%| 38.42%| 59.25% 1| 5| 40.09%| 2.11%| 37.98%| 59.91% 1| 6| 41.02%| 2.17%| 38.85%| 58.98% 1| 7| 39.68%| 2.10%| 37.58%| 60.32% ------------------------------------------------- avg.| 40.62%| 2.20%| 38.42%| 59.38% Total IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | IopsStdDev | LatStdDev | file ------------------------------------------------------------------------------------------------------------------ 0 | 71982538752 | 17573862 | 76.28 | 19526.51 | 0.805 | 866.85 | 0.304 | D:\diskspd.dat (128GiB) 1 | 71854587904 | 17542624 | 76.14 | 19491.80 | 0.805 | 904.19 | 0.306 | D:\diskspd.dat (128GiB) 2 | 70938030080 | 17318855 | 75.17 | 19243.17 | 0.812 | 1083.76 | 0.308 | D:\diskspd.dat (128GiB) 3 | 70054535168 | 17103158 | 74.23 | 19003.51 | 0.819 | 1106.76 | 0.318 | D:\diskspd.dat (128GiB) 4 | 71516565504 | 17460099 | 75.78 | 19400.11 | 0.808 | 1004.58 | 0.310 | D:\diskspd.dat (128GiB) 5 | 71904841728 | 17554893 | 76.19 | 19505.43 | 0.805 | 938.57 | 0.305 | D:\diskspd.dat (128GiB) 6 | 71010656256 | 17336586 | 75.25 | 19262.87 | 0.813 | 1039.95 | 0.307 | D:\diskspd.dat (128GiB) 7 | 71990304768 | 17575758 | 76.28 | 19528.62 | 0.805 | 870.57 | 0.306 | D:\diskspd.dat (128GiB) ------------------------------------------------------------------------------------------------------------------ total: 571252060160 | 139465835 | 605.32 | 154962.01 | 0.809 | 7117.36 | 0.308 Read IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | IopsStdDev | LatStdDev | file ------------------------------------------------------------------------------------------------------------------ 0 | 43181416448 | 10542338 | 45.76 | 11713.71 | 0.812 | 525.86 | 0.303 | D:\diskspd.dat (128GiB) 1 | 43115364352 | 10526212 | 45.69 | 11695.79 | 0.812 | 548.02 | 0.310 | D:\diskspd.dat (128GiB) 2 | 42565353472 | 10391932 | 45.10 | 11546.59 | 0.818 | 651.45 | 0.312 | D:\diskspd.dat (128GiB) 3 | 42034479104 | 10262324 | 44.54 | 11402.58 | 0.824 | 666.96 | 0.308 | D:\diskspd.dat (128GiB) 4 | 42896228352 | 10472712 | 45.45 | 11636.34 | 0.814 | 606.58 | 0.319 | D:\diskspd.dat (128GiB) 5 | 43130761216 | 10529971 | 45.70 | 11699.97 | 0.812 | 566.31 | 0.304 | D:\diskspd.dat (128GiB) 6 | 42600484864 | 10400509 | 45.14 | 11556.12 | 0.818 | 626.60 | 0.308 | D:\diskspd.dat (128GiB) 7 | 43181613056 | 10542386 | 45.76 | 11713.76 | 0.812 | 527.05 | 0.304 | D:\diskspd.dat (128GiB) ------------------------------------------------------------------------------------------------------------------ total: 342705700864 | 83668384 | 363.14 | 92964.85 | 0.815 | 4274.83 | 0.309 Write IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | IopsStdDev | LatStdDev | file ------------------------------------------------------------------------------------------------------------------ 0 | 28801122304 | 7031524 | 30.52 | 7812.80 | 0.795 | 351.93 | 0.304 | D:\diskspd.dat (128GiB) 1 | 28739223552 | 7016412 | 30.45 | 7796.01 | 0.795 | 367.25 | 0.299 | D:\diskspd.dat (128GiB) 2 | 28372676608 | 6926923 | 30.06 | 7696.58 | 0.803 | 441.33 | 0.302 | D:\diskspd.dat (128GiB) 3 | 28020056064 | 6840834 | 29.69 | 7600.93 | 0.811 | 448.23 | 0.331 | D:\diskspd.dat (128GiB) 4 | 28620337152 | 6987387 | 30.33 | 7763.76 | 0.798 | 406.83 | 0.297 | D:\diskspd.dat (128GiB) 5 | 28774080512 | 7024922 | 30.49 | 7805.47 | 0.795 | 381.97 | 0.306 | D:\diskspd.dat (128GiB) 6 | 28410171392 | 6936077 | 30.10 | 7706.75 | 0.804 | 422.48 | 0.306 | D:\diskspd.dat (128GiB) 7 | 28808691712 | 7033372 | 30.53 | 7814.86 | 0.794 | 355.18 | 0.308 | D:\diskspd.dat (128GiB) ------------------------------------------------------------------------------------------------------------------ total: 228546359296 | 55797451 | 242.18 | 61997.16 | 0.799 | 2854.15 | 0.307 Total latency distribution: %-ile | Read (ms) | Write (ms) | Total (ms) ---------------------------------------------- min | 0.092 | 0.064 | 0.064 25th | 0.757 | 0.737 | 0.749 50th | 0.803 | 0.790 | 0.798 75th | 0.857 | 0.850 | 0.854 90th | 0.916 | 0.909 | 0.913 95th | 0.961 | 0.947 | 0.955 99th | 1.092 | 1.030 | 1.066 3-nines | 1.343 | 1.208 | 1.307 4-nines | 2.080 | 1.875 | 1.994 5-nines | 68.757 | 68.816 | 68.785 6-nines | 72.411 | 72.364 | 72.389 7-nines | 73.594 | 73.850 | 73.606 8-nines | 74.207 | 74.240 | 74.211 9-nines | 74.207 | 74.240 | 74.240 max | 74.207 | 74.240 | 74.240 C:\Installs\DiskSpd\amd64>.\diskspd.exe -b4K -o1 -d900 -r -w40 -t8 -Sh -D -L -c128G D:\diskspd.dat Command Line: .\diskspd.exe -b4K -o1 -d900 -r -w40 -t8 -Sh -D -L -c128G D:\diskspd.dat Input parameters: timespan: 1 ------------- duration: 900s warm up time: 5s cool down time: 0s measuring latency gathering IOPS at intervals of 1000ms random seed: 0 path: 'D:\diskspd.dat' think time: 0ms burst size: 0 software cache disabled hardware write cache disabled, writethrough on performing mix test (read/write ratio: 60/40) block size: 4KiB using random I/O (alignment: 4KiB) number of outstanding I/O operations per thread: 1 threads per file: 8 IO priority: normal System information: computer name: winspd-proxmox start time: 2024/11/07 23:28:49 UTC cpu count: 8 core count: 8 group count: 1 node count: 1 socket count: 2 heterogeneous cores: n active power scheme: Balanced (381b4222-f694-41f0-9685-ff5bb260df2e) Results for timespan 1: ******************************************************************************* actual test time: 900.00s thread count: 8 Socket | CPU | Usage | User | Kernel | Idle ------------------------------------------------- 0| 0| 23.18%| 1.39%| 21.79%| 76.82% 0| 1| 22.42%| 1.35%| 21.07%| 77.58% 0| 2| 22.51%| 1.42%| 21.09%| 77.49% 0| 3| 23.07%| 1.33%| 21.74%| 76.93% 1| 4| 22.71%| 1.29%| 21.41%| 77.29% 1| 5| 22.26%| 1.34%| 20.92%| 77.74% 1| 6| 22.60%| 1.57%| 21.02%| 77.40% 1| 7| 22.52%| 1.33%| 21.19%| 77.48% ------------------------------------------------- avg.| 22.66%| 1.38%| 21.28%| 77.34% Total IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | IopsStdDev | LatStdDev | file ------------------------------------------------------------------------------------------------------------------ 0 | 38917206016 | 9501271 | 41.24 | 10556.97 | 0.094 | 655.55 | 0.052 | D:\diskspd.dat (128GiB) 1 | 39357456384 | 9608754 | 41.70 | 10676.39 | 0.093 | 648.32 | 0.051 | D:\diskspd.dat (128GiB) 2 | 39068499968 | 9538208 | 41.40 | 10598.01 | 0.094 | 689.91 | 0.051 | D:\diskspd.dat (128GiB) 3 | 38828810240 | 9479690 | 41.14 | 10532.99 | 0.094 | 700.88 | 0.051 | D:\diskspd.dat (128GiB) 4 | 39495852032 | 9642542 | 41.85 | 10713.94 | 0.093 | 643.67 | 0.050 | D:\diskspd.dat (128GiB) 5 | 39369232384 | 9611629 | 41.72 | 10679.59 | 0.093 | 661.95 | 0.051 | D:\diskspd.dat (128GiB) 6 | 39125262336 | 9552066 | 41.46 | 10613.41 | 0.094 | 672.37 | 0.051 | D:\diskspd.dat (128GiB) 7 | 38124617728 | 9307768 | 40.40 | 10341.96 | 0.096 | 863.98 | 0.051 | D:\diskspd.dat (128GiB) ------------------------------------------------------------------------------------------------------------------ total: 312286937088 | 76241928 | 330.91 | 84713.26 | 0.094 | 5225.78 | 0.051 Read IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | IopsStdDev | LatStdDev | file ------------------------------------------------------------------------------------------------------------------ 0 | 23338975232 | 5697992 | 24.73 | 6331.10 | 0.112 | 394.73 | 0.050 | D:\diskspd.dat (128GiB) 1 | 23612858368 | 5764858 | 25.02 | 6405.40 | 0.111 | 389.07 | 0.049 | D:\diskspd.dat (128GiB) 2 | 23438807040 | 5722365 | 24.84 | 6358.18 | 0.111 | 416.05 | 0.048 | D:\diskspd.dat (128GiB) 3 | 23301087232 | 5688742 | 24.69 | 6320.82 | 0.112 | 422.50 | 0.049 | D:\diskspd.dat (128GiB) 4 | 23690260480 | 5783755 | 25.10 | 6426.39 | 0.110 | 386.84 | 0.048 | D:\diskspd.dat (128GiB) 5 | 23615361024 | 5765469 | 25.02 | 6406.08 | 0.110 | 398.40 | 0.048 | D:\diskspd.dat (128GiB) 6 | 23476088832 | 5731467 | 24.88 | 6368.30 | 0.111 | 403.68 | 0.049 | D:\diskspd.dat (128GiB) 7 | 22861201408 | 5581348 | 24.22 | 6201.50 | 0.113 | 520.41 | 0.050 | D:\diskspd.dat (128GiB) ------------------------------------------------------------------------------------------------------------------ total: 187334639616 | 45735996 | 198.51 | 50817.78 | 0.111 | 3136.47 | 0.049 Write IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | IopsStdDev | LatStdDev | file ------------------------------------------------------------------------------------------------------------------ 0 | 15578230784 | 3803279 | 16.51 | 4225.87 | 0.068 | 268.26 | 0.044 | D:\diskspd.dat (128GiB) 1 | 15744598016 | 3843896 | 16.68 | 4271.00 | 0.067 | 267.73 | 0.041 | D:\diskspd.dat (128GiB) 2 | 15629692928 | 3815843 | 16.56 | 4239.83 | 0.068 | 281.84 | 0.044 | D:\diskspd.dat (128GiB) 3 | 15527723008 | 3790948 | 16.45 | 4212.16 | 0.069 | 285.97 | 0.041 | D:\diskspd.dat (128GiB) 4 | 15805591552 | 3858787 | 16.75 | 4287.54 | 0.067 | 264.58 | 0.042 | D:\diskspd.dat (128GiB) 5 | 15753871360 | 3846160 | 16.69 | 4273.51 | 0.067 | 270.64 | 0.042 | D:\diskspd.dat (128GiB) 6 | 15649173504 | 3820599 | 16.58 | 4245.11 | 0.068 | 275.89 | 0.042 | D:\diskspd.dat (128GiB) 7 | 15263416320 | 3726420 | 16.17 | 4140.47 | 0.071 | 349.42 | 0.042 | D:\diskspd.dat (128GiB) ------------------------------------------------------------------------------------------------------------------ total: 124952297472 | 30505932 | 132.40 | 33895.48 | 0.068 | 2096.80 | 0.042 Total latency distribution: %-ile | Read (ms) | Write (ms) | Total (ms) ---------------------------------------------- min | 0.037 | 0.043 | 0.037 25th | 0.100 | 0.062 | 0.069 50th | 0.105 | 0.066 | 0.098 75th | 0.113 | 0.071 | 0.107 90th | 0.123 | 0.077 | 0.116 95th | 0.150 | 0.083 | 0.135 99th | 0.207 | 0.109 | 0.186 3-nines | 0.442 | 0.169 | 0.403 4-nines | 1.354 | 0.397 | 1.149 5-nines | 5.723 | 5.723 | 5.723 6-nines | 6.321 | 6.340 | 6.321 7-nines | 7.586 | 8.598 | 8.598 8-nines | 10.611 | 8.653 | 10.611 9-nines | 10.611 | 8.653 | 10.611 max | 10.611 | 8.653 | 10.611