C:\Installs\DiskSpd\amd64>.\diskspd.exe -t8 -o1 -b4k -r4k -w100 -d900 -Sh -D -L -Zr -c128G D:\diskspd.dat Command Line: .\diskspd.exe -t8 -o1 -b4k -r4k -w100 -d900 -Sh -D -L -Zr -c128G D:\diskspd.dat Input parameters: timespan: 1 ------------- duration: 900s warm up time: 5s cool down time: 0s measuring latency gathering IOPS at intervals of 1000ms random seed: 0 generating random data for each write IO WARNING: this increases the CPU cost of issuing writes and should only be compared to other results using the -Zr flag path: 'D:\diskspd.dat' think time: 0ms burst size: 0 software cache disabled hardware write cache disabled, writethrough on performing write test block size: 4KiB using random I/O (alignment: 4KiB) number of outstanding I/O operations per thread: 1 threads per file: 8 IO priority: normal System information: computer name: winspd-proxmox start time: 2024/11/07 15:59:02 UTC cpu count: 8 core count: 8 group count: 1 node count: 1 socket count: 2 heterogeneous cores: n active power scheme: Balanced (381b4222-f694-41f0-9685-ff5bb260df2e) Results for timespan 1: ******************************************************************************* actual test time: 900.01s thread count: 8 Socket | CPU | Usage | User | Kernel | Idle ------------------------------------------------- 0| 0| 14.09%| 0.98%| 13.11%| 85.91% 0| 1| 13.65%| 1.12%| 12.53%| 86.35% 0| 2| 13.65%| 1.10%| 12.54%| 86.35% 0| 3| 13.45%| 0.95%| 12.50%| 86.55% 1| 4| 13.71%| 0.93%| 12.78%| 86.29% 1| 5| 13.54%| 1.01%| 12.52%| 86.46% 1| 6| 13.64%| 1.21%| 12.42%| 86.36% 1| 7| 13.92%| 1.11%| 12.81%| 86.08% ------------------------------------------------- avg.| 13.70%| 1.05%| 12.65%| 86.30% Total IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | IopsStdDev | LatStdDev | file ------------------------------------------------------------------------------------------------------------------ 0 | 19716341760 | 4813560 | 20.89 | 5348.31 | 0.186 | 235.25 | 0.025 | D:\diskspd.dat (128GiB) 1 | 19747581952 | 4821187 | 20.92 | 5356.79 | 0.186 | 234.86 | 0.042 | D:\diskspd.dat (128GiB) 2 | 19758120960 | 4823760 | 20.94 | 5359.64 | 0.186 | 233.34 | 0.022 | D:\diskspd.dat (128GiB) 3 | 19765030912 | 4825447 | 20.94 | 5361.52 | 0.186 | 235.95 | 0.026 | D:\diskspd.dat (128GiB) 4 | 19737468928 | 4818718 | 20.91 | 5354.04 | 0.186 | 235.73 | 0.041 | D:\diskspd.dat (128GiB) 5 | 19741417472 | 4819682 | 20.92 | 5355.11 | 0.186 | 234.03 | 0.055 | D:\diskspd.dat (128GiB) 6 | 19730251776 | 4816956 | 20.91 | 5352.08 | 0.186 | 234.50 | 0.030 | D:\diskspd.dat (128GiB) 7 | 19736461312 | 4818472 | 20.91 | 5353.77 | 0.186 | 232.29 | 0.021 | D:\diskspd.dat (128GiB) ------------------------------------------------------------------------------------------------------------------ total: 157932675072 | 38557782 | 167.35 | 42841.27 | 0.186 | 1868.31 | 0.035 Read IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | IopsStdDev | LatStdDev | file ------------------------------------------------------------------------------------------------------------------ 0 | 0 | 0 | 0.00 | 0.00 | 0.000 | 0.00 | N/A | D:\diskspd.dat (128GiB) 1 | 0 | 0 | 0.00 | 0.00 | 0.000 | 0.00 | N/A | D:\diskspd.dat (128GiB) 2 | 0 | 0 | 0.00 | 0.00 | 0.000 | 0.00 | N/A | D:\diskspd.dat (128GiB) 3 | 0 | 0 | 0.00 | 0.00 | 0.000 | 0.00 | N/A | D:\diskspd.dat (128GiB) 4 | 0 | 0 | 0.00 | 0.00 | 0.000 | 0.00 | N/A | D:\diskspd.dat (128GiB) 5 | 0 | 0 | 0.00 | 0.00 | 0.000 | 0.00 | N/A | D:\diskspd.dat (128GiB) 6 | 0 | 0 | 0.00 | 0.00 | 0.000 | 0.00 | N/A | D:\diskspd.dat (128GiB) 7 | 0 | 0 | 0.00 | 0.00 | 0.000 | 0.00 | N/A | D:\diskspd.dat (128GiB) ------------------------------------------------------------------------------------------------------------------ total: 0 | 0 | 0.00 | 0.00 | 0.000 | 0.00 | N/A Write IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | IopsStdDev | LatStdDev | file ------------------------------------------------------------------------------------------------------------------ 0 | 19716341760 | 4813560 | 20.89 | 5348.31 | 0.186 | 235.25 | 0.025 | D:\diskspd.dat (128GiB) 1 | 19747581952 | 4821187 | 20.92 | 5356.79 | 0.186 | 234.86 | 0.042 | D:\diskspd.dat (128GiB) 2 | 19758120960 | 4823760 | 20.94 | 5359.64 | 0.186 | 233.34 | 0.022 | D:\diskspd.dat (128GiB) 3 | 19765030912 | 4825447 | 20.94 | 5361.52 | 0.186 | 235.95 | 0.026 | D:\diskspd.dat (128GiB) 4 | 19737468928 | 4818718 | 20.91 | 5354.04 | 0.186 | 235.73 | 0.041 | D:\diskspd.dat (128GiB) 5 | 19741417472 | 4819682 | 20.92 | 5355.11 | 0.186 | 234.03 | 0.055 | D:\diskspd.dat (128GiB) 6 | 19730251776 | 4816956 | 20.91 | 5352.08 | 0.186 | 234.50 | 0.030 | D:\diskspd.dat (128GiB) 7 | 19736461312 | 4818472 | 20.91 | 5353.77 | 0.186 | 232.29 | 0.021 | D:\diskspd.dat (128GiB) ------------------------------------------------------------------------------------------------------------------ total: 157932675072 | 38557782 | 167.35 | 42841.27 | 0.186 | 1868.31 | 0.035 Total latency distribution: %-ile | Read (ms) | Write (ms) | Total (ms) ---------------------------------------------- min | N/A | 0.052 | 0.052 25th | N/A | 0.177 | 0.177 50th | N/A | 0.186 | 0.186 75th | N/A | 0.194 | 0.194 90th | N/A | 0.202 | 0.202 95th | N/A | 0.208 | 0.208 99th | N/A | 0.231 | 0.231 3-nines | N/A | 0.287 | 0.287 4-nines | N/A | 0.874 | 0.874 5-nines | N/A | 2.007 | 2.007 6-nines | N/A | 5.661 | 5.661 7-nines | N/A | 74.875 | 74.875 8-nines | N/A | 79.229 | 79.229 9-nines | N/A | 79.229 | 79.229 max | N/A | 79.229 | 79.229 C:\Installs\DiskSpd\amd64>.\diskspd.exe -b4K -o16 -d900 -r -w40 -t8 -Sh -D -L -c128G D:\diskspd.dat Command Line: .\diskspd.exe -b4K -o16 -d900 -r -w40 -t8 -Sh -D -L -c128G D:\diskspd.dat Input parameters: timespan: 1 ------------- duration: 900s warm up time: 5s cool down time: 0s measuring latency gathering IOPS at intervals of 1000ms random seed: 0 path: 'D:\diskspd.dat' think time: 0ms burst size: 0 software cache disabled hardware write cache disabled, writethrough on performing mix test (read/write ratio: 60/40) block size: 4KiB using random I/O (alignment: 4KiB) number of outstanding I/O operations per thread: 16 threads per file: 8 using I/O Completion Ports IO priority: normal System information: computer name: winspd-proxmox start time: 2024/11/07 16:19:56 UTC cpu count: 8 core count: 8 group count: 1 node count: 1 socket count: 2 heterogeneous cores: n active power scheme: Balanced (381b4222-f694-41f0-9685-ff5bb260df2e) Results for timespan 1: ******************************************************************************* actual test time: 900.00s thread count: 8 Socket | CPU | Usage | User | Kernel | Idle ------------------------------------------------- 0| 0| 17.23%| 0.95%| 16.28%| 82.77% 0| 1| 17.06%| 1.17%| 15.89%| 82.94% 0| 2| 17.07%| 1.26%| 15.82%| 82.93% 0| 3| 17.20%| 1.20%| 16.00%| 82.80% 1| 4| 16.25%| 1.18%| 15.07%| 83.75% 1| 5| 16.36%| 1.14%| 15.22%| 83.64% 1| 6| 16.05%| 1.05%| 15.00%| 83.95% 1| 7| 16.44%| 0.96%| 15.48%| 83.56% ------------------------------------------------- avg.| 16.71%| 1.11%| 15.59%| 83.29% Total IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | IopsStdDev | LatStdDev | file ------------------------------------------------------------------------------------------------------------------ 0 | 28693954560 | 7005360 | 30.41 | 7783.73 | 2.050 | 299.21 | 0.393 | D:\diskspd.dat (128GiB) 1 | 28699684864 | 7006759 | 30.41 | 7785.28 | 2.050 | 300.57 | 0.426 | D:\diskspd.dat (128GiB) 2 | 28695048192 | 7005627 | 30.41 | 7784.03 | 2.050 | 301.36 | 0.401 | D:\diskspd.dat (128GiB) 3 | 28713799680 | 7010205 | 30.43 | 7789.11 | 2.049 | 301.10 | 0.406 | D:\diskspd.dat (128GiB) 4 | 28725579776 | 7013081 | 30.44 | 7792.31 | 2.048 | 302.04 | 0.392 | D:\diskspd.dat (128GiB) 5 | 28730261504 | 7014224 | 30.44 | 7793.58 | 2.048 | 304.95 | 0.387 | D:\diskspd.dat (128GiB) 6 | 28736065536 | 7015641 | 30.45 | 7795.15 | 2.048 | 303.38 | 0.394 | D:\diskspd.dat (128GiB) 7 | 28739309568 | 7016433 | 30.45 | 7796.03 | 2.047 | 310.55 | 0.402 | D:\diskspd.dat (128GiB) ------------------------------------------------------------------------------------------------------------------ total: 229733703680 | 56087330 | 243.43 | 62319.22 | 2.049 | 2414.72 | 0.400 Read IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | IopsStdDev | LatStdDev | file ------------------------------------------------------------------------------------------------------------------ 0 | 17211277312 | 4201972 | 18.24 | 4668.86 | 1.957 | 186.67 | 0.369 | D:\diskspd.dat (128GiB) 1 | 17222062080 | 4204605 | 18.25 | 4671.78 | 1.956 | 185.60 | 0.414 | D:\diskspd.dat (128GiB) 2 | 17209384960 | 4201510 | 18.24 | 4668.34 | 1.956 | 186.60 | 0.376 | D:\diskspd.dat (128GiB) 3 | 17230209024 | 4206594 | 18.26 | 4673.99 | 1.955 | 186.64 | 0.384 | D:\diskspd.dat (128GiB) 4 | 17228369920 | 4206145 | 18.26 | 4673.49 | 1.955 | 187.50 | 0.377 | D:\diskspd.dat (128GiB) 5 | 17231269888 | 4206853 | 18.26 | 4674.28 | 1.954 | 189.29 | 0.352 | D:\diskspd.dat (128GiB) 6 | 17245437952 | 4210312 | 18.27 | 4678.12 | 1.954 | 186.25 | 0.375 | D:\diskspd.dat (128GiB) 7 | 17231990784 | 4207029 | 18.26 | 4674.47 | 1.954 | 191.87 | 0.375 | D:\diskspd.dat (128GiB) ------------------------------------------------------------------------------------------------------------------ total: 137810001920 | 33645020 | 146.03 | 37383.34 | 1.955 | 1455.45 | 0.378 Write IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | IopsStdDev | LatStdDev | file ------------------------------------------------------------------------------------------------------------------ 0 | 11482677248 | 2803388 | 12.17 | 3114.87 | 2.190 | 124.79 | 0.386 | D:\diskspd.dat (128GiB) 1 | 11477622784 | 2802154 | 12.16 | 3113.50 | 2.191 | 127.46 | 0.403 | D:\diskspd.dat (128GiB) 2 | 11485663232 | 2804117 | 12.17 | 3115.68 | 2.191 | 127.69 | 0.396 | D:\diskspd.dat (128GiB) 3 | 11483590656 | 2803611 | 12.17 | 3115.12 | 2.189 | 127.53 | 0.398 | D:\diskspd.dat (128GiB) 4 | 11497209856 | 2806936 | 12.18 | 3118.82 | 2.188 | 126.76 | 0.371 | D:\diskspd.dat (128GiB) 5 | 11498991616 | 2807371 | 12.18 | 3119.30 | 2.189 | 128.58 | 0.394 | D:\diskspd.dat (128GiB) 6 | 11490627584 | 2805329 | 12.18 | 3117.03 | 2.188 | 128.61 | 0.381 | D:\diskspd.dat (128GiB) 7 | 11507318784 | 2809404 | 12.19 | 3121.56 | 2.187 | 131.48 | 0.399 | D:\diskspd.dat (128GiB) ------------------------------------------------------------------------------------------------------------------ total: 91923701760 | 22442310 | 97.41 | 24935.89 | 2.189 | 971.73 | 0.391 Total latency distribution: %-ile | Read (ms) | Write (ms) | Total (ms) ---------------------------------------------- min | 0.112 | 0.094 | 0.094 25th | 1.875 | 2.066 | 1.919 50th | 1.951 | 2.178 | 2.019 75th | 2.027 | 2.299 | 2.152 90th | 2.098 | 2.410 | 2.302 95th | 2.142 | 2.477 | 2.388 99th | 2.240 | 2.607 | 2.540 3-nines | 2.489 | 2.794 | 2.735 4-nines | 3.596 | 3.820 | 3.688 5-nines | 68.307 | 68.310 | 68.309 6-nines | 74.177 | 71.692 | 73.914 7-nines | 92.777 | 92.031 | 92.767 8-nines | 92.924 | 92.767 | 92.924 9-nines | 92.924 | 92.767 | 92.924 max | 92.924 | 92.767 | 92.924 C:\Installs\DiskSpd\amd64>.\diskspd.exe -b4K -o1 -d900 -r -w40 -t8 -Sh -D -L -c128G D:\diskspd.dat Command Line: .\diskspd.exe -b4K -o1 -d900 -r -w40 -t8 -Sh -D -L -c128G D:\diskspd.dat Input parameters: timespan: 1 ------------- duration: 900s warm up time: 5s cool down time: 0s measuring latency gathering IOPS at intervals of 1000ms random seed: 0 path: 'D:\diskspd.dat' think time: 0ms burst size: 0 software cache disabled hardware write cache disabled, writethrough on performing mix test (read/write ratio: 60/40) block size: 4KiB using random I/O (alignment: 4KiB) number of outstanding I/O operations per thread: 1 threads per file: 8 IO priority: normal System information: computer name: winspd-proxmox start time: 2024/11/07 16:35:12 UTC cpu count: 8 core count: 8 group count: 1 node count: 1 socket count: 2 heterogeneous cores: n active power scheme: Balanced (381b4222-f694-41f0-9685-ff5bb260df2e) Results for timespan 1: ******************************************************************************* actual test time: 900.00s thread count: 8 Socket | CPU | Usage | User | Kernel | Idle ------------------------------------------------- 0| 0| 14.48%| 0.77%| 13.71%| 85.52% 0| 1| 13.22%| 0.94%| 12.28%| 86.78% 0| 2| 13.38%| 0.90%| 12.49%| 86.62% 0| 3| 13.03%| 0.78%| 12.25%| 86.97% 1| 4| 12.91%| 0.87%| 12.05%| 87.09% 1| 5| 13.04%| 1.03%| 12.01%| 86.96% 1| 6| 13.30%| 1.07%| 12.22%| 86.70% 1| 7| 13.18%| 1.02%| 12.16%| 86.82% ------------------------------------------------- avg.| 13.32%| 0.92%| 12.40%| 86.68% Total IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | IopsStdDev | LatStdDev | file ------------------------------------------------------------------------------------------------------------------ 0 | 24333692928 | 5940843 | 25.78 | 6600.94 | 0.151 | 324.01 | 0.039 | D:\diskspd.dat (128GiB) 1 | 24729149440 | 6037390 | 26.20 | 6708.21 | 0.149 | 341.35 | 0.042 | D:\diskspd.dat (128GiB) 2 | 24711872512 | 6033172 | 26.19 | 6703.52 | 0.149 | 351.74 | 0.066 | D:\diskspd.dat (128GiB) 3 | 24791965696 | 6052726 | 26.27 | 6725.25 | 0.148 | 350.80 | 0.042 | D:\diskspd.dat (128GiB) 4 | 24807047168 | 6056408 | 26.29 | 6729.34 | 0.148 | 347.71 | 0.037 | D:\diskspd.dat (128GiB) 5 | 24709312512 | 6032547 | 26.18 | 6702.83 | 0.149 | 361.66 | 0.065 | D:\diskspd.dat (128GiB) 6 | 24649318400 | 6017900 | 26.12 | 6686.56 | 0.149 | 350.93 | 0.042 | D:\diskspd.dat (128GiB) 7 | 24695091200 | 6029075 | 26.17 | 6698.97 | 0.149 | 357.78 | 0.039 | D:\diskspd.dat (128GiB) ------------------------------------------------------------------------------------------------------------------ total: 197427449856 | 48200061 | 209.20 | 53555.63 | 0.149 | 2712.09 | 0.048 Read IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | IopsStdDev | LatStdDev | file ------------------------------------------------------------------------------------------------------------------ 0 | 14594506752 | 3563112 | 15.46 | 3959.01 | 0.145 | 198.75 | 0.041 | D:\diskspd.dat (128GiB) 1 | 14842601472 | 3623682 | 15.73 | 4026.31 | 0.143 | 209.99 | 0.042 | D:\diskspd.dat (128GiB) 2 | 14820577280 | 3618305 | 15.70 | 4020.34 | 0.143 | 214.59 | 0.069 | D:\diskspd.dat (128GiB) 3 | 14875320320 | 3631670 | 15.76 | 4035.19 | 0.143 | 214.57 | 0.042 | D:\diskspd.dat (128GiB) 4 | 14879334400 | 3632650 | 15.77 | 4036.28 | 0.143 | 214.12 | 0.039 | D:\diskspd.dat (128GiB) 5 | 14820241408 | 3618223 | 15.70 | 4020.25 | 0.143 | 219.25 | 0.050 | D:\diskspd.dat (128GiB) 6 | 14793719808 | 3611748 | 15.68 | 4013.05 | 0.143 | 211.84 | 0.043 | D:\diskspd.dat (128GiB) 7 | 14805233664 | 3614559 | 15.69 | 4016.18 | 0.143 | 220.48 | 0.039 | D:\diskspd.dat (128GiB) ------------------------------------------------------------------------------------------------------------------ total: 118431535104 | 28913949 | 125.49 | 32126.61 | 0.143 | 1631.14 | 0.047 Write IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | IopsStdDev | LatStdDev | file ------------------------------------------------------------------------------------------------------------------ 0 | 9739186176 | 2377731 | 10.32 | 2641.92 | 0.160 | 134.50 | 0.035 | D:\diskspd.dat (128GiB) 1 | 9886547968 | 2413708 | 10.48 | 2681.90 | 0.157 | 140.83 | 0.041 | D:\diskspd.dat (128GiB) 2 | 9891295232 | 2414867 | 10.48 | 2683.19 | 0.157 | 146.35 | 0.061 | D:\diskspd.dat (128GiB) 3 | 9916645376 | 2421056 | 10.51 | 2690.06 | 0.156 | 145.17 | 0.039 | D:\diskspd.dat (128GiB) 4 | 9927712768 | 2423758 | 10.52 | 2693.06 | 0.156 | 142.78 | 0.034 | D:\diskspd.dat (128GiB) 5 | 9889071104 | 2414324 | 10.48 | 2682.58 | 0.157 | 151.80 | 0.082 | D:\diskspd.dat (128GiB) 6 | 9855598592 | 2406152 | 10.44 | 2673.50 | 0.157 | 148.29 | 0.039 | D:\diskspd.dat (128GiB) 7 | 9889857536 | 2414516 | 10.48 | 2682.80 | 0.157 | 146.63 | 0.036 | D:\diskspd.dat (128GiB) ------------------------------------------------------------------------------------------------------------------ total: 78995914752 | 19286112 | 83.71 | 21429.01 | 0.157 | 1090.26 | 0.049 Total latency distribution: %-ile | Read (ms) | Write (ms) | Total (ms) ---------------------------------------------- min | 0.040 | 0.052 | 0.040 25th | 0.123 | 0.134 | 0.126 50th | 0.138 | 0.156 | 0.144 75th | 0.154 | 0.178 | 0.164 90th | 0.173 | 0.199 | 0.188 95th | 0.189 | 0.213 | 0.204 99th | 0.278 | 0.239 | 0.249 3-nines | 0.563 | 0.282 | 0.506 4-nines | 0.936 | 0.791 | 0.893 5-nines | 1.963 | 1.914 | 1.943 6-nines | 4.303 | 8.080 | 5.435 7-nines | 39.696 | 74.936 | 73.027 8-nines | 74.620 | 87.096 | 87.096 9-nines | 74.620 | 87.096 | 87.096 max | 74.620 | 87.096 | 87.096