Disk Performance: Difference between revisions
Jump to navigation
Jump to search
(Created page with "==Sequential Write== <syntaxhighlight lang="bash"> dd if=/dev/zero of=/tmp/tempfile bs=1M count=1024 conv=fdatasync :' 1024+0 records in 1024+0 records out 1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.521978 s, 2.1 GB/s ' </syntaxhighlight> ==Sequential Read » Clean Buffer== <syntaxhighlight lang="bash"> echo 'sync;echo 3 >/proc/sys/vm/drop_caches'|sudo bash dd if=/tmp/tempfile of=/dev/null bs=1M count=1024 :' 1024+0 records in 1024+0 records out 1073741824 bytes (1.1...") |
|||
(19 intermediate revisions by the same user not shown) | |||
Line 29: | Line 29: | ||
' | ' | ||
</syntaxhighlight> | </syntaxhighlight> | ||
==Benchmark Random Read & Write== | |||
'''iozone -t1 -i0 -i2 -r1k -s1g /tmp''' | |||
'''-t :''' Number of threads or processes to use in throughput test | |||
'''-i :''' Test to run | |||
0=write/rewrite 1=read/re-read 2=random-read/write 3=Read-backwards | |||
4=Re-write-record 5=stride-read 6=fwrite/re-fwrite 7=fread/Re-fread | |||
8=random_mix 9=pwrite/Re-pwrite 10=pread/Re-pread 11=pwritev/Re-pwritev 12=preadv/Re-preadv | |||
'''-r :''' record size in Kb | |||
k .. size in kB | |||
m .. size in MB | |||
g .. size in GB | |||
'''-s :''' file size in Kb | |||
k .. size in kB | |||
m .. size in MB | |||
g .. size in GB | |||
/'''tmp:''' test path | |||
==Playground== | ==Playground== | ||
Line 77: | Line 98: | ||
|- | |- | ||
| valign="top" | | | valign="top" | | ||
<syntaxhighlight lang="bash"> | |||
cat <<'EXE' | sudo bash | |||
apt-get update;echo | |||
apt-get install -y iozone3 | |||
echo;iozone -v | |||
EXE | |||
</syntaxhighlight> | |||
| valign="top" | | valign="top" colspan="2" | | ||
'''lsblk''' | |||
nvme0n1 259:0 0 953.9G 0 disk | |||
├─nvme0n1p1 259:1 0 1G 0 part /boot/efi | |||
├─nvme0n1p2 259:2 0 2G 0 part /boot | |||
└─nvme0n1p3 259:3 0 950.8G 0 part / | |||
|} | |} | ||
Line 88: | Line 119: | ||
| valign="top" | | | valign="top" | | ||
* [https://www.hostbillo.com/blog/clear-ram-memory-cache-buffer-and-swap-space-on-linux-hostbillo/ Linux » Free up RAM, Cache, Buffer & Swap] | * [https://www.hostbillo.com/blog/clear-ram-memory-cache-buffer-and-swap-space-on-linux-hostbillo/ Linux » Free up RAM, Cache, Buffer & Swap] | ||
* [https://superuser.com/questions/204635/ Linux » Disk Encryption Slow Down] | |||
* [https://www.baeldung.com/linux/disk-performance-test Linux » Disk Performance] | * [https://www.baeldung.com/linux/disk-performance-test Linux » Disk Performance] | ||
* [https://www.redhat.com/sysadmin/lvm-vs-partitioning Linux » LVM vs Partition] | |||
* [[Convention for HDD Label|Linux » Partition Label]] | |||
| valign="top" | | | valign="top" | | ||
Line 100: | Line 134: | ||
| valign="top" | | | valign="top" | | ||
* [https://serverfault.com/questions/283129/ SSH » Connection Hang Forever] | * [https://serverfault.com/questions/283129/ SSH » Connection Hang Forever] | ||
* [[Ruby on Rails]] | |||
* [[Free Up RAM]] | * [[Free Up RAM]] | ||
* [[TensorFlow]] | * [[TensorFlow]] | ||
* [[Homebrew]] | * [[Homebrew]] | ||
Line 108: | Line 142: | ||
* [[TMux]] | * [[TMux]] | ||
* [[CURL]] | * [[CURL]] | ||
* [[Tar]] | |||
| valign="top" | | | valign="top" | | ||
* [[Macrium Reflect Alternatives]] | |||
* [[Linux Mount Drive]] | |||
* [[Fedora/Morefine]] | |||
* [[Alpine/Morefine]] | |||
* [[Linux Kernel]] | |||
* [[Swap Space]] | |||
* [[BIOS Menu]] | |||
* [https://rescuezilla.com/ Rescuezilla] | |||
* [[Fedora]] | |||
* [[7Zip]] | |||
| valign="top" | | | valign="top" | | ||
* [https://docs.rackspace.com/docs/copy-files-with-scp-and-rsync Linux » Copy files with SCP & Rsync] | |||
* [https://creodias.docs.cloudferro.com/en/latest/networking/How-To-Upload-And-Synchronise-Files-With-SCP-RSYNC-Creodias.html Linux » Upload & Synchronize Files] | |||
* [[Fedora/Raspberry Pi]] | |||
|} | |} |
Latest revision as of 10:50, 12 July 2024
Sequential Write
dd if=/dev/zero of=/tmp/tempfile bs=1M count=1024 conv=fdatasync
:'
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.521978 s, 2.1 GB/s
'
Sequential Read » Clean Buffer
echo 'sync;echo 3 >/proc/sys/vm/drop_caches'|sudo bash
dd if=/tmp/tempfile of=/dev/null bs=1M count=1024
:'
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.978744 s, 1.1 GB/s
'
Sequential Read » Using Buffer
dd if=/tmp/tempfile of=/dev/null bs=1M count=1024
:'
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.151489 s, 7.1 GB/s
'
Benchmark Random Read & Write
iozone -t1 -i0 -i2 -r1k -s1g /tmp -t : Number of threads or processes to use in throughput test -i : Test to run 0=write/rewrite 1=read/re-read 2=random-read/write 3=Read-backwards 4=Re-write-record 5=stride-read 6=fwrite/re-fwrite 7=fread/Re-fread 8=random_mix 9=pwrite/Re-pwrite 10=pread/Re-pread 11=pwritev/Re-pwritev 12=preadv/Re-preadv -r : record size in Kb k .. size in kB m .. size in MB g .. size in GB -s : file size in Kb k .. size in kB m .. size in MB g .. size in GB /tmp: test path
Playground
echo 'sync;echo 3 >/proc/sys/vm/drop_caches && swapoff -a && swapon -a'|sudo bash
free -th
|
echo 'apt update;apt list --upgradable;apt upgrade'|sudo bash
bottom
| |
| ||
docker network prune -f
docker volume prune -f
docker system prune -f
docker image ls
|
cat <<'EXE' | bash
for d in system network volume
do docker ${d} prune -f;done
EXE
|
cat <<'EXE' | ssh [email protected]
for d in system network volume
do docker ${d} prune -f;done
EXE
|
| ||
cat <<'EXE' | sudo bash
apt-get update;echo
apt-get install -y iozone3
echo;iozone -v
EXE
|
lsblk nvme0n1 259:0 0 953.9G 0 disk ├─nvme0n1p1 259:1 0 1G 0 part /boot/efi ├─nvme0n1p2 259:2 0 2G 0 part /boot └─nvme0n1p3 259:3 0 950.8G 0 part / |
References
| ||