Disk Performance: Difference between revisions

From Chorke Wiki
Jump to navigation Jump to search
 
(18 intermediate revisions by the same user not shown)
Line 35: Line 35:
   
   
  '''-i  :''' Test to run
  '''-i  :''' Test to run
       0=write/rewrite,   1=read/re-read,     2=random-read/write, 3=Read-backwards,
       0=write/rewrite    1=read/re-read      2=random-read/write 3=Read-backwards
       4=Re-write-record, 5=stride-read,       6=fwrite/re-fwrite7=fread/Re-fread,
       4=Re-write-record  5=stride-read      6=fwrite/re-fwrite   7=fread/Re-fread
       8=random_mix,       9=pwrite/Re-pwrite, 10=pread/Re-pread11=pwritev/Re-pwritev, 12=preadv/Re-preadv
       8=random_mix      9=pwrite/Re-pwrite 10=pread/Re-pread   11=pwritev/Re-pwritev 12=preadv/Re-preadv
   
   
  '''-r  :''' record size in Kb
  '''-r  :''' record size in Kb
Line 98: Line 98:
|-
|-
| valign="top" |
| valign="top" |
<syntaxhighlight lang="bash">
cat <<'EXE' | sudo bash
apt-get update;echo
apt-get install -y iozone3
echo;iozone -v
EXE
</syntaxhighlight>


| valign="top" |
| valign="top" colspan="2" |
 
'''lsblk'''
| valign="top" |
nvme0n1        259:0    0 953.9G  0 disk 
├─nvme0n1p1    259:1    0    1G  0 part  /boot/efi
├─nvme0n1p2    259:2    0    2G  0 part  /boot
└─nvme0n1p3    259:3    0 950.8G  0 part  /


|}
|}
Line 109: Line 119:
| valign="top" |
| valign="top" |
* [https://www.hostbillo.com/blog/clear-ram-memory-cache-buffer-and-swap-space-on-linux-hostbillo/ Linux » Free up RAM, Cache, Buffer & Swap]
* [https://www.hostbillo.com/blog/clear-ram-memory-cache-buffer-and-swap-space-on-linux-hostbillo/ Linux » Free up RAM, Cache, Buffer & Swap]
* [https://superuser.com/questions/204635/ Linux » Disk Encryption Slow Down]
* [https://www.baeldung.com/linux/disk-performance-test Linux » Disk Performance]
* [https://www.baeldung.com/linux/disk-performance-test Linux » Disk Performance]
* [https://www.redhat.com/sysadmin/lvm-vs-partitioning Linux » LVM vs Partition]
* [[Convention for HDD Label|Linux » Partition Label]]


| valign="top" |
| valign="top" |
Line 121: Line 134:
| valign="top" |
| valign="top" |
* [https://serverfault.com/questions/283129/ SSH » Connection Hang Forever]
* [https://serverfault.com/questions/283129/ SSH » Connection Hang Forever]
* [[Ruby on Rails]]
* [[Free Up RAM]]
* [[Free Up RAM]]
* [[Ruby on Rails]]
* [[TensorFlow]]
* [[TensorFlow]]
* [[Homebrew]]
* [[Homebrew]]
Line 129: Line 142:
* [[TMux]]
* [[TMux]]
* [[CURL]]
* [[CURL]]
* [[Tar]]


| valign="top" |
| valign="top" |
* [[Macrium Reflect Alternatives]]
* [[Linux Mount Drive]]
* [[Fedora/Morefine]]
* [[Alpine/Morefine]]
* [[Linux Kernel]]
* [[Swap Space]]
* [[BIOS Menu]]
* [https://rescuezilla.com/ Rescuezilla]
* [[Fedora]]
* [[7Zip]]


| valign="top" |
| valign="top" |
* [https://docs.rackspace.com/docs/copy-files-with-scp-and-rsync Linux » Copy files with SCP & Rsync]
* [https://creodias.docs.cloudferro.com/en/latest/networking/How-To-Upload-And-Synchronise-Files-With-SCP-RSYNC-Creodias.html Linux » Upload & Synchronize Files]
* [[Fedora/Raspberry Pi]]


|}
|}

Latest revision as of 10:50, 12 July 2024

Sequential Write

dd if=/dev/zero of=/tmp/tempfile bs=1M count=1024 conv=fdatasync
:'
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.521978 s, 2.1 GB/s
'

Sequential Read » Clean Buffer

echo 'sync;echo 3 >/proc/sys/vm/drop_caches'|sudo bash
dd if=/tmp/tempfile of=/dev/null bs=1M count=1024
:'
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.978744 s, 1.1 GB/s
'

Sequential Read » Using Buffer

dd if=/tmp/tempfile of=/dev/null bs=1M count=1024
:'
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.151489 s, 7.1 GB/s
'

Benchmark Random Read & Write

iozone -t1 -i0 -i2 -r1k -s1g /tmp
-t  : Number of threads or processes to use in throughput test

-i  : Test to run
      0=write/rewrite    1=read/re-read      2=random-read/write  3=Read-backwards
      4=Re-write-record  5=stride-read       6=fwrite/re-fwrite   7=fread/Re-fread
      8=random_mix       9=pwrite/Re-pwrite 10=pread/Re-pread    11=pwritev/Re-pwritev  12=preadv/Re-preadv

-r  : record size in Kb
      k .. size in kB
      m .. size in MB
      g .. size in GB

-s  : file size in Kb
      k .. size in kB
      m .. size in MB
      g .. size in GB

/tmp: test path

Playground

echo 'sync;echo 3 >/proc/sys/vm/drop_caches && swapoff -a && swapon -a'|sudo bash
free -th
echo 'apt update;apt list --upgradable;apt upgrade'|sudo bash
bottom

docker network prune -f
docker volume  prune -f
docker system  prune -f
docker image ls
cat <<'EXE' | bash
for d in system network volume
do docker ${d} prune -f;done
EXE
cat <<'EXE' | ssh [email protected]
for d in system network volume
do docker ${d} prune -f;done
EXE

cat <<'EXE' | sudo bash
apt-get update;echo
apt-get install -y iozone3
echo;iozone -v
EXE
lsblk
nvme0n1        259:0    0 953.9G  0 disk  
├─nvme0n1p1    259:1    0     1G  0 part  /boot/efi
├─nvme0n1p2    259:2    0     2G  0 part  /boot
└─nvme0n1p3    259:3    0 950.8G  0 part  /

References