All Questions
Tagged with performance hard-drive
223
questions
3
votes
3
answers
9k
views
optimizing ext[234] for small file throughput
I have a system that has a high throughput of small files on disk, i.e. a huge number of small files are created, written and deleted within seconds.
Are there any reasonable ext2/ext3/ext4 mount ...
- 1
0
votes
1
answer
10k
views
Ceph hardware sizing calculator
I would like to calculate the Hardware sizing for a ceph cluster. There are so few references to the sizing, that I try to get these details here in the community.
E.g. what shall i have depending on
...
CommunityBot
- 1
0
votes
1
answer
26
views
SAS channel speed and multiple disk setup
I have the following setup and looking for recommendations on the 2 connection options:
1x SAS Controller in HBA mode with 2x SAS Ports
2 SAS cables with 4 SAS connectors each
4x HDs with 6GB/s SAS ...
- 10.4k
1
vote
2
answers
116
views
Prefetched Small File Cache
First, my use case: On my Linux-based server I am getting unsatisfactory disk IO performance for small files, and am limited to the approximately 100 IOPS that a 7200rpm HDD will support. This is of ...
- 4,812
1
vote
0
answers
382
views
Disk performance issues exclusively with RAID 10 (LVM RAID)
For some reason, I am suffering very poor disk performance on RAID 10, but normal performance on RAID 5.
For context, I have 4 x 1 TB hard drives in a server. They are the physical volumes within the ...
- 11
2
votes
2
answers
2k
views
Why would diskspd perform better without cache?
We are currently investigating high disk latency on a Windows server 2012 r2 that run as an SQL server. It is a virtual machine under VMware and the datastore of the faulty disk is linked with a very ...
CommunityBot
- 1
1
vote
1
answer
306
views
kafka cluster RAID vs JBOD with new hardware and kafka versions
we want to design production kafka cluster with 7 kafka machines , on RHEL OS
kafka version should be - 2.7
usually we are installing the kafka machine/s disks as RAID 10 ( as confluent recommended )
...
9
votes
2
answers
8k
views
Why do sequential writes have better performance than random writes on SSDs?
An LBA (logical block addresses) is a mapping table implemented in the FTL to match between logical and physical pages/blocks in SSDs, my guess is that most SSDs (at least when they are empty) keeps ...
- 78.1k
0
votes
0
answers
3k
views
sdb: Disk read/write request responses are too high (read > 20 ms for 15m or write > 20 ms for 15m)
I use Zabbix agent to monitor my Linux servers.
I start to receive this alarm:
sdb: Disk read/write request responses are too high (read > 20 ms for 15m or write > 20 ms for 15m)
incident ...
1
vote
0
answers
450
views
FIO test results wildly vary based on number of jobs
Take the following 3 commands:
fio --name=write_throughput --numjobs=8 \
--size=10G --time_based --runtime=60s --ramp_time=2s --ioengine=libaio \
--direct=1 --verify=0 --bs=1M --iodepth=64 --rw=write \...
- 273
6
votes
2
answers
2k
views
Why are concurrent downloads faster
Many download managers like this, this and this support downloading a file over multiple parallel connections, one per thread.
The concept is that each connection will download one part of the file ...
- 888
3
votes
1
answer
3k
views
Huge MFT and slow performance
I have a Windows Server 2012 R2 with huge MFT and slow performance when listing file in folder. Filesystem is about 350.000 files but in past many millions file was created and delete with crap Backup ...
0
votes
1
answer
1k
views
VMWare Disk Performance
I have an HP ProLiant DL380p Gen8 (VMWare 7u3 installed) with 2 pieces of 960GB SSD RAID1 arrays (total of ~1+1=2GB usage). The rest of the configuration is like
24 CPUs x Intel(R) Xeon(R) CPU E5-...
- 16.9k
0
votes
1
answer
87
views
Disk read metrics not showing for postgres activity
I've long noticed that ESXI wasn't showing disk READ activity for my Ubuntu Postgres database server. I figured maybe it was just a weird bug with ESXI, as it would show disk WRITE activity.
I decided ...
- 99
2
votes
10
answers
4k
views
For what sort of Linux desktop is LVM striping worthwhile?
I run several Linux machines at home and at work. Most of my computing is I/O-limited, e.g., large compiler regression suites and the like. At home I also have one machine that captures high-...
- 173
0
votes
1
answer
12k
views
What's the difference between 10k/15k SAS HDDs and SATA SSDs?
What is the rule of thumb in performance characteristics and differences between 10k / 15k revolutions per minute (RPM) Serial Attached Storage (SAS) hard disc drives (HDDs), versus Serial ATA (SATA) ...
CommunityBot
- 1
109
votes
8
answers
23k
views
How can a single disk in a hardware SATA RAID-10 array bring the entire array to a screeching halt?
Prelude:
I'm a code-monkey that's increasingly taken on SysAdmin duties for my small company. My code is our product, and increasingly we provide the same app as SaaS.
About 18 months ago I moved our ...
- 379
0
votes
0
answers
1k
views
Hard resetting link, limiting SATA link speed to 1.5 Gbps from non-existent disk
Good morning!
Can anyone help me with a strange problem that I have in my Debian 8.8 Jessie server? I'm having these messages in my syslog:
[lun may 24 10:23:09 2021] ata9: limiting SATA link speed to ...
-1
votes
1
answer
427
views
Simulate some process IO with fio or other tool
Is there any way to track a specific process and get stats for disk IO such as queue depth, total reading/writing threads, percent of reads/writes and so on?
The main goal is to use all that ...
- 525
1
vote
1
answer
3k
views
Adding disks to existing RAID array
We want to increase disk space of one of our server. Currently it has 8 physical disks(4 x 480 GB, 4 x 1.9 TB) and 3 virtual disks(RAID 1 (2 x 480GB), RAID 1 (2 x 480 GB), RAID 10(4 x 1.9TB)). We want ...
CommunityBot
- 1
2
votes
0
answers
912
views
Openstack: VM disk I/O Tunning
In OpenStack, I am facing I/O performance issues. I am using virtio-scsi driver support in the quest. Currently, I am getting below mentioned performance.
WRITE: bw=37.2MiB/s (39.1MB/s), 37.2MiB/s-37....
- 21
0
votes
0
answers
826
views
Poor proxmox pveperf performance on a mdadm raid 1
When running pveperf on a Debian + Proxmox PowerEdge R540 server that uses two hard drive in a raid 1 configuration (using mdadm), I get very low performances in the number of FSYNCS/SECOND:
$ sudo ...
CommunityBot
- 1
2
votes
1
answer
404
views
About IOPS of a RAID5 disk array without cache
we are using a 530-8i RAID adapter,which is none-cache supported, on a Lenovo ThinkSystem SR590 server.And we have 4 HDD(600GB/10K RPM/SAS) in the array.
I read an article about calculating the disk/...
- 48.5k
1
vote
1
answer
410
views
Raw LVM disk write is four times faster on host than inside KVM guest?
I've got a Debian 10.6 Host, with a Debian 10.6 guest. KVM/Qemu/libvirt. The host has a software RAID 10 array with 6 mechanical disks. LVM is on top of the RAID array. One LV is passed into the guest ...
- 1,628
2
votes
0
answers
612
views
Access disk io data in linux without tools like iotop/iostat to find processes or files with IO
We have regularly high load average. With the help of a zabbix agent, I could narrow it down to be mainly because of cpu iowait (and lastly disk io). I am not allowed to install any additional ...
- 121
0
votes
1
answer
1k
views
Sql Server 2012 Disk I/O Too high
I am running SQL Server 2012 on windows azure VM Windows server 2012.
This is a live Database, about 250GB, with high usage.
I applied some best practice articles for the temp-db long ago, and also ...
CommunityBot
- 1
-1
votes
1
answer
3k
views
The causes for frozen server
We built one windows 2012R2 server (it has enough free memory/disk space, high performance of CPU), but it would be frozen for around half hour every 12 hours.
The symptoms:
couldn't access the ...
- 51.7k
13
votes
3
answers
31k
views
Relation between disk IOPS and sar tps
I'm trying to estimate IOPS requirements of my application running on 32-bit CentOS 6.2. I started to take some measurement on a machine with SATA disks and I'm quite confused of difference between ...
1
vote
0
answers
140
views
disk I/O latency spikes (contains log files from amplify)
Ubuntu 18.04 LTS server, disk is ssd. Application stack is: mongodb, node, nignx and some python.
Server is up 1 month and already had 3 OS disk fails where Ubuntu would go in read only mode. After ...
0
votes
0
answers
43
views
Linux software raid slow until reboot
I am running an debian 10 machine with 3 4tb hdd drives.
Each drive has a 1GB partition for a raid1 for the boot and the rest of the disk is configured as a raid 5 for lvm.
After a while of running I ...
- 101
1
vote
2
answers
15k
views
Install Winsat on server 2012? Windows System Assesment Tool
I use winsat to see my disk read/write speed on Windows 8 and it works great:
winsat disk -drive c
Can this be used on Windows Server 2012?
- 535
1
vote
1
answer
285
views
Is my server drive on SATA2 or SATA3 based on this output?
smartctl output:
# smartctl -a /dev/sda | grep SATA
SATA Version is: SATA 3.1, 6.0 Gb/s (current: 3.0 Gb/s)
dmesg output (empty):
# dmesg | grep SATA
hdparm output:
# hdparm -I /dev/sda | grep ...
CommunityBot
- 1
6
votes
2
answers
7k
views
Why does storage's performance change at various queue depths?
I'm in the market for a storage upgrade for our servers.
I'm looking at benchmarks of various PCIe SSD devices and in comparisons I see that IOPS change at various queue depths.
How can that be and ...
- 21
1
vote
1
answer
468
views
Extremely Low Random Read/Write Performance on (4096 Aligned) Advanced Format Disks
On a SATA 3.0, 6.0 Gb/s
*-disk:0
description: ATA Disk
product: WDC WD20EFRX-68E
vendor: Western Digital
physical id: 0
bus info: scsi@1:0.0.0
hw_sector_size: 512
...
- 1,245
7
votes
3
answers
14k
views
SAS / SATA max number of connected disks vs performance
I would like to understand following things:
When I have a motherboard with SATA 6Gb/s and 8 ports, does it mean that every single port is able to provide 6Gb/s speed to disk that is connected over ...
- 324
3
votes
5
answers
6k
views
Bad disk performance on HP DL360 with Smart Array P400i RAID controller
I have a HP DL360 server with 4x 146GB SAS disks and a Smart Array P400i RAID controller with 256MB cache. The disks are in RAID 5 (3 disks + 1 hot spare).
The server is running VMware ESX 3i.
The ...
- 753
5
votes
2
answers
1k
views
Server Hot Swap Hard Drives
We have a HP Proliant DL380 G9 server. We have a separate data drive which consists of 4 x 1TB 7.2k 6Gb hot-swappable SAS drives RAID 5'd to provide a 3GB logical drive. We've noticed the performance ...
- 13.8k
3
votes
3
answers
23k
views
How to get more I/O performance from Citrix XenServer?
I have a Citrix XenServer 6.1 installed on a HP Server (1x Intel Xeon E5630 @ 2.53GHz (4 cores, 8 threads, RAM: 752MB for dom0 and 55286MB for the guests). The server has 2 scsi mirrored disks and is ...
- 2,529
14
votes
7
answers
16k
views
How do storage IOPS change in response to disk capacity?
All other things being equal, how would a storage array's IOPS performance change if one used larger disks.
For example, take an array with 10 X 100GB disks.
Measure IOPS for sequential 256kb block ...
CommunityBot
- 1
0
votes
0
answers
186
views
partition ssd + hdd disk on ubuntu server running plesk
i have a new server with 256 SSD and 4TB SATA HDD, with the following logical volumes mounted
# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 1 223.4G 0 disk
├─sda1 ...
- 101
7
votes
3
answers
9k
views
Find current IOPS usage of EBS volume from my application on AWS EC2
I am relatively new to AWS and disk performance. I am trying to figure out how much provisioned IOPS does my application need to perform well.
Currently My PHP and MySQL application is hosted on EC2 ...
- 123
4
votes
1
answer
824
views
If I connect a SATA3 6Gbps SSD to a SAS2 6Gbps port using a breakout cable, will I get SATA3 speeds?
I have 2 SATA3 SSDs in my server, which are currently connected to SATA2 ports. If I wanted to get SATA3 speeds out of them instead, could I buy a SAS2 HBA and use an SFF-8087 to SATA breakout cable ...
- 5,495
0
votes
1
answer
2k
views
Optimum size for ISA server disk cache
Our ISA server administrator is saying this:
How the ISA cache works is as follows:
when the ISA server receives a request
to access a website, the first step it
takes is check through the cache to
...
CommunityBot
- 1
0
votes
1
answer
274
views
Linux Ubuntu disk usage
Currently, I have a streaming dedicated server, below you will be able to see server details:
HDD: 12TB HDD
RAM: 64GB
Processor: Intel® Core™ i7-6700 Quad-Core Skylake Hyper-Threading
Network speed: ...
- 2,878
8
votes
1
answer
6k
views
iotop and iostat disagree
I'm trying to understand what's going on with my server's disks. It's running Ubuntu 12.04LTS and I'm used to using iostat to know when the disk is the bottleneck. But iostat -xd looks to me like ...
- 115
2
votes
2
answers
289
views
How to ask antivirus software to work slower and hence use less disk access?
It is our policy for our end-user's computers (usually laptops) to have high power CPUs, GPUs, RAMs (no less than 16GB) and HDD space (1TB), but we save money by choosing lower rotation speed of HDD. ...
- 117
31
votes
4
answers
34k
views
Limit Linux background flush (dirty pages)
Background flushing on Linux happens when either too much written data is pending (adjustable via /proc/sys/vm/dirty_background_ratio) or a timeout for pending writes is reached (/proc/sys/vm/...
- 1,110
12
votes
2
answers
7k
views
Why is ZFS so much slower than ext4 and btrfs?
Problem
I recently installed a new disk and created a zpool on it:
/# zpool create morez /dev/sdb
After using it for a while, I noticed it was quite slow:
/morez# fio --name rw --rw rw --size 10G
...
- 1,245
0
votes
0
answers
99
views
Using hdparam for more strenuous tests
So I am tasked with getting some strenuous raw hard drive performance tests. We started with FIO but this has proven to be ineffective as the results are poor in windows and linux.
I tried Bonnie++ ...
- 217
4
votes
5
answers
1k
views
Hard drive throttling?
You're copying a lot of stuff in same time and computer performance just dies. Try for example to copy 10+ ISO images same time.
There's QoS in networking, affinities and priorities in CPUs, but is ...
- 1