[SOLVED] Low NVME Speed?

business_kid · 01-23-2024, 12:21 PM

I have an Asrock B550M Pro4, replacing my previous MSI B550M Bazooka m/b. There is a problem

Code:

dec@Ebony:~$sudo hdparm -Tt /dev/sda

/dev/sda:
 Timing cached reads:   53828 MB in  1.99 seconds = 26983.04 MB/sec
 Timing buffered disk reads: 380 MB in  3.01 seconds = 126.08 MB/sec
dec@Ebony:~$sudo hdparm -Tt /dev/nvme0n1

/dev/nvme0n1:
 Timing cached reads:   56116 MB in  1.99 seconds = 28133.82 MB/sec
 Timing buffered disk reads: 2046 MB in  3.00 seconds = 681.45 MB/sec

That's the problem. I included sda just to show the box is no slouch, although it's not exotic either. But here's the rub: I had this NVME in a different motherboard (MSI B550M Bazooka) and hdparm reported 2.0 GB/S. The m/b was swapped out by a friend. I didn't have hands on the job, because I can only use 1 of them. I already fixed an issue with the ram. Am I missing pcie lanes? Could this be on pcie-3.x instead of pcie-4.x? There's 2 nvme sockets, and I passed a warning not to use the slower one. Any other possible causes?

mrmazda · 01-23-2024, 12:32 PM

Has it been subjected to appropriate trimming?

More tests might be appropriate:

Code:

# hdparm -t /dev/nvme0n1
/dev/nvme0n1:
 Timing buffered disk reads: 2870 MB in  3.00 seconds = 956.41 MB/sec

# hdparm -t /dev/nvme0n1p5
/dev/nvme0n1p5:
 Timing buffered disk reads: 2852 MB in  3.00 seconds = 950.66 MB/sec

# hdparm -t /dev/nvme0n1p6
/dev/nvme0n1p6:
 Timing buffered disk reads: 2852 MB in  3.00 seconds = 950.55 MB/sec

# hdparm -t /dev/nvme0n1p7
/dev/nvme0n1p7:
 Timing buffered disk reads: 3088 MB in  3.00 seconds = 1028.65 MB/sec

# hdparm -t /dev/nvme0n1p10
/dev/nvme0n1p10:
 Timing buffered disk reads: 5346 MB in  3.00 seconds = 1781.38 MB/sec
#

business_kid · 01-24-2024, 04:40 AM

Quote:

Originally Posted by mrmazda

Has it been subjected to appropriate trimming?

No, no trimming that I know of. How do you do that?

I went through the partitions, I got speeds of 737MB/S to 1999MB/S. /dev/nvme0n1 read as 2.0G in the old m/b, and 683MB/S in this one, which is when I posted. It's the same nvme. The main use disks (p6 & p7) are 737 & 913 MB/S resp.

EDIT: fstrim gave me about an extra 10% on these, but no more (801MB/S & 1118MB/S)

Arnulf · 01-24-2024, 02:16 PM

Quote:

Originally Posted by business_kid

Could this be on pcie-3.x instead of pcie-4.x? There's 2 nvme sockets, and I passed a warning not to use the slower one.

Use M2_1 on the "Asrock B550M Pro4" for first NVMe SDD. M2_1 provides PCIe 4.0 x4 or PCIe 3.0 x4 depending on CPU. M2_2 only provides PCIe 3.0 x2. This is faster than SATA 6.0 GB/s but it is very slow for NVMe.

Which NVMe SSD model is in use?
Which Linux kernel is in use?

business_kid · 01-25-2024, 07:21 AM

Quote:

Originally Posted by Arnulf

Which NVMe SSD model is in use?
Which Linux kernel is in use?

Don't know for sure about the NVME. It was supplied. Is this it? (from lspci)

Code:

01:00.0 Non-Volatile memory controller: Intel Corporation SSD 660P Series (rev 03)

It's basically an (Asrock) AMD m/b from a build-to-order supplier. I can't imagine an Intel part on an AMD m/b.

Kernel is 5.15.63 from Slackware-15.0 updates.

Arnulf · 01-25-2024, 02:42 PM

"Intel Corporation SSD 660P Series" is your NVMe SSD and this model is well-known for very poor performance. It comes with a PCIe 3.0 x4 interface. Therefore you haven't any benefit from a CPU that provides PCIe 4.0. Main reason for its poor performance is use of QLC NAND instead of TLC NAND. Currently "QLC NAND" is a synonym for "sleeping pill".

Kernel is 5.15.63 is quite old for AMD Ryzen & B550 chipset. Switch to Kernel 6, e.g. 6.1 LTS or 6.6.13 from slackware64-current.

business_kid · 01-26-2024, 04:20 AM

Thanks for that. So intel's graphics aren't the only thing that sucks. I did get up to 2GB/S from it. So it's fast enough for me, but I know why it's slow.

Arnulf · 01-26-2024, 05:34 AM

Update to latest UEFI version may help a little, but don't expect too much. Early UEFI versions of Asrock B550M Pro4 have some issues.

business_kid · 01-26-2024, 07:36 AM

This is a new board, and I'm fine with UEFI. And this board is over specified for the current applications it runs. I just felt it might be in an electrically dangerous situation. The guy who put this together was experienced, but left half the ram hanging out of it's slot.

////// · 01-27-2024, 12:50 PM

Code:

# hdparm -t /dev/nvme0n1

is that command safe?
ive got 2tb samsung 990 nvme0n m.2 ssd, i would like to test its speeds.

business_kid · 01-28-2024, 04:29 AM

Many such invocations are below, even post #1. today, it's saying

Code:

dec@Ebony:~$sudo hdparm -t /dev/nvme0n1

/dev/nvme0n1:
 Timing buffered disk reads: 2044 MB in  3.00 seconds = 681.11 MB/sec

Arnulf's comments seem on the money. It's a pcie-3 part with a poor reputation in a pcie-4 socket. Hence the [Solved] nature of this thread. See posts #6-7.

Timothy Miller · 01-28-2024, 12:07 PM

AS a somewhat humorous anecdote, i had the Crucial P1 in one of my machines (literally identical to the 660p other than the sticker and the name/model in the firmware). Only SSD that after seeing the performance of I removed from a machine, threw straight in the garbage, and went back to the prior SSD.