Skip to Main Content

Infrastructure Software

Announcement

For appeals, questions and feedback about Oracle Forums, please email oracle-forums-moderators_us@oracle.com. Technical questions should be asked in the appropriate category. Thank you!

All ssd zfs pool, slow write

drolfeNov 30 2015 — edited Dec 10 2015

Hi,

I'm testing Solaris 11.3 ZFS with a single intel SSD 3500 600GB drive, it's being served to the client via SRP with infiniband 20G.

I"m getting around 1600MB/s read but only 300MB write, I've tried with cache, and or zil on other ssd's but never goes over 300GB write,

I installed ubuntu 15 desktop just to test the ssd drive speed, on the intel 3500 600GB I was getting 450MB read and write so it looks like ZFS is much slower on write ?

Hardware details below:

Supermicro SuperStorage Server 2027R-AR24NV , 64GB ram, 40g connectx2 infiniband car, dual E5 CPU's and 3x LSI 3008 SAS3 controller in IT mode

intel 3500 600GB drive,

OS installed on 120GB intel 3500 drive

root@ssd-san:~# zpool status ssdsix

  pool: ssdsix

state: ONLINE

  scan: none requested

config:

        NAME                     STATE     READ WRITE CKSUM

        ssdsix                   ONLINE       0     0     0

          c0t55CD2E404BA23027d0  ONLINE       0     0     0

errors: No known data errors

root@ssd-san:~# stmfadm list-lu

LU Name: 600144F04DCD4B000000565B73CE0001

root@ssd-san:~#

root@ssd-san:~# stmfadm list-target -v

Target: eui.0002C9030007733E

    Operational Status     : Online

    Provider Name          : srpt

    Alias                  : -

    Protocol               : SRP

    Sessions               : 1

        Initiator: eui.001E0BFFFF4D606D

            Alias: 0000000000000000:001e0bffff4d606d

            Logged in since: Mon Nov 30 09:05:58 2015

root@ssd-san:~# ibstat

CA 'mlx4_0'

        CA type: MT26428

        Number of ports: 2

        Firmware version: 2.9.1000

        Hardware version: 160

        Node GUID: 0x0002c9030007733e

        System image GUID: 0x0002c90300077341

        Port 1:

                State: Down

                Physical state: Polling

                Rate: 0

                Base lid: 0

                LMC: 0

                SM lid: 0

                Capability mask: 0x02180000

                Port GUID: 0x0002c9030007733f

                Link layer: IB

        Port 2:

                State: Active

                Physical state: LinkUp

                Rate: 20

                Base lid: 2

                LMC: 0

                SM lid: 3

                Capability mask: 0x02180000

                Port GUID: 0x0002c90300077340

                Link layer: IB

root@ssd-san:~#

Comments
Locked Post
New comments cannot be posted to this locked post.
Post Details
Locked on Jan 7 2016
Added on Nov 30 2015
16 comments
5,253 views