Por que minha unidade de fita está tão lenta?

Question

Comprei uma unidade de fita Quantum Ultrium LTO-4 usada e a conectei a uma controladora HP Smart Array P400 SAS em meu HP ProLiant N54l. Eu uso o FreeBSD 11 como meu sistema operacional.

Agora, inseri uma fita e executei o benchmark do comando btape do Bacula:

$ btape /dev/nsa0
Tape block granularity is 1024 bytes.
btape: butil.c:291-0 Using device: "/dev/nsa0" for writing.
btape: btape.c:471-0 open device "LTO-4" (/dev/nsa0): OK
*rewind
btape: btape.c:576-0 Rewound "LTO-4" (/dev/nsa0)
*speed
btape: btape.c:1055-0 Test with zero data, should give the maximum throughput.
btape: btape.c:904-0 Begin writing 3 files of 1.073 GB with raw blocks of 64512 bytes.
++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=1.073 GB. Write rate = 2.182 MB/s
+++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=1.073 GB. Write rate = 4.511 MB/s
+++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=1.073 GB. Write rate = 1.835 MB/s
btape: btape.c:379-0 Total Volume bytes=3.221 GB. Total Write rate = 2.449 MB/s

Este (e alguns outros testes) confirmam uma taxa de gravação de cerca de 2 MB / s, o que é excessivamente lento. Por que esse é o caso? O que posso fazer para elevar a taxa de gravação para a velocidade esperada (por exemplo, 100 MB / s)?

Editar

Parece que algo pode estar errado com o controlador. Depois de uma reinicialização, consegui transferir dados em alta velocidade por algum tempo até que vários erros de PCI ocorressem e a velocidade diminuísse para um rastreamento:

ciss0: *** PCI-E LL correctable errors, count=10546, LLErrStatus=0x80000004
ciss0: *** PCI-E LL correctable errors, count=20570, LLErrStatus=0x80000004
ciss0: *** PCI-E LL correctable errors, count=30995, LLErrStatus=0x80000004
ciss0: *** PCI-E LL correctable errors, count=41101, LLErrStatus=0x80000004
ciss0: *** PCI-E LL correctable errors, count=51400, LLErrStatus=0x80000004
ciss0: *** PCI-E LL correctable errors, count=61729, LLErrStatus=0x80000004

Talvez o cartão esteja encaixado incorretamente ou algo assim.

    

Answer 1

Troquei o controlador HP SmartArray P400 SAS por um controlador SAS 3041E LSI. Isso resolveu meus problemas de desempenho, agora posso fazer backup confortavelmente em alta velocidade (posso chegar a cerca de 70 MB / s na prática). Abaixo você encontra a saída do mesmo teste de desempenho usado anteriormente:

$ btape /dev/nsa0
Tape block granularity is 1024 bytes.
btape: butil.c:291-0 Using device: "/dev/nsa0" for writing.
btape: btape.c:471-0 open device "LTO-4" (/dev/nsa0): OK
*rewind
btape: btape.c:576-0 Rewound "LTO-4" (/dev/nsa0)
*speed
btape: btape.c:1055-0 Test with zero data, should give the maximum throughput.
btape: btape.c:904-0 Begin writing 3 files of 1.073 GB with raw blocks of 64512 bytes.
++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=1.073 GB. Write rate = 71.58 MB/s
+++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=1.073 GB. Write rate = 119.3 MB/s
+++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=1.073 GB. Write rate = 134.2 MB/s
btape: btape.c:379-0 Total Volume bytes=3.221 GB. Total Write rate = 100.6 MB/s

btape: btape.c:904-0 Begin writing 3 files of 2.147 GB with raw blocks of 64512 bytes.
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=2.147 GB. Write rate = 143.1 MB/s
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=2.147 GB. Write rate = 153.3 MB/s
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=2.147 GB. Write rate = 143.1 MB/s
btape: btape.c:379-0 Total Volume bytes=6.442 GB. Total Write rate = 146.4 MB/s

btape: btape.c:904-0 Begin writing 3 files of 4.294 GB with raw blocks of 64512 bytes.
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=4.295 GB. Write rate = 165.1 MB/s
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=4.295 GB. Write rate = 165.1 MB/s
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=4.295 GB. Write rate = 165.1 MB/s
btape: btape.c:379-0 Total Volume bytes=12.88 GB. Total Write rate = 165.1 MB/s

btape: btape.c:1067-0 Test with random data, should give the minimum throughput.
btape: btape.c:904-0 Begin writing 3 files of 1.073 GB with raw blocks of 64512 bytes.
++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=1.073 GB. Write rate = 53.69 MB/s
+++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=1.073 GB. Write rate = 51.13 MB/s
+++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=1.073 GB. Write rate = 53.69 MB/s
btape: btape.c:379-0 Total Volume bytes=3.221 GB. Total Write rate = 52.80 MB/s

btape: btape.c:904-0 Begin writing 3 files of 2.147 GB with raw blocks of 64512 bytes.
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=2.147 GB. Write rate = 59.65 MB/s
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=2.147 GB. Write rate = 58.04 MB/s
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=2.147 GB. Write rate = 58.04 MB/s
btape: btape.c:379-0 Total Volume bytes=6.442 GB. Total Write rate = 58.56 MB/s

btape: btape.c:904-0 Begin writing 3 files of 4.294 GB with raw blocks of 64512 bytes.
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=4.295 GB. Write rate = 60.49 MB/s
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=4.295 GB. Write rate = 70.41 MB/s
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=4.295 GB. Write rate = 69.27 MB/s
btape: btape.c:379-0 Total Volume bytes=12.88 GB. Total Write rate = 66.41 MB/s

btape: btape.c:1081-0 Test with zero data and bacula block structure.
btape: btape.c:959-0 Begin writing 3 files of 1.073 GB with blocks of 64512 bytes.
+++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=1.073 GB. Write rate = 71.58 MB/s
+++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=1.073 GB. Write rate = 76.70 MB/s
+++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=1.073 GB. Write rate = 71.58 MB/s
btape: btape.c:379-0 Total Volume bytes=3.221 GB. Total Write rate = 73.21 MB/s

btape: btape.c:959-0 Begin writing 3 files of 2.147 GB with blocks of 64512 bytes.
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=2.147 GB. Write rate = 93.37 MB/s
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=2.147 GB. Write rate = 85.90 MB/s
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=2.147 GB. Write rate = 89.48 MB/s
btape: btape.c:379-0 Total Volume bytes=6.442 GB. Total Write rate = 89.48 MB/s

btape: btape.c:959-0 Begin writing 3 files of 4.294 GB with blocks of 64512 bytes.
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=4.295 GB. Write rate = 97.61 MB/s
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=4.295 GB. Write rate = 99.88 MB/s
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=4.295 GB. Write rate = 97.61 MB/s
btape: btape.c:379-0 Total Volume bytes=12.88 GB. Total Write rate = 98.35 MB/s

btape: btape.c:1093-0 Test with random data, should give the minimum throughput.
btape: btape.c:959-0 Begin writing 3 files of 1.073 GB with blocks of 64512 bytes.
+++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=1.073 GB. Write rate = 41.30 MB/s
+++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=1.073 GB. Write rate = 39.77 MB/s
+++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=1.073 GB. Write rate = 41.30 MB/s
btape: btape.c:379-0 Total Volume bytes=3.221 GB. Total Write rate = 40.77 MB/s

btape: btape.c:959-0 Begin writing 3 files of 2.147 GB with blocks of 64512 bytes.
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=2.147 GB. Write rate = 45.69 MB/s
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=2.147 GB. Write rate = 44.74 MB/s
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=2.147 GB. Write rate = 44.74 MB/s
btape: btape.c:379-0 Total Volume bytes=6.442 GB. Total Write rate = 45.05 MB/s

btape: btape.c:959-0 Begin writing 3 files of 4.294 GB with blocks of 64512 bytes.
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=4.295 GB. Write rate = 45.69 MB/s
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=4.295 GB. Write rate = 49.94 MB/s
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
btape: btape.c:606-0 Wrote 1 EOF to "LTO-4" (/dev/nsa0)
btape: btape.c:405-0 Volume bytes=4.295 GB. Write rate = 51.13 MB/s
btape: btape.c:379-0 Total Volume bytes=12.88 GB. Total Write rate = 48.80 MB/s

*quit

Tenho certeza de que esta linha de controladora SAS não gosta de drives de fita em geral, como evidenciado pelos seguintes testes que realizei:

• Troquei o SmartArray P400 por outro controlador do mesmo tipo com resultados iguais sem o PCI-E LL correctable errors .
• Troquei o cabo por outro, mesmo resultado.
• Anexei uma unidade de disco rígido à placa SmartArray P400 e funcionou sem problemas.

Answer 2

Velocidades mínimas e máximas de leitura e gravação dependem do drive.
Velocidade máxima não compactada em 120 MBps para LTO-4.
As unidades de fita Quantum LTO-4 HH possuem taxas de transferência compactadas de até 576 GB / h. Assume a compactação de 2: 1. A velocidade máxima real desta unidade é: 576 GB / h / 2 = 288 * 1024 MB / 3600s = 81,92 MBps. Da especificação da unidade:

Data Rate Matching Range: 33 to 80MB/sec native

Então você nunca recebe 100 MB / s

Editar:
Leia sobre Testando sua unidade de fita com o Bacula .
Você deve definir o arquivo bacula-sd.conf e certificar-se de que o Bacula (o daemon de armazenamento) não está em execução ou que você desmontou a unidade que será usada para teste.