mdadm RAID6, recupera 2 falhas no disco durante a reformulação

2

Eu estava remodelando minha matriz de 10 discos para 11 para um estado degradado (a unidade que eu quero adicionar já tem dados, mas não tenho onde colocá-los). 2 drives desconectados enquanto estava em execução (problema de energia).

Ainda é possível recuperar essa matriz?

Depois de ligar e desligar a energia, não consegui adicioná-los à matriz novamente:

mdadm: /dev/md0 has failed so using --add cannot work and might destroy
mdadm: data on /dev/sdX1.  You should stop the array and re-assemble it.

Desde a reinicialização, eu tentei:

- montar, falha devido a discos "defeituosos"

- montar --force, falha:

md: sdl1 does not have a valid v1.2 superblock, not importing!
md: sdk1 does not have a valid v1.2 superblock, not importing!
md/raid:md0: not enough operational devices (3/11 failed)
md/raid:md0: failed to run raid set.'

Eu tenho lido o artigo Recuperação de RAID , mas até agora não obtive sucesso.

mdadm --create --chunk=64 --size=1953512448 --assume-clean --level=6 --raid-devices=11 /dev/md0 /dev/sd{f,h,e,g,m,i,k,l,n,d}1 missing , falha:

mdadm: /dev/sdf1 is smaller than given size. 1953512256K < 1953512448K + metadata

para todas as unidades. Meu argumento para --size é "Used Dev Size / 2" do mdadm --examine / dev / sdf1. Eu fiz o downgrade do mdadm para cada versão até a v3.1.2 (quando os metadados padrão foram alterados para 1.2, eu sei que nunca os especifiquei manualmente).

Removendo --size, eu posso criar o array, mas não montar:

XFS (md0): Mounting V4 Filesystem
XFS (md0): Log inconsistent (didn't find previous header)
XFS (md0): failed to find log head
XFS (md0): log mount/recovery failed: error -5
XFS (md0): log mount failed

Info

Meu mdadm --detail antes de reformular:

/dev/md0:
        Version : 1.2
  Creation Time : Fri Jan 27 19:20:36 2012
     Raid Level : raid6
     Array Size : 15628099584 (14904.12 GiB 16003.17 GB)
  Used Dev Size : 1953512448 (1863.01 GiB 2000.40 GB)
   Raid Devices : 10
  Total Devices : 10
    Persistence : Superblock is persistent

  Intent Bitmap : Internal

    Update Time : Wed Jun 17 14:16:09 2015
          State : clean
 Active Devices : 10
Working Devices : 10
 Failed Devices : 0
  Spare Devices : 0

         Layout : left-symmetric
     Chunk Size : 64K

           Name : ubuntu:0
           UUID : 70485ad1:0f5f2362:e8f5489a:577ac908
         Events : 6037532

    Number   Major   Minor   RaidDevice State
       0       8       81        0      active sync   /dev/sdf1
       9       8      177        1      active sync   /dev/sdl1
      12       8       65        2      active sync   /dev/sde1
       3       8       97        3      active sync   /dev/sdg1
       4       8      145        4      active sync   /dev/sdj1
       6       8      193        5      active sync   /dev/sdm1
       7       8      113        6      active sync   /dev/sdh1
       8       8      129        7      active sync   /dev/sdi1
      10       8      161        8      active sync   /dev/sdk1
      11       8       49        9      active sync   /dev/sdd1

E mdadm --examine após falha e reinicialize com todos os discos visíveis novamente:

Os caminhos dos dispositivos foram alterados, pois havia um disco hotswap adicionado antes de a redefinição ser iniciada

/dev/sdd1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x5
     Array UUID : 70485ad1:0f5f2362:e8f5489a:577ac908
           Name : ubuntu:0
  Creation Time : Fri Jan 27 19:20:36 2012
     Raid Level : raid6
   Raid Devices : 11

 Avail Dev Size : 3907024896 (1863.01 GiB 2000.40 GB)
     Array Size : 17581612032 (16767.13 GiB 18003.57 GB)
    Data Offset : 2048 sectors
   Super Offset : 8 sectors
          State : clean
    Device UUID : 329fc32d:e9cf2ff4:3aa6c9a0:500aa445

Internal Bitmap : 2 sectors from superblock
  Reshape pos'n : 3196923264 (3048.82 GiB 3273.65 GB)
  Delta Devices : 1 (10->11)

    Update Time : Wed Jun 17 19:46:34 2015
       Checksum : 904d0c9c - correct
         Events : 6039833

         Layout : left-symmetric
     Chunk Size : 64K

   Device Role : Active device 9
   Array State : A.AAA...AA. ('A' == active, '.' == missing)


/dev/sde1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x5
     Array UUID : 70485ad1:0f5f2362:e8f5489a:577ac908
           Name : ubuntu:0
  Creation Time : Fri Jan 27 19:20:36 2012
     Raid Level : raid6
   Raid Devices : 11

 Avail Dev Size : 3907024896 (1863.01 GiB 2000.40 GB)
     Array Size : 17581612032 (16767.13 GiB 18003.57 GB)
    Data Offset : 2048 sectors
   Super Offset : 8 sectors
          State : clean
    Device UUID : e59303ea:e613013e:ef8af657:1fc6ccab

Internal Bitmap : 2 sectors from superblock
  Reshape pos'n : 3196923264 (3048.82 GiB 3273.65 GB)
  Delta Devices : 1 (10->11)

    Update Time : Wed Jun 17 19:46:34 2015
       Checksum : b3b3f659 - correct
         Events : 6039833

         Layout : left-symmetric
     Chunk Size : 64K

   Device Role : Active device 2
   Array State : A.AAA...AA. ('A' == active, '.' == missing)


/dev/sdf1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x5
     Array UUID : 70485ad1:0f5f2362:e8f5489a:577ac908
           Name : ubuntu:0
  Creation Time : Fri Jan 27 19:20:36 2012
     Raid Level : raid6
   Raid Devices : 11

 Avail Dev Size : 3907024896 (1863.01 GiB 2000.40 GB)
     Array Size : 17581612032 (16767.13 GiB 18003.57 GB)
    Data Offset : 2048 sectors
   Super Offset : 8 sectors
          State : clean
    Device UUID : 6aa0f9d8:e7b0cc66:d2f2a600:ef305279

Internal Bitmap : 2 sectors from superblock
  Reshape pos'n : 3148373376 (3002.52 GiB 3223.93 GB)
  Delta Devices : 1 (10->11)

    Update Time : Wed Jun 17 19:46:34 2015
       Checksum : 3beac20c - correct
         Events : 6039833

         Layout : left-symmetric
     Chunk Size : 64K

   Device Role : Active device 0
   Array State : AAAAAAAAAA. ('A' == active, '.' == missing)


/dev/sdg1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x5
     Array UUID : 70485ad1:0f5f2362:e8f5489a:577ac908
           Name : ubuntu:0
  Creation Time : Fri Jan 27 19:20:36 2012
     Raid Level : raid6
   Raid Devices : 11

 Avail Dev Size : 3907024896 (1863.01 GiB 2000.40 GB)
     Array Size : 17581612032 (16767.13 GiB 18003.57 GB)
    Data Offset : 2048 sectors
   Super Offset : 8 sectors
          State : clean
    Device UUID : 4b1d87a9:16027400:df71810f:3ce53c50

Internal Bitmap : 2 sectors from superblock
  Reshape pos'n : 3196923264 (3048.82 GiB 3273.65 GB)
  Delta Devices : 1 (10->11)

    Update Time : Wed Jun 17 19:46:34 2015
       Checksum : 91a563ea - correct
         Events : 6039833

         Layout : left-symmetric
     Chunk Size : 64K

   Device Role : Active device 3
   Array State : A.AAA...AA. ('A' == active, '.' == missing)


/dev/sdh1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x5
     Array UUID : 70485ad1:0f5f2362:e8f5489a:577ac908
           Name : ubuntu:0
  Creation Time : Fri Jan 27 19:20:36 2012
     Raid Level : raid6
   Raid Devices : 11

 Avail Dev Size : 5860268032 (2794.39 GiB 3000.46 GB)
     Array Size : 17581612032 (16767.13 GiB 18003.57 GB)
  Used Dev Size : 3907024896 (1863.01 GiB 2000.40 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
          State : clean
    Device UUID : 27c8fefa:8b2b74a2:9a456d34:d1a60c20

Internal Bitmap : 2 sectors from superblock
  Reshape pos'n : 3196923264 (3048.82 GiB 3273.65 GB)
  Delta Devices : 1 (10->11)

    Update Time : Wed Jun 17 19:29:09 2015
       Checksum : ee4ae103 - correct
         Events : 6039833

         Layout : left-symmetric
     Chunk Size : 64K

   Device Role : Active device 1
   Array State : AAAAAA..AA. ('A' == active, '.' == missing)


/dev/sdi1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x5
     Array UUID : 70485ad1:0f5f2362:e8f5489a:577ac908
           Name : ubuntu:0
  Creation Time : Fri Jan 27 19:20:36 2012
     Raid Level : raid6
   Raid Devices : 11

 Avail Dev Size : 3907024896 (1863.01 GiB 2000.40 GB)
     Array Size : 17581612032 (16767.13 GiB 18003.57 GB)
    Data Offset : 2048 sectors
   Super Offset : 8 sectors
          State : clean
    Device UUID : bebc3764:9e582fe8:01de9766:2d8c452b

Internal Bitmap : 2 sectors from superblock
  Reshape pos'n : 3196923264 (3048.82 GiB 3273.65 GB)
  Delta Devices : 1 (10->11)

    Update Time : Wed Jun 17 19:29:09 2015
       Checksum : 6632686d - correct
         Events : 6039833

         Layout : left-symmetric
     Chunk Size : 64K

   Device Role : Active device 5
   Array State : AAAAAA..AA. ('A' == active, '.' == missing)


/dev/sdk1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x5
     Array UUID : 70485ad1:0f5f2362:e8f5489a:577ac908
           Name : ubuntu:0
  Creation Time : Fri Jan 27 19:20:36 2012
     Raid Level : raid6
   Raid Devices : 11

 Avail Dev Size : 5860268032 (2794.39 GiB 3000.46 GB)
     Array Size : 17581612032 (16767.13 GiB 18003.57 GB)
  Used Dev Size : 3907024896 (1863.01 GiB 2000.40 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
          State : clean
    Device UUID : 986d9f31:3a74b90d:7800779e:31607539

Internal Bitmap : 2 sectors from superblock
  Reshape pos'n : 3148373376 (3002.52 GiB 3223.93 GB)
  Delta Devices : 1 (10->11)

    Update Time : Wed Jun 17 19:24:09 2015
       Checksum : de0a23b - correct
         Events : 6039833

         Layout : left-symmetric
     Chunk Size : 64K

   Device Role : Active device 6
   Array State : AAAAAAAAAA. ('A' == active, '.' == missing)


/dev/sdl1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x5
     Array UUID : 70485ad1:0f5f2362:e8f5489a:577ac908
           Name : ubuntu:0
  Creation Time : Fri Jan 27 19:20:36 2012
     Raid Level : raid6
   Raid Devices : 11

 Avail Dev Size : 5860268032 (2794.39 GiB 3000.46 GB)
     Array Size : 17581612032 (16767.13 GiB 18003.57 GB)
  Used Dev Size : 3907024896 (1863.01 GiB 2000.40 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
          State : clean
    Device UUID : a5f4ac69:f6bbac94:60c1b790:db2c223e

Internal Bitmap : 2 sectors from superblock
  Reshape pos'n : 3196923264 (3048.82 GiB 3273.65 GB)
  Delta Devices : 1 (10->11)

    Update Time : Wed Jun 17 19:28:58 2015
       Checksum : c9909fb9 - correct
         Events : 6039833

         Layout : left-symmetric
     Chunk Size : 64K

   Device Role : Active device 7
   Array State : AAAAAA.AAA. ('A' == active, '.' == missing)


/dev/sdm1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x5
     Array UUID : 70485ad1:0f5f2362:e8f5489a:577ac908
           Name : ubuntu:0
  Creation Time : Fri Jan 27 19:20:36 2012
     Raid Level : raid6
   Raid Devices : 11

 Avail Dev Size : 3907024896 (1863.01 GiB 2000.40 GB)
     Array Size : 17581612032 (16767.13 GiB 18003.57 GB)
    Data Offset : 2048 sectors
   Super Offset : 8 sectors
          State : clean
    Device UUID : 938d9190:582eecf8:b9157fce:38705df2

Internal Bitmap : 2 sectors from superblock
  Reshape pos'n : 3196923264 (3048.82 GiB 3273.65 GB)
  Delta Devices : 1 (10->11)

    Update Time : Wed Jun 17 19:46:34 2015
       Checksum : d2462ecd - correct
         Events : 6039833

         Layout : left-symmetric
     Chunk Size : 64K

   Device Role : Active device 4
   Array State : A.AAA...AA. ('A' == active, '.' == missing)


/dev/sdn1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x5
     Array UUID : 70485ad1:0f5f2362:e8f5489a:577ac908
           Name : ubuntu:0
  Creation Time : Fri Jan 27 19:20:36 2012
     Raid Level : raid6
   Raid Devices : 11

 Avail Dev Size : 3907024896 (1863.01 GiB 2000.40 GB)
     Array Size : 17581612032 (16767.13 GiB 18003.57 GB)
    Data Offset : 2048 sectors
   Super Offset : 8 sectors
          State : clean
    Device UUID : 289f68f6:f43d8a40:2203e21c:e6cff371

Internal Bitmap : 2 sectors from superblock
  Reshape pos'n : 3196923264 (3048.82 GiB 3273.65 GB)
  Delta Devices : 1 (10->11)

    Update Time : Wed Jun 17 19:46:34 2015
       Checksum : 4db49d1a - correct
         Events : 6039833

         Layout : left-symmetric
     Chunk Size : 64K

   Device Role : Active device 8
   Array State : A.AAA...AA. ('A' == active, '.' == missing)
    
por user294789 17.06.2015 / 23:17

2 respostas

0

Eu acho que você não contou aqui toda a história, eu suspeito que a falha de energia foi durante a ressincronização de raid, se assim for, então --auto-assemble não funcionará. É hora de se recuperar de backup ou usar ajuda profissional.

    
por 18.06.2015 / 03:10
0

Bem, a boa notícia é que todas as dez unidades têm contagens de eventos correspondentes em 6039833.

Acho que a chave para o sucesso está resolvendo por que você está vendo ...

md: sdl1 does not have a valid v1.2 superblock, not importing!
md: sdk1 does not have a valid v1.2 superblock, not importing!

Este é um caso interessante e certamente levará algum estudo para descobrir uma solução. Se você gostaria de alguma ajuda entre em contato comigo através do link da web no meu perfil.

    
por 18.06.2015 / 05:32