Q:

Need some help recovering/rebuilding my pve+pbs home server

The controller of my SSD (Samsung 980 Pro…) died so I have to rebuild my setup from backups. The first step is to install PVE and on top of that PBS and update everything, then do my LUKS setup on my external RAID and recover /etc/pve from a backup.

 

The original setup is:

Hardware Internal Samsung 980 Pro NVMe SSD (now dead) Mercury Elite Pro Dual Mini hardware RAID1

Encryption at rest SSD Password luks-fa1483bd-f599-4dcf-9732-c09069472150

PV /dev/nvme0n1p3 /dev/mapper/luks-fa1483bd-f599-4dcf-9732-c09069472150

VG pve rna-mepdm-1

LV-thin YES NO

LV (size) vm-100-disk-0 (32GB) vm-100-disk-0 (801GB)

Used as CLIENT boot disk CLIENT: /mnt/ServerData (300GB) ext4 UUID:109bd659-811d-442e-9539-ebf3673d9ad3

LV vm-100-disk-1 (32GB) rna-pbs-mepdm-1 (200GB)

Used as CLIENT: /var/lib/docker UUID:a74f54a6-7a85-4c3b-839f-c034ef280d0b HOST: /mnt/pbs-backup-1 (200GB) ext4 UUID:fb75e648-561d-47a1-948c-83d9d72df80f

LVvm-100-disk-2 (500GB)

Used asCLIENT: /mnt/ServerBackup (500GB) UUID:e7639f38-e488-46fb-bd95-64c930c30603

 

The server data (of the single VM I am currently using) lives on the RAID, and gets backed up to a LV on the internal SSD (as well as to the cloud). I have not lost server data, I lost the internal backup of server data, but I still have one external restic backup of server data on B2.

The VM itself lives on the internal SSD and gets backed up with PBS to the RAID. I lost that VM, but I have a PBS backup on the RAID.

 

I had:

Code:

root@pve:~# vgs -o +lv_size,lv_name

VG          #PV #LV #SN Attr   VSize    VFree   LSize    LV

pve           1   6   0 wz–n- <931.01g  15.99g <794.79g data

pve           1   6   0 wz–n- <931.01g  15.99g    8.00g swap

pve           1   6   0 wz–n- <931.01g  15.99g   96.00g root

pve           1   6   0 wz–n- <931.01g  15.99g   32.00g vm-100-disk-0

pve           1   6   0 wz–n- <931.01g  15.99g   32.00g vm-100-disk-1

pve           1   6   0 wz–n- <931.01g  15.99g  500.00g vm-100-disk-2

(and the RAID entries)

 

After installing PVE and PBS and unlocking the external RAID I have

Code:

root@pve:~# lsblk

NAME                                          MAJ:MIN RM   SIZE RO TYPE  MOUNTPOINTS

loop0                                           7:0    0   300G  0 loop

-loop0p1                                     259:4    0   300G  0 part

sda                                             8:0    0   1.7T  0 disk

-sda1                                          8:1    0   1.7T  0 part

-luks-fa1483bd-f599-4dcf-9732-c09069472150 252:5    0   1.7T  0 crypt

|-rna--mepdm--1-vm--100--disk--0          252:6    0   300G  0 lvm

-rna–mepdm–1-rna–pbs–mepdm–1        252:7    0   200G  0 lvm

nvme0n1                                       259:0    0 931.5G  0 disk

|-nvme0n1p1                                   259:1    0  1007K  0 part

|-nvme0n1p2                                   259:2    0     1G  0 part  /boot/efi

-nvme0n1p3                                   259:3    0   930G  0 part

|-pve-swap                                  252:0    0     8G  0 lvm   [SWAP]

|-pve-root                                  252:1    0    96G  0 lvm   /

|-pve-data_tmeta                            252:2    0   8.1G  0 lvm

| 

-pve-data                                252:4    0 793.8G  0 lvm

-pve-data_tdata                            252:3    0 793.8G  0 lvm

-pve-data                                252:4    0 793.8G  0 lvm

 

I lost the internal SSD, so I lost my VM (which I should be able to restore from the PBS backup), the docker cache of the VM, and the restic backup of server data (of which I still have external backups).

 

Now, the bad news is that I probably have lost a .tar.gz of /etc on the pve host, and the one I still have might be from PVE 8, so before I upgraded to PVE 9 a few months ago (I hope that upgrade is not what finally killed my SSD controller for some reason, but I don’t expect it).

 

Basically, I need to recreate the LV thin VG and the LVs, but I recall that doing that from the command line did not work years ago when I first set it up (2022, PVE 7). What is my best way forward at this point?

Raid data recovery
  • You must be logged in to reply to this topic.
New to Communities?

New to Communities?

Ask a Question