2022 Jan - Hypervisor crashed

 2022 Jan - Hypervisor crashed and VMs failed to boot

zfs scrubbing for error check

Server freeze while I am trying to migrate data from one VM to another VM.  In the end, all VMs got affected, so I have did a forced reboot.

And then, worst nightmare came with server getting a slow boot detecting virtual partitions.  Oh god, come on ... it is 7pm !!!

Waited for 10 mins and it is still not moving, thus did a hard reboot again, and it hang in the same place again.  Thus, I went for a quick dinner first.

When am back to the office, Hypervisor was up .. but most VMs are dead!  Oh dear, I still need to sleep.  Spend 15 mins to notice VM's partition is missing.  Do I did a partition recovery for each of the VM.

Finally managed go leave office around 9pm, but reporting time for next day wont change.  So much fun doing IT.

Thus today need to go thru the server to see what causes the server to freeze, and see if need to migrate all VMs to another server.

### Next day
After going thru the logs and reading, it seem to be I/O issue with big syncing issue.  I guess will have to do some buffer and watch out the speed of transfer.  But it sort of shaken my confident with this set of hardware.  So should I get a new set of hardware to try again ?


Oh dear, I still have 2,300 mails to go thru.

Comments

Popular posts from this blog

Add Custom Map to Your Google Map