AOS Upgrade on ESXi from 6.5.2 to 6.5.3.6 hangs.
Issue
I have tried to upgrade my Nutanix CE 2.0 based on ESXi to a newer AOS version for a while and it has caused issues. After kicking off the upgrade, LCM starts a root task which hangs at 60%. The AOS upgrade for each node shows as cancelled in the tasks view and LCM stops responding.
Symptoms
- LCM Root Task hung at 60%
- LCM Tasks for each CVM upgrade showing as “Cancelled”
- Running
lcm_leader
on a CVM returns no leader “lcm leader is at none” - Trying to open LCM on Prism Elements shows “loading”
Investigation
/home/nutanix/data/logs/install.out
shows that SCSI passthrough is no longer supported. “SCSI passthrough on ESX is no longer supported in NOS 4.5+”
Workaround
Comment out the check for SCSI passthrough in the installer script - /home/nutanix/data/installer/<version string>/bin/svm_upgrade
- on each CVM, save, then wait. The exact location can be found in the install.out
log file from above.
LCM should kick back in to life and the install should complete as normal.
Tailing the /home/nutanix/data/logs/install.out
file shows the install now continues
Once complete the new version is shown in the About Nutanix dialog.
Written with StackEdit.
Awesome, this helped me get through a stuck upgrade today, thanks :-)
ReplyDeleteStumbled across this and it really helped me dude. I owe you one.
ReplyDeleteStumbled across this gem and my updates are back on track.
ReplyDeleteOh dude, you save me a ton of work, I owe you an Iced Soda
ReplyDelete