Thursday 3 August 2023

Nutanix CE 2.0 on ESXi AOS Upgrade Hangs

AOS Upgrade on ESXi from 6.5.2 to 6.5.3.6 hangs.

Issue

I have tried to upgrade my Nutanix CE 2.0 based on ESXi to a newer AOS version for a while and it has caused issues. After kicking off the upgrade, LCM starts a root task which hangs at 60%. The AOS upgrade for each node shows as cancelled in the tasks view and LCM stops responding.

Symptoms

  • LCM Root Task hung at 60%
  • LCM Tasks for each CVM upgrade showing as “Cancelled”
  • Running lcm_leader on a CVM returns no leader “lcm leader is at none”
  • Trying to open LCM on Prism Elements shows “loading”

test4

Investigation

/home/nutanix/data/logs/install.out shows that SCSI passthrough is no longer supported. “SCSI passthrough on ESX is no longer supported in NOS 4.5+”

test2

Workaround

Comment out the check for SCSI passthrough in the installer script - /home/nutanix/data/installer/<version string>/bin/svm_upgrade - on each CVM, save, then wait. The exact location can be found in the install.out log file from above.

test3

LCM should kick back in to life and the install should complete as normal.

test5

Tailing the /home/nutanix/data/logs/install.out file shows the install now continues

test6

Once complete the new version is shown in the About Nutanix dialog.

test

Written with StackEdit.

4 comments:

  1. Awesome, this helped me get through a stuck upgrade today, thanks :-)

    ReplyDelete
  2. Stumbled across this and it really helped me dude. I owe you one.

    ReplyDelete
  3. Stumbled across this gem and my updates are back on track.

    ReplyDelete
  4. Natalie Rasheed1 August 2024 at 14:20

    Oh dude, you save me a ton of work, I owe you an Iced Soda

    ReplyDelete

Please be nice! :)

Nutanix CE 2.0 on ESXi AOS Upgrade Hangs

AOS Upgrade on ESXi from 6.5.2 to 6.5.3.6 hangs. Issue I have tried to upgrade my Nutanix CE 2.0 based on ESXi to a newer AOS version for ...