ESXI Crash PSOD 6X 7X

Cause

Panic Details: Crash at 2023-02-05T07:30:19.561Z on CPU 4 running world 2098384 – hclk-sched-vmnic4. VMK Uptime:422:20:42:55.138

Panic Message: @BlueScreen: #PF Exception 14 in world 2098384:hclk-sched-v IP 0x41800a037c55 addr 0x0

Backtrace:

0x451a9ab1bbf0:[0x41800a037c55]qfle3_xmit_pkt@(qfle3)#<None>+0x1e1d stack: 0x459c633c2680, 0xbad0039, 0xbad0039, 0x4180096f7f62, 0x4180478000800x451a9ab1bdd0:[0x41800a0398aa]qfle3_uplink_tx@(qfle3)#<None>+0x8b stack: 0x430db543f790, 0x430632d89a00, 0x430632d89a00, 0x4305bcee6640, 0x10x451a9ab1be20:[0x41800985d144]UplinkDevTransmit@vmkernel#nover+0x4cd stack: 0x1, 0x0, 0x7c, 0x0, 0x451a9ab1bf300x451a9ab1bef0:[0x41800a3edb2f]NetSchedHClkRunCycle@(netsched_hclk)#<None>+0x1f8 stack: 0x1, 0x2f, 0x0, 0x4305bcee6640, 0x7c000000000x451a9ab1bfb0:[0x41800a3edd69]NetSchedHClkSchedSysWorld@(netsched_hclk)#<None>+0x8a stack: 0x451a9ab23000, 0x451a8d023100, 0x451a9ab23100, 0x418009912c1b, 0x00x451a9ab1bfe0:[0x418009912c1a]CpuSched_StartWorld@vmkernel#nover+0x77 stack: 0x0, 0x0, 0x0, 0x0, 0x0

PSOD Can Occur When Using QFLE3 Driver your current version qfle3 1.0.50.11-9vmw.670.0.0.8169922

https://kb.vmware.com/s/article/79058

Qlogic has released a new driver for ESXi 6.7 and 7.0 to address this issue:

ESXi 6.7: Version 1.1.9.0

ESXi 7.0: Version 1.4.8.0:

Cross Hyperviosr Disaster recovery ,ESXI TO AHV or AHV to ESXI

Cross hypervisor disaster recovery (CHDR) provides the ability to migrate the VMs from one
hypervisor to another (ESXi to AHV or AHV to ESXi) by using the protection domain semantics
of protecting VMs, generating snapshots, replicating the snapshots, and then recovering the
VMs from the snapshots

Key notes

  1. install and configure NGT on all the VMs
  2. When you recover VMs from the AHV hypervisor on the ESXi hypervisor, the VMs come up with E1000 NIC attached by default. However, if you want to bring the VMs up withVMXNET NIC is attached, you must install VMware Tools
  3. Static IP address preservation is not supported for CHDR workflows. If a VM has an astatic IP address configured, you must manually reconfigure the VM IP address after its recovery on the target site.
  4. Hypervisor-specific properties like multi-writer flags, independent persistent and independent non-persistent disks, or changed block tracking (CBT) is not preserved in the CHDR operation

Requirements

  1. Nutanix supports only VMs with flat files. Nutanix does not support vSphere snapshots
    or delta disk files. If you have delta disks attached to the VM and you proceed with the
    migration, the VMs are lost
  2. Nutanix does not support VMs with attached volume groups or shared virtual disks
  3. Nutanix supports IDE/SCSI and SATA disks only. PCI/NVMe disks are not supported
  4. Nutanix supports CHDR on both the sites with all the AOS versions that are not EOL
  5. Set the SAN policy to OnlineAll for all the Windows VMs for all the non-boot SCSI disksso that they can automatically be brought online. For more information about setting SANpolicy, see Bringing Multiple SCSI Disks Online on page 208
  6. (For migration from AHV to ESXi) Automatic reattachment of iSCSI-based volume groups(VGs) fails after VMs are migrated to ESXi because vCenter and, in turn, the Nutanix cluster do not obtain the IP addresses of the VMs. Therefore, after migration, manually reattach theVGs to the VMs
  7. Do not enable VMware vSphere Fault Tolerance (FT) on VMs that are protected with CHDR.If already enabled, disable VMware FT. VMware FT does not allow registration of VMs. enabled with FT on any ESXi node after migration. This also results in a failure or crash of Uhura service

Limitations of CHDR

  1. Nutanix cluster nodes to vSphere cluster mapping: The Nutanix data distribution architecture
    does not support the mapping of the nodes of a Nutanix cluster to multiple vSphere clusters
  2. Ensure that all the nodes in the Nutanix cluster are in the same vSphere (ESXi) host cluster and that the network is available on all the nodes in the Nutanix cluster at the primary or remote site. Any configuration using Nutanix DR where there is more than one ESXi cluster on top of a single Nutanix cluster is not supported
  3. Recommends that each application that constitutes a set of entities is protected by a unique protection domain
  4. Supports one snapshot per hour as the shortest possible snapshot frequency for asynchronous replication
  5. Does not support snapshots of the entire file systems or storage containers
  6. Supports a VM to be a part of a protection domain only if the VM is entirely on a Nutanixdatastore and not on an external storage
  7. Does not support running multiple third-party backups in Parallel on the same set of VMs.The system becomes unstable
  8. Does not support VMX editing when you restore a VM. As a result, the characteristics of the restored VM such as MAC addresses may be in conflict with other VMs in the cluster
  9. The replication speed reduces when deduplication is enabled on storage containers containing protected VM

for more details

VMware vSphere health check Guidance

ESXI Server hardware Information :-

  • Server Model
  • Serial Number
  • CPU
  • RAM
  • Local hard drive
  • Number H.D.D
  • Type of HDD
  • BIOS
  • Number of host
  • Application health Check
    • vCenter Build/Release
    • License summary
    • Active Sessions
    • ESX/ESXi Build/Release
    • Cluster(s) Name/Statistics (Hosts, CPU and MEM availabity, HA,DRS and DPM enabled, Resource Pools, Health
    • ESX/ESXi Hardware configuration (NICs/HBAs)
    • ESX/ESXi Hardware Health Sensor via CIM
    • ESX/ESXi State
    • ESX/ESXi Configurations (for detailed information, use detail-hosts option)
    • ESX/ESXi Multipathing Info (only available in host or detail-hosts option)
    • ESX/ESXi Datastore summary
    • ESX/ESXi LUN summary
    • ESX/ESXi Port group summary
    • ESX/ESXi Host logs
    • CDP Summary
    • Recent Task
    • Virtual Machine summary
    • VM Storage summary
    • VM Network summary
    • VM w/Snapshots
    • VM w/Snapshot delta age
    • VM w/RDMs
    • VM w/NPIV enabled
    • VM w/connected CD-ROMs
    • VM w/connected Floppy’s
    • Protection health check
    • Backup virtual machine list
    •  last backup date
    • Pending snapshot for vms (right click the vms and check the snapshot)