[Qemu-devel] [Bug 1818937] Re: Crash with HV_ERROR on macOS host

[Roman Bolshakov]

For the triage of the issue we need the following VMCS fields:
* instruction error
* exit reason
* exit qualification

On my machine (with macOS 10.14.5) each time QEMU exits with HV_ERROR, AppleHV 
spills the following error into system log:
2019-07-06 10:38:56.148547+0300 0x1e3ee4   Default     0x0                  0   
   0    kernel: (AppleHV) AppleHV: 
/BuildRoot/Library/Caches/com.apple.xbs/Sources/Hypervisor/Hypervisor-31.230.1/kext/x86/vmx/hv_vmx_vcpu.cpp
 : hv_return_t hv_vmx_vcpu_t::hv_vmx_vcpu_run()
: 997

Such log lines can be read with the command:
$ log show -predicate 'senderImagePath CONTAINS "AppleHV"'

The error above can only happen if vmlaunch or vmresume has failed and
RFLAGS has either CF or ZF (or both) set to 1, according to Intel SDM.
Unfortunately the exact RFLAGS value is not logged by
Hypervisor.framework. I have submitted a feedback report (FB6787376) to
log RFLAGS if it's not zero  immediately after vmlaunch/vmresume.

If you wish to assist in debugging of the issue, please build and use QEMU from 
the branch:
https://github.com/roolebo/qemu/tree/debug-hv-error

Or apply the patch to your tree:
https://github.com/roolebo/qemu/commit/f8098782573a89fc323d8dcae2d5445335e626f0.diff

-- 
You received this bug notification because you are a member of qemu-
devel-ml, which is subscribed to QEMU.
https://bugs.launchpad.net/bugs/1818937

Title:
  Crash with HV_ERROR on macOS host

Status in QEMU:
  New

Bug description:
  On macOS host running Windows 10 guest, qemu crashed with error
  message: Error: HV_ERROR.

  Host: macOS Mojave 10.14.3 (18D109) Late 2014 Mac mini presumably Core i5 
4278U.
  QEMU: git commit a3e3b0a7bd5de211a62cdf2d6c12b96d3c403560
  QEMU parameter: qemu-system-x86_64 -m 3000 -drive 
file=disk.img,if=virtio,discard=unmap -accel hvf -soundhw hda -smp 3

  thread list
  Process 56054 stopped
    thread #1: tid = 0x2ffec8, 0x00007fff48d0805a vImage`vLookupTable_Planar16 
+ 970, queue = 'com.apple.main-thread'
    thread #2: tid = 0x2ffecc, 0x00007fff79d6d7de 
libsystem_kernel.dylib`__psynch_cvwait + 10
    thread #3: tid = 0x2ffecd, 0x00007fff79d715aa 
libsystem_kernel.dylib`__select + 10
    thread #4: tid = 0x2ffece, 0x00007fff79d71d9a 
libsystem_kernel.dylib`__sigwait + 10
  * thread #6: tid = 0x2ffed0, 0x00007fff79d7023e 
libsystem_kernel.dylib`__pthread_kill + 10, stop reason = signal SIGABRT
    thread #7: tid = 0x2ffed1, 0x00007fff79d6d7de 
libsystem_kernel.dylib`__psynch_cvwait + 10
    thread #8: tid = 0x2ffed2, 0x00007fff79d6d7de 
libsystem_kernel.dylib`__psynch_cvwait + 10
    thread #11: tid = 0x2fff34, 0x00007fff79d6a17a 
libsystem_kernel.dylib`mach_msg_trap + 10, name = 'com.apple.NSEventThread'
    thread #30: tid = 0x300c04, 0x00007fff79e233f8 
libsystem_pthread.dylib`start_wqthread
    thread #31: tid = 0x300c16, 0x00007fff79e233f8 
libsystem_pthread.dylib`start_wqthread
    thread #32: tid = 0x300c17, 0x0000000000000000
    thread #33: tid = 0x300c93, 0x00007fff79d6d7de 
libsystem_kernel.dylib`__psynch_cvwait + 10

  
  Crashed thread:

  * thread #6, stop reason = signal SIGABRT
    * frame #0: 0x00007fff79d7023e libsystem_kernel.dylib`__pthread_kill + 10
      frame #1: 0x00007fff79e26c1c libsystem_pthread.dylib`pthread_kill + 285
      frame #2: 0x00007fff79cd91c9 libsystem_c.dylib`abort + 127
      frame #3: 0x000000010baa476d 
qemu-system-x86_64`assert_hvf_ok(ret=<unavailable>) at hvf.c:106 [opt]
      frame #4: 0x000000010baa4c8f 
qemu-system-x86_64`hvf_vcpu_exec(cpu=0x00007f8e5283de00) at hvf.c:681 [opt]
      frame #5: 0x000000010b988423 
qemu-system-x86_64`qemu_hvf_cpu_thread_fn(arg=0x00007f8e5283de00) at 
cpus.c:1636 [opt]
      frame #6: 0x000000010bd9dfce 
qemu-system-x86_64`qemu_thread_start(args=<unavailable>) at 
qemu-thread-posix.c:502 [opt]
      frame #7: 0x00007fff79e24305 libsystem_pthread.dylib`_pthread_body + 126
      frame #8: 0x00007fff79e2726f libsystem_pthread.dylib`_pthread_start + 70
      frame #9: 0x00007fff79e23415 libsystem_pthread.dylib`thread_start + 13

To manage notifications about this bug go to:
https://bugs.launchpad.net/qemu/+bug/1818937/+subscriptions