[PULL 00/30] Migration 20230206 patches

[Juan Quintela]

The following changes since commit 6661b8c7fe3f8b5687d2d90f7b4f3f23d70e3e8b:

  Merge tag 'pull-ppc-20230205' of https://gitlab.com/danielhb/qemu into 
staging (2023-02-05 16:49:09 +0000)

are available in the Git repository at:

  https://gitlab.com/juan.quintela/qemu.git tags/migration-20230206-pull-request

for you to fetch changes up to 1b1f4ab69c41279a45ccd0d3178e83471e6e4ec1:

  migration: save/delete migration thread info (2023-02-06 19:22:57 +0100)

----------------------------------------------------------------
Migration Pull request

In this try
- rebase to latest upstream
- same than previous patch
- fix compilation on non linux (userfaultfd.h) (me)
- query-migrationthreads (jiang)
- fix race on reading MultiFDPages_t.block (zhenzhong)
- fix flush of zero copy page send reuest  (zhenzhong)

Please apply.

Previous try:
It includes:
- David Hildenbrand fixes for virtio-men
- David Gilbert canary to detect problems
- Fix for rdma return values (Fiona)
- Peter Xu uffd_open fixes
- Peter Xu show right downtime for postcopy
- manish.mishra msg fix fixes
- my vfio changes.

Please apply.

----------------------------------------------------------------

David Hildenbrand (13):
  migration/ram: Fix populate_read_range()
  migration/ram: Fix error handling in ram_write_tracking_start()
  migration/ram: Don't explicitly unprotect when unregistering uffd-wp
  migration/ram: Rely on used_length for uffd_change_protection()
  migration/ram: Optimize ram_write_tracking_start() for
    RamDiscardManager
  migration/savevm: Move more savevm handling into vmstate_save()
  migration/savevm: Prepare vmdesc json writer in
    qemu_savevm_state_setup()
  migration/savevm: Allow immutable device state to be migrated early
    (i.e., before RAM)
  migration/vmstate: Introduce VMSTATE_WITH_TMP_TEST() and
    VMSTATE_BITMAP_TEST()
  migration/ram: Factor out check for advised postcopy
  virtio-mem: Fail if a memory backend with "prealloc=on" is specified
  virtio-mem: Migrate immutable properties early
  virtio-mem: Proper support for preallocation with migration

Dr. David Alan Gilbert (2):
  migration: Add canary to VMSTATE_END_OF_LIST
  migration: Perform vmsd structure check during tests

Fiona Ebner (1):
  migration/rdma: fix return value for qio_channel_rdma_{readv,writev}

Jiang Jiacheng (2):
  migration: Introduce interface query-migrationthreads
  migration: save/delete migration thread info

Juan Quintela (4):
  migration: No save_live_pending() method uses the QEMUFile parameter
  migration: Split save_live_pending() into state_pending_*
  migration: Remove unused threshold_size parameter
  migration: simplify migration_iteration_run()

Peter Xu (3):
  migration: Fix migration crash when target psize larger than host
  util/userfaultfd: Add uffd_open()
  migration: Show downtime during postcopy phase

Zhenzhong Duan (3):
  migration/dirtyrate: Show sample pages only in page-sampling mode
  multifd: Fix a race on reading MultiFDPages_t.block
  multifd: Fix flush of zero copy page send request

manish.mishra (2):
  io: Add support for MSG_PEEK for socket channel
  migration: check magic value for deciding the mapping of channels

 docs/devel/migration.rst                      |   18 +-
 docs/devel/vfio-migration.rst                 |    4 +-
 .../x86_64-quintela-devices.mak               |    7 +
 .../x86_64-quintela2-devices.mak              |    6 +
 qapi/migration.json                           |   29 +
 include/hw/virtio/virtio-mem.h                |    8 +
 include/io/channel.h                          |    6 +
 include/migration/misc.h                      |    4 +-
 include/migration/register.h                  |   17 +-
 include/migration/vmstate.h                   |   35 +-
 include/qemu/userfaultfd.h                    |   12 +
 migration/channel.h                           |    5 +
 migration/migration.h                         |    4 +
 migration/multifd.h                           |    2 +-
 migration/postcopy-ram.h                      |    2 +-
 migration/savevm.h                            |   10 +-
 migration/threadinfo.h                        |   28 +
 chardev/char-socket.c                         |    4 +-
 hw/core/machine.c                             |    4 +-
 hw/s390x/s390-stattrib.c                      |   11 +-
 hw/vfio/migration.c                           |   20 +-
 hw/virtio/virtio-mem.c                        |  144 +-
 io/channel-buffer.c                           |    1 +
 io/channel-command.c                          |    1 +
 io/channel-file.c                             |    1 +
 io/channel-null.c                             |    1 +
 io/channel-socket.c                           |   19 +-
 io/channel-tls.c                              |    1 +
 io/channel-websock.c                          |    1 +
 io/channel.c                                  |   16 +-
 migration/block-dirty-bitmap.c                |   14 +-
 migration/block.c                             |   13 +-
 migration/channel-block.c                     |    1 +
 migration/channel.c                           |   45 +
 migration/dirtyrate.c                         |   10 +-
 migration/migration.c                         |  124 +-
 migration/multifd.c                           |   39 +-
 migration/postcopy-ram.c                      |   16 +-
 migration/ram.c                               |  120 +-
 migration/rdma.c                              |   16 +-
 migration/savevm.c                            |  187 ++-
 migration/threadinfo.c                        |   51 +
 migration/vmstate.c                           |    2 +
 scsi/qemu-pr-helper.c                         |    2 +-
 tests/qtest/migration-test.c                  |    4 +-
 tests/qtest/tpm-emu.c                         |    2 +-
 tests/unit/test-io-channel-socket.c           |    1 +
 util/userfaultfd.c                            |   13 +-
 util/vhost-user-server.c                      |    2 +-
 hw/vfio/trace-events                          |    2 +-
 migration/meson.build                         |    1 +
 migration/multifd.c.orig                      | 1274 +++++++++++++++++
 migration/trace-events                        |    7 +-
 53 files changed, 2134 insertions(+), 233 deletions(-)
 create mode 100644 configs/devices/x86_64-softmmu/x86_64-quintela-devices.mak
 create mode 100644 configs/devices/x86_64-softmmu/x86_64-quintela2-devices.mak
 create mode 100644 migration/threadinfo.h
 create mode 100644 migration/threadinfo.c
 create mode 100644 migration/multifd.c.orig

-- 
2.39.1