VM ダウン: /vm/xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx/domains の読み取りに失敗しました: このドメインはすでにクリーンアップされていますか?

VM ダウン: /vm/xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx/domains の読み取りに失敗しました: このドメインはすでにクリーンアップされていますか?

xcp-ng サーバーに問題があり、Linux xcp-ng 4.19.0+1 で xcp center 20.04.01 を使用しています。問題が発生する前に更新などの操作は何も行っていませんでしたが、数か月間すべて正常に動作していました。

私がまだできることは次のとおりです:

  • xcp centerとSSH経由でサーバーに接続する
  • すべてのサーバーとスナップショットを表示
  • 仮想マシンを起動または停止する

しかし、次のようないくつかの問題に直面しています。

  • 「パフォーマンス」タブにデータが表示されません。
  • 実行中の VM のコンソールに何も表示されません。
  • 起動された VM が IP に応答しません。
  • VMタブがグレー表示

やってみました :

  • ログを分析してエラーを検索しても見つからない
  • xe-toolstack の再起動
  • VMを再起動する
  • サーバー全体を再起動する

これらの問題を解決するための手順を教えてくれる人はいますか?

cat /var/log/xensource.log | grep エラー

Aug 31 18:24:59 xcp-ng xenopsd-xc: [error||19 |Async.VM.start R:ffffffffffff|xenops] Failed to read /vm/xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx/domains: has this domain already been cleaned up?
Aug 31 18:24:59 xcp-ng xenopsd-xc: [ info||19 |Async.VM.start R:ffffffffffff|xenops] VM = xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx; Hardware Assisted Paging will be enabled. Use platform/hap=(true|false) to override
Aug 31 18:25:00 xcp-ng xapi: [error||1249 HTTPS x.x.x.x->|Async.VM.start R:ffffffffffff|sql] Duplicate key in set or map: table task; field other_config; ref OpaqueRef:yyyyyyyy-xxxx-qqqq-xxxx-yyyyyyyyyyyy; key debug_info:cancel_points_seen
Aug 31 18:25:00 xcp-ng xapi: [error||1247 /var/lib/xcp/xapi||backtrace] event.from D:dddddddddddd failed with exception Server_error(SESSION_INVALID, [ OpaqueRef:yyyyyyyy-xxxx-yyyy-xxxx-yyyyyyyyyyyy ])
Aug 31 18:25:00 xcp-ng xapi: [error||1247 /var/lib/xcp/xapi||backtrace] Raised Server_error(SESSION_INVALID, [ OpaqueRef:yyyyyyyy-xxxx-yyyy-xxxx-yyyyyyyyyyyy ])
Aug 31 18:25:00 xcp-ng xapi: [error||1247 /var/lib/xcp/xapi||backtrace] 1/13 xapi Raised at file ocaml/xapi/xapi_event.ml, line 434
Aug 31 18:25:00 xcp-ng xapi: [error||1247 /var/lib/xcp/xapi||backtrace] 2/13 xapi Called from file ocaml/xapi/xapi_event.ml, line 606
Aug 31 18:25:00 xcp-ng xapi: [error||1247 /var/lib/xcp/xapi||backtrace] 3/13 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 24
Aug 31 18:25:00 xcp-ng xapi: [error||1247 /var/lib/xcp/xapi||backtrace] 4/13 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 35
Aug 31 18:25:00 xcp-ng xapi: [error||1247 /var/lib/xcp/xapi||backtrace] 5/13 xapi Called from file ocaml/xapi/xapi_event.ml, line 587
Aug 31 18:25:00 xcp-ng xapi: [error||1247 /var/lib/xcp/xapi||backtrace] 6/13 xapi Called from file ocaml/xapi/xapi_event.ml, line 698
Aug 31 18:25:00 xcp-ng xapi: [error||1247 /var/lib/xcp/xapi||backtrace] 7/13 xapi Called from file ocaml/xapi/rbac.ml, line 223
Aug 31 18:25:00 xcp-ng xapi: [error||1247 /var/lib/xcp/xapi||backtrace] 8/13 xapi Called from file ocaml/xapi/rbac.ml, line 231
Aug 31 18:25:00 xcp-ng xapi: [error||1247 /var/lib/xcp/xapi||backtrace] 9/13 xapi Called from file ocaml/xapi/server_helpers.ml, line 103
Aug 31 18:25:00 xcp-ng xapi: [error||1247 /var/lib/xcp/xapi||backtrace] 10/13 xapi Called from file ocaml/xapi/server_helpers.ml, line 121
Aug 31 18:25:00 xcp-ng xapi: [error||1247 /var/lib/xcp/xapi||backtrace] 11/13 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 24
Aug 31 18:25:00 xcp-ng xapi: [error||1247 /var/lib/xcp/xapi||backtrace] 12/13 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 35
Aug 31 18:25:00 xcp-ng xapi: [error||1247 /var/lib/xcp/xapi||backtrace] 13/13 xapi Called from file lib/backtrace.ml, line 177
Aug 31 18:25:00 xcp-ng xapi: [error||1247 /var/lib/xcp/xapi||backtrace]
Aug 31 18:25:00 xcp-ng xapi: [error||511 ||backtrace] Raised Server_error(SESSION_INVALID, [ OpaqueRef:yyyyyyyy-xxxx-yyyy-xxxx-yyyyyyyyyyyy ])
Aug 31 18:25:00 xcp-ng xapi: [error||511 ||backtrace] 1/4 xapi Raised at file ocaml/xapi-client/client.ml, line 7
Aug 31 18:25:00 xcp-ng xapi: [error||511 ||backtrace] 2/4 xapi Called from file ocaml/xapi-client/client.ml, line 19
Aug 31 18:25:00 xcp-ng xapi: [error||511 ||backtrace] 3/4 xapi Called from file ocaml/xapi-client/client.ml, line 3956
Aug 31 18:25:00 xcp-ng xapi: [error||511 ||backtrace] 4/4 xapi Called from file ocaml/xapi/xapi_xenops.ml, line 3071
Aug 31 18:25:00 xcp-ng xapi: [error||511 ||backtrace]
Aug 31 18:25:00 xcp-ng xapi: [error||1353 /var/lib/xcp/xapi||backtrace] session_check D:eeeeeeeeeeee failed with exception Server_error(SESSION_INVALID, [ OpaqueRef:yyyyyyyy-xxxx-yyyy-xxxx-yyyyyyyyyyyy ])
Aug 31 18:25:00 xcp-ng xapi: [error||1353 /var/lib/xcp/xapi||backtrace] Raised Server_error(SESSION_INVALID, [ OpaqueRef:yyyyyyyy-xxxx-yyyy-xxxx-yyyyyyyyyyyy ])
Aug 31 18:25:00 xcp-ng xapi: [error||1353 /var/lib/xcp/xapi||backtrace] 1/6 xapi Raised at file ocaml/xapi/session_check.ml, line 63
Aug 31 18:25:00 xcp-ng xapi: [error||1353 /var/lib/xcp/xapi||backtrace] 2/6 xapi Called from file ocaml/xapi/server_helpers.ml, line 100
Aug 31 18:25:00 xcp-ng xapi: [error||1353 /var/lib/xcp/xapi||backtrace] 3/6 xapi Called from file ocaml/xapi/server_helpers.ml, line 121
Aug 31 18:25:00 xcp-ng xapi: [error||1353 /var/lib/xcp/xapi||backtrace] 4/6 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 24
Aug 31 18:25:00 xcp-ng xapi: [error||1353 /var/lib/xcp/xapi||backtrace] 5/6 xapi Called from file lib/xapi-stdext-pervasives/pervasiveext.ml, line 35
Aug 31 18:25:00 xcp-ng xapi: [error||1353 /var/lib/xcp/xapi||backtrace] 6/6 xapi Called from file lib/backtrace.ml, line 177
Aug 31 18:25:00 xcp-ng xapi: [error||1353 /var/lib/xcp/xapi||backtrace]
Aug 31 18:25:00 xcp-ng xapi: [debug||511 ||helpers] Helpers.call_api_functions failed to logout: Server_error(SESSION_INVALID, [ OpaqueRef:yyyyyyyy-xxxx-yyyy-xxxx-yyyyyyyyyyyy ]) (ignoring)
Aug 31 18:25:00 xcp-ng xapi: [error||511 ||xenops] events_from_xapi: missing from the cache: [ yyyyyyyy-xxxx-yyyy-xxxx-zzzzzzzzzzzz ]
[18:25 xcp-ng log]#

[アップデート] dmesg で次のことが分かりました:

[    4.217516] Call Trace:
[    4.217518]  <IRQ>
[    4.217521]  dump_stack+0x5a/0x73
[    4.217524]  report_bad_irq+0x30/0xc0
[    4.217525]  note_interrupt+0x208/0x260
[    4.217526]  handle_irq_event_percpu+0x51/0x70
[    4.217528]  handle_irq_event+0x36/0x60
[    4.217528]  handle_fasteoi_irq+0x78/0x130
[    4.217529]  generic_handle_irq+0x24/0x30
[    4.217532]  evtchn_fifo_handle_events+0x180/0x1a0
[    4.217534]  __xen_evtchn_do_upcall+0x5f/0xb0
[    4.217534]  xen_evtchn_do_upcall+0x27/0x50
[    4.217536]  xen_do_hypervisor_callback+0x29/0x40
[    4.217537]  </IRQ>
[    4.217538] RIP: e030:xen_hypercall_sched_op+0xa/0x20
[    4.217539] Code: 51 41 53 b8 1c 00 00 00 0f 05 41 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05 <41> 5b 59 c3 cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc cc
[    4.217540] RSP: e02b:ffffffff82003e58 EFLAGS: 00000246
[    4.217541] RAX: 0000000000000000 RBX: ffffffff82011740 RCX: ffffffff810013aa
[    4.217541] RDX: ffffffff8203d250 RSI: 0000000000000000 RDI: 0000000000000001
[    4.217542] RBP: 0000000000000000 R08: 0000000000000008 R09: 00000000fc9e909a
[    4.217542] R10: 0000000000007ff0 R11: 0000000000000246 R12: 0000000000000000
[    4.217542] R13: 0000000000000000 R14: ffffffff82011740 R15: ffffffff82011740
[    4.217543]  ? xen_hypercall_sched_op+0xa/0x20
[    4.217545]  ? xen_safe_halt+0xc/0x20
[    4.217546]  ? default_idle+0x1a/0x140
[    4.217547]  ? do_idle+0x1ea/0x260
[    4.217548]  ? cpu_startup_entry+0x6f/0x80
[    4.217550]  ? start_kernel+0x558/0x578
[    4.217551]  ? set_init_arg+0x55/0x55
[    4.217552]  ? xen_start_kernel+0x599/0x5a3
[    4.217552] handlers:
[    4.217581] [<00000000d7be1930>] tis_int_handler
[    4.217655] Disabling IRQ #45

BSD vmにリンクできるようです。私のイーサネットコントローラはntel Corporation Ethernet Controller 10G X550Tです。

関連情報