XenServer зависает при экспорте виртуальной машины

Question

stboris @stboris

XenServer зависает при экспорте виртуальной машины

В XenServer 6.0 настроены ежесуточные бэкапы при помощи скрипта, который по очереди выключает виртуалки, экспортирует их при помощи xe vm-export на примонтированную NFS шару и включает обратно.

Изредка (раз в несколько недель или больше) возникает проблема — сервер перестаёт отвечать, к нему не подсоединиться ни через SSH, ни через XenCenter. Если зайти на него локально, то он тоже висит. Более точно не могу сказать, т.к. в последний раз меня не было на месте, а сервер надо было срочно поднять.

После перезагрузки сервера всё работает нормально.

По логам своего скрипта для бэкапов я вижу, что на одной виртуалке он споткнулся. В </var/logs/SMlog> последняя запись за этот день — +2s от начала экспорта этой виртуалки, далее записи уже за следующий день.

Подскажите, какие логи смотреть? Может быть кто-то сталкивался с подобной проблемой.

Вопрос задан более трёх лет назад
4044 просмотра

2 комментария

Подписаться 2 Оценить 2 комментария

stboris @stboris Автор вопроса

Очень похожая проблема описывается в одной теме на форуме Citrix.

Написано более трёх лет назад

stboris @stboris Автор вопроса

Пробую по логам восстановить, что происходило после команды экспорта виртуальной машины.

Отдана команда на экспорт ВМ (лог скрипта бэкапа):

Sat Sep 29 22:03:33 2012 Exporting VM: /mnt/backup/e-staff/e-staff-120929-2203.xvatmp -> /mnt/backup/e-staff/e-staff-120929-2203.xva

По началу всё одинаково:

Кусок лога /var/log/messages в день успешного бэкапа

Sep 28 22:06:23 xs-venus tapdisk[28778]: tapdisk-control: init, 10 x 4k buffers 
Sep 28 22:06:23 xs-venus tapdisk[28778]: I/O queue driver: lio 
Sep 28 22:06:23 xs-venus tapdisk[28778]: tapdisk-log: started, level 0 
Sep 28 22:06:23 xs-venus tapdisk[28778]: /dev/VG_XenStorage-44a08f67-f2d7-62c8-90d7-4cb9f66ca887/VHD-72fd3b46-3260-4b62-9a91-6501c6d04678 version: tap 0x00010003, b: 8192, a: 7966, f: 7962, n: 0 
Sep 28 22:06:23 xs-venus tapdisk[28778]: opened image /dev/VG_XenStorage-44a08f67-f2d7-62c8-90d7-4cb9f66ca887/VHD-72fd3b46-3260-4b62-9a91-6501c6d04678 (1 users, state: 0x00000003, type: 4, ro) 
Sep 28 22:06:23 xs-venus tapdisk[28778]: VBD CHAIN: 
Sep 28 22:06:23 xs-venus tapdisk[28778]: /dev/VG_XenStorage-44a08f67-f2d7-62c8-90d7-4cb9f66ca887/VHD-72fd3b46-3260-4b62-9a91-6501c6d04678: type:vhd(4) storage:lvm(3) 
Sep 28 22:06:23 xs-venus tapdisk[28778]: bdev: capacity=33554432 sector_size=512/512 flags=0
Sep 28 22:06:23 xs-venus kernel: block tdj: sector-size: 512/512 capacity: 33554432
Sep 28 22:06:23 xs-venus kernel: blkback: event-channel 85
Sep 28 22:06:23 xs-venus kernel: blkback: ring-ref 564
Sep 28 22:06:23 xs-venus kernel: blkback: protocol 1 (x86_32-abi)
Sep 28 22:06:23 xs-venus kernel: blkfront: xvda: barriers enabled
Sep 28 22:06:23 xs-venus kernel:  xvda: xvda1
Sep 28 22:06:23 xs-venus vbd.uevent[add](backend/vbd/0/51712): wrote /xapi/0/hotplug/vbd/51712/hotplug = 'online'
Sep 28 22:06:23 xs-venus vbd.uevent[add](backend/vbd/0/51712): wrote backend/vbd/0/51712/hotplug-status = 'connected'
Sep 28 22:06:25 xs-venus fe: qemu-dm-150[28396]:  XENIFACE Notice   USER: Features : running 
Sep 28 22:06:57 xs-venus fe: qemu-dm-150[28396]:  XENUTIL  Notice   122(0): F88F6000 - F88FBFFF: TDTCP.SYS
Sep 28 22:06:57 xs-venus fe: qemu-dm-150[28396]:  XENUTIL  Notice   123(0): F5247000 - F5269FFF: RDPWD.SYS

Кусок лога /var/log/messages в день проблемы

Sep 29 22:03:35 xs-venus tapdisk[6116]: tapdisk-control: init, 10 x 4k buffers 
Sep 29 22:03:35 xs-venus tapdisk[6116]: I/O queue driver: lio 
Sep 29 22:03:35 xs-venus tapdisk[6116]: tapdisk-log: started, level 0 
Sep 29 22:03:35 xs-venus tapdisk[6116]: /dev/VG_XenStorage-44a08f67-f2d7-62c8-90d7-4cb9f66ca887/VHD-72fd3b46-3260-4b62-9a91-6501c6d04678 version: tap 0x00010003, b: 8192, a: 7966, f: 7962, n: 0 
Sep 29 22:03:35 xs-venus tapdisk[6116]: opened image /dev/VG_XenStorage-44a08f67-f2d7-62c8-90d7-4cb9f66ca887/VHD-72fd3b46-3260-4b62-9a91-6501c6d04678 (1 users, state: 0x00000003, type: 4, ro) 
Sep 29 22:03:35 xs-venus tapdisk[6116]: VBD CHAIN: 
Sep 29 22:03:35 xs-venus tapdisk[6116]: /dev/VG_XenStorage-44a08f67-f2d7-62c8-90d7-4cb9f66ca887/VHD-72fd3b46-3260-4b62-9a91-6501c6d04678: type:vhd(4) storage:lvm(3) 
Sep 29 22:03:35 xs-venus tapdisk[6116]: bdev: capacity=33554432 sector_size=512/512 flags=0
Sep 29 22:03:35 xs-venus kernel: block tdj: sector-size: 512/512 capacity: 33554432
Sep 29 22:03:35 xs-venus kernel: blkback: event-channel 85
Sep 29 22:03:35 xs-venus kernel: blkback: ring-ref 680
Sep 29 22:03:35 xs-venus kernel: blkback: protocol 1 (x86_32-abi)
Sep 29 22:03:35 xs-venus kernel: blkfront: xvda: barriers enabled
Sep 29 22:03:35 xs-venus kernel:  xvda: xvda1
Sep 29 22:03:35 xs-venus vbd.uevent[add](backend/vbd/0/51712): wrote /xapi/0/hotplug/vbd/51712/hotplug = 'online'
Sep 29 22:03:35 xs-venus vbd.uevent[add](backend/vbd/0/51712): wrote backend/vbd/0/51712/hotplug-status = 'connected'
Sep 29 22:03:36 xs-venus fe: qemu-dm-153[5750]:  XENIFACE Notice   USER: Features : running 
Sep 29 22:04:07 xs-venus fe: qemu-dm-153[5750]:  XENUTIL  Notice   122(0): F88C6000 - F88CBFFF: TDTCP.SYS
Sep 29 22:04:07 xs-venus fe: qemu-dm-153[5750]:  XENUTIL  Notice   123(0): F5247000 - F5269FFF: RDPWD.SYS

А вот тут начинаются различия:

Продолжение /var/log/messages в день успешного бэкапа

Sep 28 22:07:17 xs-venus ovs-vswitchd: 19405|timeval|WARN|761 ms poll interval (0 ms user, 0 ms system) is over 1217 times the weighted mean interval 1 ms (31434327 samples)
Sep 28 22:07:17 xs-venus ovs-vswitchd: 19406|timeval|WARN|context switches: 222 voluntary, 0 involuntary
Sep 28 22:07:17 xs-venus ovs-vswitchd: 19407|coverage|INFO|Skipping details of duplicate event coverage for hash=2e98b47a in epoch 31434327
Sep 28 22:07:23 xs-venus ovs-vswitchd: 19408|timeval|WARN|325 ms poll interval (0 ms user, 10 ms system) is over 32 times the weighted mean interval 10 ms (31434355 samples)
Sep 28 22:07:23 xs-venus ovs-vswitchd: 19409|timeval|WARN|context switches: 206 voluntary, 0 involuntary
Sep 28 22:07:23 xs-venus ovs-vswitchd: 19410|coverage|INFO|Skipping details of duplicate event coverage for hash=2e98b47a in epoch 31434355
Sep 28 22:08:23 xs-venus ovs-vswitchd: 19411|timeval|WARN|12 ms poll interval (0 ms user, 0 ms system) is over 19 times the weighted mean interval 1 ms (31434833 samples)
Sep 28 22:08:23 xs-venus ovs-vswitchd: 19412|timeval|WARN|context switches: 1 voluntary, 0 involuntary
Sep 28 22:08:23 xs-venus ovs-vswitchd: 19413|coverage|INFO|Skipping details of duplicate event coverage for hash=b0e699e3 in epoch 31434833
Sep 28 22:08:58 xs-venus ovs-vswitchd: 19414|timeval|WARN|12 ms poll interval (0 ms user, 0 ms system) is over 19 times the weighted mean interval 1 ms (31435055 samples)
Sep 28 22:08:58 xs-venus ovs-vswitchd: 19415|timeval|WARN|context switches: 1 voluntary, 0 involuntary
Sep 28 22:08:58 xs-venus ovs-vswitchd: 19416|coverage|INFO|Skipping details of duplicate event coverage for hash=84e90a37 in epoch 31435055
Sep 28 22:10:33 xs-venus ovs-vswitchd: 19417|timeval|WARN|180 ms poll interval (0 ms user, 0 ms system) is over 288 times the weighted mean interval 1 ms (31435673 samples)
Sep 28 22:10:33 xs-venus ovs-vswitchd: 19418|timeval|WARN|context switches: 1 voluntary, 0 involuntary
Sep 28 22:10:33 xs-venus ovs-vswitchd: 19419|coverage|INFO|Skipping details of duplicate event coverage for hash=b0e699e3 in epoch 31435673
Sep 28 22:11:14 xs-venus ovs-vswitchd: 19420|timeval|WARN|497 ms poll interval (0 ms user, 10 ms system) is over 795 times the weighted mean interval 1 ms (31435937 samples)
Sep 28 22:11:14 xs-venus ovs-vswitchd: 19421|timeval|WARN|context switches: 291 voluntary, 0 involuntary
Sep 28 22:11:14 xs-venus ovs-vswitchd: 19422|coverage|INFO|Skipping details of duplicate event coverage for hash=2e98b47a in epoch 31435937
Sep 28 22:11:39 xs-venus ovs-vswitchd: 19423|timeval|WARN|338 ms poll interval (0 ms user, 10 ms system) is over 540 times the weighted mean interval 1 ms (31436068 samples)
Sep 28 22:11:39 xs-venus ovs-vswitchd: 19424|timeval|WARN|context switches: 349 voluntary, 0 involuntary
Sep 28 22:11:39 xs-venus ovs-vswitchd: 19425|coverage|INFO|Skipping details of duplicate event coverage for hash=2e98b47a in epoch 31436068
Sep 28 22:12:09 xs-venus ovs-vswitchd: 19426|timeval|WARN|15 ms poll interval (0 ms user, 0 ms system) is over 24 times the weighted mean interval 1 ms (31436293 samples)
Sep 28 22:12:09 xs-venus ovs-vswitchd: 19427|timeval|WARN|faults: 0 minor, 1 major
Sep 28 22:12:09 xs-venus ovs-vswitchd: 19428|timeval|WARN|context switches: 2 voluntary, 0 involuntary
Sep 28 22:12:09 xs-venus ovs-vswitchd: 19429|coverage|INFO|Skipping details of duplicate event coverage for hash=b0e699e3 in epoch 31436293
Sep 28 22:12:14 xs-venus ovsdb-server: 08011|timeval|WARN|317 ms poll interval (0 ms user, 0 ms system) is over 507 times the weighted mean interval 1 ms (2509870 samples)
Sep 28 22:12:14 xs-venus ovsdb-server: 08012|timeval|WARN|context switches: 53 voluntary, 0 involuntary
Sep 28 22:12:14 xs-venus ovsdb-server: 08013|coverage|INFO|Skipping details of duplicate event coverage for hash=abb17da2 in epoch 2509870
Sep 28 22:12:24 xs-venus ovs-vswitchd: 19430|timeval|WARN|281 ms poll interval (0 ms user, 10 ms system) is over 449 times the weighted mean interval 1 ms (31436377 samples)
Sep 28 22:12:24 xs-venus ovs-vswitchd: 19431|timeval|WARN|context switches: 101 voluntary, 0 involuntary
Sep 28 22:12:24 xs-venus ovs-vswitchd: 19432|coverage|INFO|Skipping details of duplicate event coverage for hash=b0e699e3 in epoch 31436377
Sep 28 22:13:27 xs-venus ovsdb-server: 08014|timeval|WARN|2141 ms poll interval (0 ms user, 10 ms system) is over 1557 times the weighted mean interval 1 ms (2509930 samples)
Sep 28 22:13:27 xs-venus ovsdb-server: 08015|timeval|WARN|context switches: 677 voluntary, 0 involuntary
Sep 28 22:13:27 xs-venus ovsdb-server: 08016|coverage|INFO|Skipping details of duplicate event coverage for hash=253343d5 in epoch 2509930
Sep 28 22:14:15 xs-venus ovs-vswitchd: 19433|timeval|WARN|880 ms poll interval (0 ms user, 10 ms system) is over 1408 times the weighted mean interval 1 ms (31437069 samples)
Sep 28 22:14:15 xs-venus ovs-vswitchd: 19434|timeval|WARN|context switches: 485 voluntary, 0 involuntary
Sep 28 22:14:15 xs-venus ovs-vswitchd: 19435|coverage|INFO|Skipping details of duplicate event coverage for hash=2e98b47a in epoch 31437069
Sep 28 22:14:21 xs-venus ovsdb-server: 08017|timeval|WARN|349 ms poll interval (0 ms user, 10 ms system) is over 28 times the weighted mean interval 12 ms (2509976 samples)
Sep 28 22:14:21 xs-venus ovsdb-server: 08018|timeval|WARN|context switches: 72 voluntary, 0 involuntary
Sep 28 22:14:21 xs-venus ovsdb-server: 08019|coverage|INFO|Skipping details of duplicate event coverage for hash=abb17da2 in epoch 2509976
Sep 28 22:14:26 xs-venus ovs-vswitchd: 19436|timeval|WARN|435 ms poll interval (0 ms user, 0 ms system) is over 535 times the weighted mean interval 1 ms (31437160 samples)
Sep 28 22:14:26 xs-venus ovs-vswitchd: 19437|timeval|WARN|context switches: 35 voluntary, 0 involuntary
Sep 28 22:14:26 xs-venus ovs-vswitchd: 19438|coverage|INFO|Skipping details of duplicate event coverage for hash=2e98b47a in epoch 31437160
Sep 28 22:14:36 xs-venus ovs-vswitchd: 19439|timeval|WARN|16 ms poll interval (0 ms user, 0 ms system) is over 17 times the weighted mean interval 1 ms (31437233 samples)
Sep 28 22:14:36 xs-venus ovs-vswitchd: 19440|timeval|WARN|faults: 0 minor, 1 major
Sep 28 22:14:36 xs-venus ovs-vswitchd: 19441|timeval|WARN|context switches: 1 voluntary, 0 involuntary
Sep 28 22:14:36 xs-venus ovs-vswitchd: 19442|coverage|INFO|Skipping details of duplicate event coverage for hash=b0e699e3 in epoch 31437233
Sep 28 22:14:37 xs-venus ovsdb-server: 08020|timeval|WARN|646 ms poll interval (0 ms user, 10 ms system) is over 44 times the weighted mean interval 14 ms (2509991 samples)
Sep 28 22:14:37 xs-venus ovsdb-server: 08021|timeval|WARN|context switches: 560 voluntary, 0 involuntary
Sep 28 22:14:37 xs-venus ovsdb-server: 08022|coverage|INFO|Skipping details of duplicate event coverage for hash=abb17da2 in epoch 2509991
Sep 28 22:15:17 xs-venus ovsdb-server: 08023|timeval|WARN|769 ms poll interval (0 ms user, 0 ms system) is over 71 times the weighted mean interval 11 ms (2510022 samples)
Sep 28 22:15:17 xs-venus ovsdb-server: 08024|timeval|WARN|context switches: 499 voluntary, 0 involuntary
Sep 28 22:15:17 xs-venus ovsdb-server: 08025|coverage|INFO|Skipping details of duplicate event coverage for hash=253343d5 in epoch 2510022
Sep 28 22:15:56 xs-venus ovsdb-server: 08026|timeval|WARN|264 ms poll interval (0 ms user, 0 ms system) is over 25 times the weighted mean interval 10 ms (2510055 samples)
Sep 28 22:15:56 xs-venus ovsdb-server: 08027|timeval|WARN|context switches: 11 voluntary, 0 involuntary
Sep 28 22:15:56 xs-venus ovsdb-server: 08028|coverage|INFO|Skipping details of duplicate event coverage for hash=253343d5 in epoch 2510055
Sep 28 22:16:00 xs-venus fe: qemu-dm-149[5843]:  XENUTIL  Notice   113(2): BF059000 - BF06FFFF: RDPDD.dll
Sep 28 22:16:00 xs-venus fe: qemu-dm-149[5843]:  XENUTIL  Notice   113(3): BF059000 - BF06FFFF: RDPDD.dll
Sep 28 22:18:16 xs-venus ovs-vswitchd: 19443|timeval|WARN|60 ms poll interval (0 ms user, 0 ms system) is over 96 times the weighted mean interval 1 ms (31438737 samples)
Sep 28 22:18:16 xs-venus ovs-vswitchd: 19444|timeval|WARN|context switches: 3 voluntary, 0 involuntary
Sep 28 22:18:16 xs-venus ovs-vswitchd: 19445|coverage|INFO|Skipping details of duplicate event coverage for hash=b0e699e3 in epoch 31438737
Sep 28 22:18:16 xs-venus ovsdb-server: 08029|timeval|WARN|54 ms poll interval (0 ms user, 0 ms system) is over 86 times the weighted mean interval 1 ms (2510167 samples)
Sep 28 22:18:16 xs-venus ovsdb-server: 08030|timeval|WARN|context switches: 49 voluntary, 0 involuntary
Sep 28 22:18:16 xs-venus ovsdb-server: 08031|coverage|INFO|Skipping details of duplicate event coverage for hash=abb17da2 in epoch 2510167
Sep 28 22:18:57 xs-venus ovsdb-server: 08032|timeval|WARN|512 ms poll interval (0 ms user, 0 ms system) is over 390 times the weighted mean interval 1 ms (2510199 samples)
Sep 28 22:18:57 xs-venus ovsdb-server: 08033|timeval|WARN|context switches: 129 voluntary, 0 involuntary
Sep 28 22:18:57 xs-venus ovsdb-server: 08034|coverage|INFO|Skipping details of duplicate event coverage for hash=253343d5 in epoch 2510199
Sep 28 22:19:17 xs-venus ovsdb-server: 08035|timeval|WARN|886 ms poll interval (0 ms user, 10 ms system) is over 61 times the weighted mean interval 14 ms (2510212 samples)
Sep 28 22:19:17 xs-venus ovsdb-server: 08036|timeval|WARN|faults: 1 minor, 1 major
Sep 28 22:19:17 xs-venus ovsdb-server: 08037|timeval|WARN|context switches: 541 voluntary, 0 involuntary
Sep 28 22:19:17 xs-venus ovsdb-server: 08038|coverage|INFO|Skipping details of duplicate event coverage for hash=abb17da2 in epoch 2510212
Sep 28 22:19:38 xs-venus ovsdb-server: 08039|timeval|WARN|1075 ms poll interval (0 ms user, 10 ms system) is over 39 times the weighted mean interval 27 ms (2510228 samples)
Sep 28 22:19:38 xs-venus ovsdb-server: 08040|timeval|WARN|context switches: 550 voluntary, 0 involuntary
Sep 28 22:19:38 xs-venus ovsdb-server: 08041|coverage|INFO|Skipping details of duplicate event coverage for hash=abb17da2 in epoch 2510228
Sep 28 22:20:27 xs-venus ovs-vswitchd: 19446|timeval|WARN|11 ms poll interval (0 ms user, 0 ms system) is over 17 times the weighted mean interval 1 ms (31439586 samples)
Sep 28 22:20:27 xs-venus ovs-vswitchd: 19447|timeval|WARN|context switches: 1 voluntary, 0 involuntary
Sep 28 22:20:27 xs-venus ovs-vswitchd: 19448|coverage|INFO|Skipping details of duplicate event coverage for hash=2e98b47a in epoch 31439586
Sep 28 22:20:27 xs-venus ovsdb-server: 08042|timeval|WARN|554 ms poll interval (0 ms user, 10 ms system) is over 42 times the weighted mean interval 13 ms (2510267 samples)
Sep 28 22:20:27 xs-venus ovsdb-server: 08043|timeval|WARN|context switches: 129 voluntary, 0 involuntary
Sep 28 22:20:27 xs-venus ovsdb-server: 08044|coverage|INFO|Skipping details of duplicate event coverage for hash=abb17da2 in epoch 2510267
Sep 28 22:20:47 xs-venus ovsdb-server: 08045|timeval|WARN|158 ms poll interval (0 ms user, 10 ms system) is over 8 times the weighted mean interval 18 ms (2510285 samples)
Sep 28 22:20:47 xs-venus ovsdb-server: 08046|timeval|WARN|context switches: 439 voluntary, 0 involuntary
Sep 28 22:20:47 xs-venus ovsdb-server: 08047|coverage|INFO|Skipping details of duplicate event coverage for hash=abb17da2 in epoch 2510285
Sep 28 22:21:24 xs-venus ovs-vswitchd: 19449|timeval|WARN|14 ms poll interval (0 ms user, 10 ms system) is over 22 times the weighted mean interval 1 ms (31439980 samples)
Sep 28 22:21:24 xs-venus ovs-vswitchd: 19450|timeval|WARN|faults: 0 minor, 1 major
Sep 28 22:21:24 xs-venus ovs-vswitchd: 19451|timeval|WARN|context switches: 2 voluntary, 0 involuntary
Sep 28 22:21:24 xs-venus ovs-vswitchd: 19452|coverage|INFO|Skipping details of duplicate event coverage for hash=9c3d7749 in epoch 31439980
Sep 28 22:21:57 xs-venus ovs-vswitchd: 19453|timeval|WARN|11 ms poll interval (0 ms user, 10 ms system) is over 17 times the weighted mean interval 1 ms (31440139 samples)
Sep 28 22:21:57 xs-venus ovs-vswitchd: 19454|timeval|WARN|faults: 0 minor, 1 major
Sep 28 22:21:57 xs-venus ovs-vswitchd: 19455|timeval|WARN|context switches: 1 voluntary, 0 involuntary
Sep 28 22:21:57 xs-venus ovs-vswitchd: 19456|coverage|INFO|Skipping details of duplicate event coverage for hash=b0e699e3 in epoch 31440139
Sep 28 22:22:07 xs-venus ovsdb-server: 08048|timeval|WARN|61 ms poll interval (0 ms user, 0 ms system) is over 29 times the weighted mean interval 2 ms (2510348 samples)
Sep 28 22:22:07 xs-venus ovsdb-server: 08049|timeval|WARN|context switches: 15 voluntary, 0 involuntary
Sep 28 22:22:07 xs-venus ovsdb-server: 08050|coverage|INFO|Skipping details of duplicate event coverage for hash=253343d5 in epoch 2510348
Sep 28 22:22:27 xs-venus ovsdb-server: 08051|timeval|WARN|159 ms poll interval (0 ms user, 0 ms system) is over 55 times the weighted mean interval 3 ms (2510362 samples)
Sep 28 22:22:27 xs-venus ovsdb-server: 08052|timeval|WARN|context switches: 28 voluntary, 0 involuntary
Sep 28 22:22:27 xs-venus ovsdb-server: 08053|coverage|INFO|Skipping details of duplicate event coverage for hash=abb17da2 in epoch 2510362
Sep 28 22:25:20 xs-venus multipathd: xvda1: remove path (operator) 
Sep 28 22:25:20 xs-venus multipathd: xvda1: spurious uevent, path not in pathvec 
Sep 28 22:25:20 xs-venus multipathd: xvda: remove path (operator) 
Sep 28 22:25:20 xs-venus multipathd: xvda: spurious uevent, path not in pathvec 
Sep 28 22:25:21 xs-venus vbd.uevent[remove](backend/vbd/0/51712): removed /xapi/0/hotplug/vbd/51712/hotplug
Sep 28 22:25:21 xs-venus vbd.uevent[remove](backend/vbd/0/51712): removed backend/vbd/0/51712/hotplug-status
Sep 28 22:25:22 xs-venus tapdisk[28778]: gaps written/skipped: 0/0 
Sep 28 22:25:22 xs-venus tapdisk[28778]: /dev/VG_XenStorage-44a08f67-f2d7-62c8-90d7-4cb9f66ca887/VHD-72fd3b46-3260-4b62-9a91-6501c6d04678: b: 8192, a: 7966, f: 7962, n: 0 
Sep 28 22:25:22 xs-venus tapdisk[28778]: closed image /dev/VG_XenStorage-44a08f67-f2d7-62c8-90d7-4cb9f66ca887/VHD-72fd3b46-3260-4b62-9a91-6501c6d04678 (0 users, state: 0x00000002, type: 4) 
Sep 28 22:25:22 xs-venus tapdisk[28778]: tapdisk-log: closing after 0 errors 
Sep 28 22:25:22 xs-venus tapdisk[28778]: tapdisk-syslog: 11 messages, 905 bytes, xmits: 12, failed: 0, dropped: 0
Sep 28 22:25:22 xs-venus tapdisk[28778]: tapdisk-control: draining 1 connections 
Sep 28 22:25:22 xs-venus tapdisk[28778]: tapdisk-control: done Sep 28 22:07:17 xs-venus ovs-vswitchd: 19405|timeval|WARN|761 ms poll interval (0 ms user, 0 ms system) is over 1217 times the weighted mean interval 1 ms (31434327 samples)
Sep 28 22:07:17 xs-venus ovs-vswitchd: 19406|timeval|WARN|context switches: 222 voluntary, 0 involuntary
Sep 28 22:07:17 xs-venus ovs-vswitchd: 19407|coverage|INFO|Skipping details of duplicate event coverage for hash=2e98b47a in epoch 31434327
Sep 28 22:07:23 xs-venus ovs-vswitchd: 19408|timeval|WARN|325 ms poll interval (0 ms user, 10 ms system) is over 32 times the weighted mean interval 10 ms (31434355 samples)
Sep 28 22:07:23 xs-venus ovs-vswitchd: 19409|timeval|WARN|context switches: 206 voluntary, 0 involuntary
Sep 28 22:07:23 xs-venus ovs-vswitchd: 19410|coverage|INFO|Skipping details of duplicate event coverage for hash=2e98b47a in epoch 31434355
Sep 28 22:08:23 xs-venus ovs-vswitchd: 19411|timeval|WARN|12 ms poll interval (0 ms user, 0 ms system) is over 19 times the weighted mean interval 1 ms (31434833 samples)
Sep 28 22:08:23 xs-venus ovs-vswitchd: 19412|timeval|WARN|context switches: 1 voluntary, 0 involuntary
Sep 28 22:08:23 xs-venus ovs-vswitchd: 19413|coverage|INFO|Skipping details of duplicate event coverage for hash=b0e699e3 in epoch 31434833
Sep 28 22:08:58 xs-venus ovs-vswitchd: 19414|timeval|WARN|12 ms poll interval (0 ms user, 0 ms system) is over 19 times the weighted mean interval 1 ms (31435055 samples)
Sep 28 22:08:58 xs-venus ovs-vswitchd: 19415|timeval|WARN|context switches: 1 voluntary, 0 involuntary
Sep 28 22:08:58 xs-venus ovs-vswitchd: 19416|coverage|INFO|Skipping details of duplicate event coverage for hash=84e90a37 in epoch 31435055
Sep 28 22:10:33 xs-venus ovs-vswitchd: 19417|timeval|WARN|180 ms poll interval (0 ms user, 0 ms system) is over 288 times the weighted mean interval 1 ms (31435673 samples)
Sep 28 22:10:33 xs-venus ovs-vswitchd: 19418|timeval|WARN|context switches: 1 voluntary, 0 involuntary
Sep 28 22:10:33 xs-venus ovs-vswitchd: 19419|coverage|INFO|Skipping details of duplicate event coverage for hash=b0e699e3 in epoch 31435673
Sep 28 22:11:14 xs-venus ovs-vswitchd: 19420|timeval|WARN|497 ms poll interval (0 ms user, 10 ms system) is over 795 times the weighted mean interval 1 ms (31435937 samples)
Sep 28 22:11:14 xs-venus ovs-vswitchd: 19421|timeval|WARN|context switches: 291 voluntary, 0 involuntary
Sep 28 22:11:14 xs-venus ovs-vswitchd: 19422|coverage|INFO|Skipping details of duplicate event coverage for hash=2e98b47a in epoch 31435937
Sep 28 22:11:39 xs-venus ovs-vswitchd: 19423|timeval|WARN|338 ms poll interval (0 ms user, 10 ms system) is over 540 times the weighted mean interval 1 ms (31436068 samples)
Sep 28 22:11:39 xs-venus ovs-vswitchd: 19424|timeval|WARN|context switches: 349 voluntary, 0 involuntary
Sep 28 22:11:39 xs-venus ovs-vswitchd: 19425|coverage|INFO|Skipping details of duplicate event coverage for hash=2e98b47a in epoch 31436068
Sep 28 22:12:09 xs-venus ovs-vswitchd: 19426|timeval|WARN|15 ms poll interval (0 ms user, 0 ms system) is over 24 times the weighted mean interval 1 ms (31436293 samples)
Sep 28 22:12:09 xs-venus ovs-vswitchd: 19427|timeval|WARN|faults: 0 minor, 1 major
Sep 28 22:12:09 xs-venus ovs-vswitchd: 19428|timeval|WARN|context switches: 2 voluntary, 0 involuntary
Sep 28 22:12:09 xs-venus ovs-vswitchd: 19429|coverage|INFO|Skipping details of duplicate event coverage for hash=b0e699e3 in epoch 31436293
Sep 28 22:12:14 xs-venus ovsdb-server: 08011|timeval|WARN|317 ms poll interval (0 ms user, 0 ms system) is over 507 times the weighted mean interval 1 ms (2509870 samples)
Sep 28 22:12:14 xs-venus ovsdb-server: 08012|timeval|WARN|context switches: 53 voluntary, 0 involuntary
Sep 28 22:12:14 xs-venus ovsdb-server: 08013|coverage|INFO|Skipping details of duplicate event coverage for hash=abb17da2 in epoch 2509870
Sep 28 22:12:24 xs-venus ovs-vswitchd: 19430|timeval|WARN|281 ms poll interval (0 ms user, 10 ms system) is over 449 times the weighted mean interval 1 ms (31436377 samples)
Sep 28 22:12:24 xs-venus ovs-vswitchd: 19431|timeval|WARN|context switches: 101 voluntary, 0 involuntary
Sep 28 22:12:24 xs-venus ovs-vswitchd: 19432|coverage|INFO|Skipping details of duplicate event coverage for hash=b0e699e3 in epoch 31436377
Sep 28 22:13:27 xs-venus ovsdb-server: 08014|timeval|WARN|2141 ms poll interval (0 ms user, 10 ms system) is over 1557 times the weighted mean interval 1 ms (2509930 samples)
Sep 28 22:13:27 xs-venus ovsdb-server: 08015|timeval|WARN|context switches: 677 voluntary, 0 involuntary
Sep 28 22:13:27 xs-venus ovsdb-server: 08016|coverage|INFO|Skipping details of duplicate event coverage for hash=253343d5 in epoch 2509930
Sep 28 22:14:15 xs-venus ovs-vswitchd: 19433|timeval|WARN|880 ms poll interval (0 ms user, 10 ms system) is over 1408 times the weighted mean interval 1 ms (31437069 samples)
Sep 28 22:14:15 xs-venus ovs-vswitchd: 19434|timeval|WARN|context switches: 485 voluntary, 0 involuntary
Sep 28 22:14:15 xs-venus ovs-vswitchd: 19435|coverage|INFO|Skipping details of duplicate event coverage for hash=2e98b47a in epoch 31437069
Sep 28 22:14:21 xs-venus ovsdb-server: 08017|timeval|WARN|349 ms poll interval (0 ms user, 10 ms system) is over 28 times the weighted mean interval 12 ms (2509976 samples)
Sep 28 22:14:21 xs-venus ovsdb-server: 08018|timeval|WARN|context switches: 72 voluntary, 0 involuntary
Sep 28 22:14:21 xs-venus ovsdb-server: 08019|coverage|INFO|Skipping details of duplicate event coverage for hash=abb17da2 in epoch 2509976
Sep 28 22:14:26 xs-venus ovs-vswitchd: 19436|timeval|WARN|435 ms poll interval (0 ms user, 0 ms system) is over 535 times the weighted mean interval 1 ms (31437160 samples)
Sep 28 22:14:26 xs-venus ovs-vswitchd: 19437|timeval|WARN|context switches: 35 voluntary, 0 involuntary
Sep 28 22:14:26 xs-venus ovs-vswitchd: 19438|coverage|INFO|Skipping details of duplicate event coverage for hash=2e98b47a in epoch 31437160
Sep 28 22:14:36 xs-venus ovs-vswitchd: 19439|timeval|WARN|16 ms poll interval (0 ms user, 0 ms system) is over 17 times the weighted mean interval 1 ms (31437233 samples)
Sep 28 22:14:36 xs-venus ovs-vswitchd: 19440|timeval|WARN|faults: 0 minor, 1 major
Sep 28 22:14:36 xs-venus ovs-vswitchd: 19441|timeval|WARN|context switches: 1 voluntary, 0 involuntary
Sep 28 22:14:36 xs-venus ovs-vswitchd: 19442|coverage|INFO|Skipping details of duplicate event coverage for hash=b0e699e3 in epoch 31437233
Sep 28 22:14:37 xs-venus ovsdb-server: 08020|timeval|WARN|646 ms poll interval (0 ms user, 10 ms system) is over 44 times the weighted mean interval 14 ms (2509991 samples)
Sep 28 22:14:37 xs-venus ovsdb-server: 08021|timeval|WARN|context switches: 560 voluntary, 0 involuntary
Sep 28 22:14:37 xs-venus ovsdb-server: 08022|coverage|INFO|Skipping details of duplicate event coverage for hash=abb17da2 in epoch 2509991
Sep 28 22:15:17 xs-venus ovsdb-server: 08023|timeval|WARN|769 ms poll interval (0 ms user, 0 ms system) is over 71 times the weighted mean interval 11 ms (2510022 samples)
Sep 28 22:15:17 xs-venus ovsdb-server: 08024|timeval|WARN|context switches: 499 voluntary, 0 involuntary
Sep 28 22:15:17 xs-venus ovsdb-server: 08025|coverage|INFO|Skipping details of duplicate event coverage for hash=253343d5 in epoch 2510022
Sep 28 22:15:56 xs-venus ovsdb-server: 08026|timeval|WARN|264 ms poll interval (0 ms user, 0 ms system) is over 25 times the weighted mean interval 10 ms (2510055 samples)
Sep 28 22:15:56 xs-venus ovsdb-server: 08027|timeval|WARN|context switches: 11 voluntary, 0 involuntary
Sep 28 22:15:56 xs-venus ovsdb-server: 08028|coverage|INFO|Skipping details of duplicate event coverage for hash=253343d5 in epoch 2510055
Sep 28 22:16:00 xs-venus fe: qemu-dm-149[5843]:  XENUTIL  Notice   113(2): BF059000 - BF06FFFF: RDPDD.dll
Sep 28 22:16:00 xs-venus fe: qemu-dm-149[5843]:  XENUTIL  Notice   113(3): BF059000 - BF06FFFF: RDPDD.dll
Sep 28 22:18:16 xs-venus ovs-vswitchd: 19443|timeval|WARN|60 ms poll interval (0 ms user, 0 ms system) is over 96 times the weighted mean interval 1 ms (31438737 samples)
Sep 28 22:18:16 xs-venus ovs-vswitchd: 19444|timeval|WARN|context switches: 3 voluntary, 0 involuntary
Sep 28 22:18:16 xs-venus ovs-vswitchd: 19445|coverage|INFO|Skipping details of duplicate event coverage for hash=b0e699e3 in epoch 31438737
Sep 28 22:18:16 xs-venus ovsdb-server: 08029|timeval|WARN|54 ms poll interval (0 ms user, 0 ms system) is over 86 times the weighted mean interval 1 ms (2510167 samples)
Sep 28 22:18:16 xs-venus ovsdb-server: 08030|timeval|WARN|context switches: 49 voluntary, 0 involuntary
Sep 28 22:18:16 xs-venus ovsdb-server: 08031|coverage|INFO|Skipping details of duplicate event coverage for hash=abb17da2 in epoch 2510167
Sep 28 22:18:57 xs-venus ovsdb-server: 08032|timeval|WARN|512 ms poll interval (0 ms user, 0 ms system) is over 390 times the weighted mean interval 1 ms (2510199 samples)
Sep 28 22:18:57 xs-venus ovsdb-server: 08033|timeval|WARN|context switches: 129 voluntary, 0 involuntary
Sep 28 22:18:57 xs-venus ovsdb-server: 08034|coverage|INFO|Skipping details of duplicate event coverage for hash=253343d5 in epoch 2510199
Sep 28 22:19:17 xs-venus ovsdb-server: 08035|timeval|WARN|886 ms poll interval (0 ms user, 10 ms system) is over 61 times the weighted mean interval 14 ms (2510212 samples)
Sep 28 22:19:17 xs-venus ovsdb-server: 08036|timeval|WARN|faults: 1 minor, 1 major
Sep 28 22:19:17 xs-venus ovsdb-server: 08037|timeval|WARN|context switches: 541 voluntary, 0 involuntary
Sep 28 22:19:17 xs-venus ovsdb-server: 08038|coverage|INFO|Skipping details of duplicate event coverage for hash=abb17da2 in epoch 2510212
Sep 28 22:19:38 xs-venus ovsdb-server: 08039|timeval|WARN|1075 ms poll interval (0 ms user, 10 ms system) is over 39 times the weighted mean interval 27 ms (2510228 samples)
Sep 28 22:19:38 xs-venus ovsdb-server: 08040|timeval|WARN|context switches: 550 voluntary, 0 involuntary
Sep 28 22:19:38 xs-venus ovsdb-server: 08041|coverage|INFO|Skipping details of duplicate event coverage for hash=abb17da2 in epoch 2510228
Sep 28 22:20:27 xs-venus ovs-vswitchd: 19446|timeval|WARN|11 ms poll interval (0 ms user, 0 ms system) is over 17 times the weighted mean interval 1 ms (31439586 samples)
Sep 28 22:20:27 xs-venus ovs-vswitchd: 19447|timeval|WARN|context switches: 1 voluntary, 0 involuntary
Sep 28 22:20:27 xs-venus ovs-vswitchd: 19448|coverage|INFO|Skipping details of duplicate event coverage for hash=2e98b47a in epoch 31439586
Sep 28 22:20:27 xs-venus ovsdb-server: 08042|timeval|WARN|554 ms poll interval (0 ms user, 10 ms system) is over 42 times the weighted mean interval 13 ms (2510267 samples)
Sep 28 22:20:27 xs-venus ovsdb-server: 08043|timeval|WARN|context switches: 129 voluntary, 0 involuntary
Sep 28 22:20:27 xs-venus ovsdb-server: 08044|coverage|INFO|Skipping details of duplicate event coverage for hash=abb17da2 in epoch 2510267
Sep 28 22:20:47 xs-venus ovsdb-server: 08045|timeval|WARN|158 ms poll interval (0 ms user, 10 ms system) is over 8 times the weighted mean interval 18 ms (2510285 samples)
Sep 28 22:20:47 xs-venus ovsdb-server: 08046|timeval|WARN|context switches: 439 voluntary, 0 involuntary
Sep 28 22:20:47 xs-venus ovsdb-server: 08047|coverage|INFO|Skipping details of duplicate event coverage for hash=abb17da2 in epoch 2510285
Sep 28 22:21:24 xs-venus ovs-vswitchd: 19449|timeval|WARN|14 ms poll interval (0 ms user, 10 ms system) is over 22 times the weighted mean interval 1 ms (31439980 samples)
Sep 28 22:21:24 xs-venus ovs-vswitchd: 19450|timeval|WARN|faults: 0 minor, 1 major
Sep 28 22:21:24 xs-venus ovs-vswitchd: 19451|timeval|WARN|context switches: 2 voluntary, 0 involuntary
Sep 28 22:21:24 xs-venus ovs-vswitchd: 19452|coverage|INFO|Skipping details of duplicate event coverage for hash=9c3d7749 in epoch 31439980
Sep 28 22:21:57 xs-venus ovs-vswitchd: 19453|timeval|WARN|11 ms poll interval (0 ms user, 10 ms system) is over 17 times the weighted mean interval 1 ms (31440139 samples)
Sep 28 22:21:57 xs-venus ovs-vswitchd: 19454|timeval|WARN|faults: 0 minor, 1 major
Sep 28 22:21:57 xs-venus ovs-vswitchd: 19455|timeval|WARN|context switches: 1 voluntary, 0 involuntary
Sep 28 22:21:57 xs-venus ovs-vswitchd: 19456|coverage|INFO|Skipping details of duplicate event coverage for hash=b0e699e3 in epoch 31440139
Sep 28 22:22:07 xs-venus ovsdb-server: 08048|timeval|WARN|61 ms poll interval (0 ms user, 0 ms system) is over 29 times the weighted mean interval 2 ms (2510348 samples)
Sep 28 22:22:07 xs-venus ovsdb-server: 08049|timeval|WARN|context switches: 15 voluntary, 0 involuntary
Sep 28 22:22:07 xs-venus ovsdb-server: 08050|coverage|INFO|Skipping details of duplicate event coverage for hash=253343d5 in epoch 2510348
Sep 28 22:22:27 xs-venus ovsdb-server: 08051|timeval|WARN|159 ms poll interval (0 ms user, 0 ms system) is over 55 times the weighted mean interval 3 ms (2510362 samples)
Sep 28 22:22:27 xs-venus ovsdb-server: 08052|timeval|WARN|context switches: 28 voluntary, 0 involuntary
Sep 28 22:22:27 xs-venus ovsdb-server: 08053|coverage|INFO|Skipping details of duplicate event coverage for hash=abb17da2 in epoch 2510362
Sep 28 22:25:20 xs-venus multipathd: xvda1: remove path (operator) 
Sep 28 22:25:20 xs-venus multipathd: xvda1: spurious uevent, path not in pathvec 
Sep 28 22:25:20 xs-venus multipathd: xvda: remove path (operator) 
Sep 28 22:25:20 xs-venus multipathd: xvda: spurious uevent, path not in pathvec 
Sep 28 22:25:21 xs-venus vbd.uevent[remove](backend/vbd/0/51712): removed /xapi/0/hotplug/vbd/51712/hotplug
Sep 28 22:25:21 xs-venus vbd.uevent[remove](backend/vbd/0/51712): removed backend/vbd/0/51712/hotplug-status
Sep 28 22:25:22 xs-venus tapdisk[28778]: gaps written/skipped: 0/0 
Sep 28 22:25:22 xs-venus tapdisk[28778]: /dev/VG_XenStorage-44a08f67-f2d7-62c8-90d7-4cb9f66ca887/VHD-72fd3b46-3260-4b62-9a91-6501c6d04678: b: 8192, a: 7966, f: 7962, n: 0 
Sep 28 22:25:22 xs-venus tapdisk[28778]: closed image /dev/VG_XenStorage-44a08f67-f2d7-62c8-90d7-4cb9f66ca887/VHD-72fd3b46-3260-4b62-9a91-6501c6d04678 (0 users, state: 0x00000002, type: 4) 
Sep 28 22:25:22 xs-venus tapdisk[28778]: tapdisk-log: closing after 0 errors 
Sep 28 22:25:22 xs-venus tapdisk[28778]: tapdisk-syslog: 11 messages, 905 bytes, xmits: 12, failed: 0, dropped: 0
Sep 28 22:25:22 xs-venus tapdisk[28778]: tapdisk-control: draining 1 connections 
Sep 28 22:25:22 xs-venus tapdisk[28778]: tapdisk-control: done

Скрипт бэкапа перезапускает машину после экспорта.

Fri Sep 28 22:25:23 2012 Restarting VM: 4d65c889-0312-5d5d-829b-686a36c2945f

Продолжение /var/log/messages в день проблемы

Sep 29 22:04:38 xs-venus ovs-vswitchd: 19607|reconnect|ERR|unix:/var/run/openvswitch/db.sock: no response to inactivity probe after 5 seconds, disconnecting
Sep 29 22:04:38 xs-venus ovs-vswitchd: 19608|reconnect|INFO|unix:/var/run/openvswitch/db.sock: connection dropped
Sep 29 22:04:39 xs-venus ovs-vswitchd: 19609|reconnect|INFO|unix:/var/run/openvswitch/db.sock: connecting...
Sep 29 22:04:39 xs-venus ovs-vswitchd: 19610|reconnect|INFO|unix:/var/run/openvswitch/db.sock: connected
Sep 29 22:07:34 xs-venus kernel: nfs: server nas01.gov.local not responding, still trying
Sep 29 22:08:02 xs-venus kernel: INFO: task kswapd0:360 blocked for more than 120 seconds.
Sep 29 22:08:02 xs-venus kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 29 22:08:02 xs-venus kernel: kswapd0       D 000d58da     0   360      2 0x00000000
Sep 29 22:08:02 xs-venus kernel:  ed875bf4 00000246 9d296d2d 000d58da 9d296d2d 000d58da c04cb780 00000000
Sep 29 22:08:02 xs-venus kernel:  c0628dea 000d58fe eeaa8d94 eeaa8c84 eeaa8bf0 eeaa8d94 c16dc100 00000002
Sep 29 22:08:02 xs-venus kernel:  ea91e040 000d58da c04cb780 0000e154 00000000 00000005 00258aef 33d90409
Sep 29 22:08:02 xs-venus kernel: Call Trace:
Sep 29 22:08:02 xs-venus kernel:  [<c03833fb>] io_schedule+0x4b/0x80
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d98>] nfs_wait_bit_uninterruptible+0x8/0x10 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<c0383775>] __wait_on_bit+0x45/0x70
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d90>] ? nfs_wait_bit_uninterruptible+0x0/0x10 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d90>] ? nfs_wait_bit_uninterruptible+0x0/0x10 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<c03837f1>] out_of_line_wait_on_bit+0x51/0x60
Sep 29 22:08:02 xs-venus kernel:  [<c0142b60>] ? wake_bit_function+0x0/0x50
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d85>] nfs_wait_on_request+0x25/0x30 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e5c371>] nfs_sync_mapping_wait+0xa1/0x230 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e5c593>] nfs_wb_page+0x93/0x140 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e4d32c>] nfs_release_page+0x4c/0x60 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<c016277e>] try_to_release_page+0x2e/0x50
Sep 29 22:08:02 xs-venus kernel:  [<c016e815>] shrink_page_list+0x4e5/0x690
Sep 29 22:08:02 xs-venus kernel:  [<c016d623>] ? isolate_pages_global+0x103/0x1d0
Sep 29 22:08:02 xs-venus kernel:  [<c016eccf>] shrink_list+0x30f/0x7e0
Sep 29 22:08:02 xs-venus kernel:  [<c016a54f>] ? determine_dirtyable_memory+0x3f/0x60
Sep 29 22:08:02 xs-venus kernel:  [<c016a585>] ? get_dirty_limits+0x15/0x2d0
Sep 29 22:08:02 xs-venus kernel:  [<c014a3a6>] ? ktime_get_ts+0xe6/0x110
Sep 29 22:08:02 xs-venus kernel:  [<c016f534>] shrink_zone+0x274/0x360
Sep 29 22:08:02 xs-venus kernel:  [<c017008a>] kswapd+0x4aa/0x540
Sep 29 22:08:02 xs-venus kernel:  [<c016d520>] ? isolate_pages_global+0x0/0x1d0
Sep 29 22:08:02 xs-venus kernel:  [<c0142b10>] ? autoremove_wake_function+0x0/0x50
Sep 29 22:08:02 xs-venus kernel:  [<c0122079>] ? complete+0x49/0x60
Sep 29 22:08:02 xs-venus kernel:  [<c016fbe0>] ? kswapd+0x0/0x540
Sep 29 22:08:02 xs-venus kernel:  [<c0142854>] kthread+0x74/0x80
Sep 29 22:08:02 xs-venus kernel:  [<c01427e0>] ? kthread+0x0/0x80
Sep 29 22:08:02 xs-venus kernel:  [<c010483b>] kernel_thread_helper+0x7/0x10
Sep 29 22:08:02 xs-venus kernel: INFO: task ovsdb-server:5604 blocked for more than 120 seconds.
Sep 29 22:08:02 xs-venus kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 29 22:08:02 xs-venus kernel: ovsdb-server  D edc7f8a8     0  5604   5603 0x00000004
Sep 29 22:08:02 xs-venus kernel:  edc7f8fc 00200286 c16ba020 edc7f8a8 c0106bb1 696112c5 000d58d0 0997fd04
Sep 29 22:08:02 xs-venus kernel:  45e056eb 000d5900 edcb5594 edcb5484 edcb53f0 edcb5594 c16ec100 00000003
Sep 29 22:08:02 xs-venus kernel:  ea91eac0 000d58dc c04cb780 00179ae0 00000000 00000005 0024ca34 53b60faa
Sep 29 22:08:02 xs-venus kernel: Call Trace:
Sep 29 22:08:02 xs-venus kernel:  [<c0106bb1>] ? local_clock+0x41/0x80
Sep 29 22:08:02 xs-venus kernel:  [<c03833fb>] io_schedule+0x4b/0x80
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d98>] nfs_wait_bit_uninterruptible+0x8/0x10 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<c0383775>] __wait_on_bit+0x45/0x70
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d90>] ? nfs_wait_bit_uninterruptible+0x0/0x10 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d90>] ? nfs_wait_bit_uninterruptible+0x0/0x10 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<c03837f1>] out_of_line_wait_on_bit+0x51/0x60
Sep 29 22:08:02 xs-venus kernel:  [<c0142b60>] ? wake_bit_function+0x0/0x50
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d85>] nfs_wait_on_request+0x25/0x30 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e5c371>] nfs_sync_mapping_wait+0xa1/0x230 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e5c593>] nfs_wb_page+0x93/0x140 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e4d32c>] nfs_release_page+0x4c/0x60 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<c0106cc0>] ? xen_clocksource_read+0x20/0x130
Sep 29 22:08:02 xs-venus kernel:  [<c016277e>] try_to_release_page+0x2e/0x50
Sep 29 22:08:02 xs-venus kernel:  [<c016e815>] shrink_page_list+0x4e5/0x690
Sep 29 22:08:02 xs-venus kernel:  [<c0106dda>] ? sched_clock+0xa/0x10
Sep 29 22:08:02 xs-venus kernel:  [<c0122a72>] ? update_curr+0x72/0xf0
Sep 29 22:08:02 xs-venus kernel:  [<c016d623>] ? isolate_pages_global+0x103/0x1d0
Sep 29 22:08:02 xs-venus kernel:  [<c016eccf>] shrink_list+0x30f/0x7e0
Sep 29 22:08:02 xs-venus kernel:  [<c016a54f>] ? determine_dirtyable_memory+0x3f/0x60
Sep 29 22:08:02 xs-venus kernel:  [<c016a585>] ? get_dirty_limits+0x15/0x2d0
Sep 29 22:08:02 xs-venus kernel:  [<c016f534>] shrink_zone+0x274/0x360
Sep 29 22:08:02 xs-venus kernel:  [<c016fa51>] try_to_free_pages+0x1a1/0x2b0
Sep 29 22:08:02 xs-venus kernel:  [<c016d520>] ? isolate_pages_global+0x0/0x1d0
Sep 29 22:08:02 xs-venus kernel:  [<c0169028>] __alloc_pages_nodemask+0x238/0x4f0
Sep 29 22:08:02 xs-venus kernel:  [<c018f9d2>] cache_alloc_refill+0x312/0x610
Sep 29 22:08:02 xs-venus kernel:  [<c018fe23>] __kmalloc+0x153/0x180
Sep 29 22:08:02 xs-venus kernel:  [<c030014f>] __alloc_skb+0x6f/0x170
Sep 29 22:08:02 xs-venus kernel:  [<c0122102>] ? __wake_up_sync+0x12/0x20
Sep 29 22:08:02 xs-venus kernel:  [<c02fb1cd>] ? sock_alloc_send_pskb+0x15d/0x280
Sep 29 22:08:02 xs-venus kernel:  [<c02fb1cd>] sock_alloc_send_pskb+0x15d/0x280
Sep 29 22:08:02 xs-venus kernel:  [<c036c6dc>] ? unix_stream_recvmsg+0x22c/0x560
Sep 29 22:08:02 xs-venus kernel:  [<c02fb308>] sock_alloc_send_skb+0x18/0x20
Sep 29 22:08:02 xs-venus kernel:  [<c036ccd4>] unix_stream_sendmsg+0x1c4/0x350
Sep 29 22:08:02 xs-venus kernel:  [<c02f7f3a>] sock_aio_write+0x10a/0x120
Sep 29 22:08:02 xs-venus kernel:  [<c01a6b2d>] ? d_kill+0x4d/0x60
Sep 29 22:08:02 xs-venus kernel:  [<c01ad846>] ? mntput_no_expire+0x16/0xd0
Sep 29 22:08:02 xs-venus kernel:  [<c019631d>] do_sync_write+0xcd/0x110
Sep 29 22:08:02 xs-venus kernel:  [<c0229c27>] ? __copy_to_user_ll+0x57/0x60
Sep 29 22:08:02 xs-venus kernel:  [<c0142b10>] ? autoremove_wake_function+0x0/0x50
Sep 29 22:08:02 xs-venus kernel:  [<c013c84b>] ? getrusage+0xfb/0x240
Sep 29 22:08:02 xs-venus kernel:  [<c0201aaf>] ? security_file_permission+0xf/0x20
Sep 29 22:08:02 xs-venus kernel:  [<c01964d0>] ? rw_verify_area+0x60/0xc0
Sep 29 22:08:02 xs-venus kernel:  [<c0196b56>] vfs_write+0x146/0x150
Sep 29 22:08:02 xs-venus kernel:  [<c01970fd>] sys_write+0x3d/0x70
Sep 29 22:08:02 xs-venus kernel:  [<c0104501>] syscall_call+0x7/0xb
Sep 29 22:08:02 xs-venus kernel: INFO: task ovs-vswitchd:5621 blocked for more than 120 seconds.
Sep 29 22:08:02 xs-venus kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 29 22:08:02 xs-venus kernel: ovs-vswitchd  D 67058e39     0  5621   5620 0x00000004
Sep 29 22:08:02 xs-venus kernel:  ea0039ec 00200282 000d58de 67058e39 000d58de 00000003 ea003ae0 00000748
Sep 29 22:08:02 xs-venus kernel:  d698f155 000d5902 edb5f954 edb5f844 edb5f7b0 edb5f954 c16ec100 00000003
Sep 29 22:08:02 xs-venus kernel:  eb0d7e40 000d58de c04cb780 0002365f 00000000 00000005 0024dcdf 54c7fbec
Sep 29 22:08:02 xs-venus kernel: Call Trace:
Sep 29 22:08:02 xs-venus kernel:  [<c03833fb>] io_schedule+0x4b/0x80
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d98>] nfs_wait_bit_uninterruptible+0x8/0x10 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<c0383775>] __wait_on_bit+0x45/0x70
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d90>] ? nfs_wait_bit_uninterruptible+0x0/0x10 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d90>] ? nfs_wait_bit_uninterruptible+0x0/0x10 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<c03837f1>] out_of_line_wait_on_bit+0x51/0x60
Sep 29 22:08:02 xs-venus kernel:  [<c0142b60>] ? wake_bit_function+0x0/0x50
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d85>] nfs_wait_on_request+0x25/0x30 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e5c371>] nfs_sync_mapping_wait+0xa1/0x230 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e5c593>] nfs_wb_page+0x93/0x140 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e4d32c>] nfs_release_page+0x4c/0x60 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<c016277e>] try_to_release_page+0x2e/0x50
Sep 29 22:08:02 xs-venus kernel:  [<c016e815>] shrink_page_list+0x4e5/0x690
Sep 29 22:08:02 xs-venus kernel:  [<c016d59c>] ? isolate_pages_global+0x7c/0x1d0
Sep 29 22:08:02 xs-venus kernel:  [<c016eccf>] shrink_list+0x30f/0x7e0
Sep 29 22:08:02 xs-venus kernel:  [<c016a54f>] ? determine_dirtyable_memory+0x3f/0x60
Sep 29 22:08:02 xs-venus kernel:  [<c016a585>] ? get_dirty_limits+0x15/0x2d0
Sep 29 22:08:02 xs-venus kernel:  [<c016f534>] shrink_zone+0x274/0x360
Sep 29 22:08:02 xs-venus kernel:  [<c016fa51>] try_to_free_pages+0x1a1/0x2b0
Sep 29 22:08:02 xs-venus kernel:  [<c016d520>] ? isolate_pages_global+0x0/0x1d0
Sep 29 22:08:02 xs-venus kernel:  [<c0169028>] __alloc_pages_nodemask+0x238/0x4f0
Sep 29 22:08:02 xs-venus kernel:  [<c016b712>] __do_page_cache_readahead+0xd2/0x1e0
Sep 29 22:08:02 xs-venus kernel:  [<c016b848>] ra_submit+0x28/0x40
Sep 29 22:08:02 xs-venus kernel:  [<c01654f5>] filemap_fault+0x3d5/0x3e0
Sep 29 22:08:02 xs-venus kernel:  [<c01ad846>] ? mntput_no_expire+0x16/0xd0
Sep 29 22:08:02 xs-venus kernel:  [<c0178a3d>] __do_fault+0x3d/0x5d0
Sep 29 22:08:02 xs-venus kernel:  [<c01a17f1>] ? do_path_lookup+0x31/0x60
Sep 29 22:08:02 xs-venus kernel:  [<c01a2178>] ? user_path_at+0x48/0x70
Sep 29 22:08:02 xs-venus kernel:  [<c0165120>] ? filemap_fault+0x0/0x3e0
Sep 29 22:08:02 xs-venus kernel:  [<c017abc7>] handle_mm_fault+0x2f7/0x1090
Sep 29 22:08:02 xs-venus kernel:  [<c02f8c26>] ? sys_send+0x36/0x40
Sep 29 22:08:02 xs-venus kernel:  [<c02f9ae6>] ? sys_socketcall+0x146/0x270
Sep 29 22:08:02 xs-venus kernel:  [<c0115ea9>] do_page_fault+0x109/0x2d0
Sep 29 22:08:02 xs-venus kernel:  [<c0115da0>] ? do_page_fault+0x0/0x2d0
Sep 29 22:08:02 xs-venus kernel:  [<c03854c0>] error_code+0x30/0x38
Sep 29 22:08:02 xs-venus kernel:  [<c0115da0>] ? do_page_fault+0x0/0x2d0
Sep 29 22:08:02 xs-venus kernel: INFO: task irqbalance:5772 blocked for more than 120 seconds.
Sep 29 22:08:02 xs-venus kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 29 22:08:02 xs-venus kernel: irqbalance    D ea253994     0  5772      1 0x00000000
Sep 29 22:08:02 xs-venus kernel:  ea2539dc 00000282 c5cf59c0 ea253994 c031933e f0671910 c8e93880 02e5f157
Sep 29 22:08:02 xs-venus kernel:  e07ad0bb 000d58ff ed0345d4 ed0344c4 ed034430 ed0345d4 c16cc100 00000001
Sep 29 22:08:02 xs-venus kernel:  eebc5580 000d58db c04cb780 001a7f17 00000000 ea2539d4 c014a3a6 29eb53c5
Sep 29 22:08:02 xs-venus kernel: Call Trace:
Sep 29 22:08:02 xs-venus kernel:  [<c031933e>] ? sch_direct_xmit+0x8e/0x1f0
Sep 29 22:08:02 xs-venus kernel:  [<f0671910>] ? e1000_clean_rx_irq+0x290/0x310 [e1000e]
Sep 29 22:08:02 xs-venus kernel:  [<c014a3a6>] ? ktime_get_ts+0xe6/0x110
Sep 29 22:08:02 xs-venus kernel:  [<c03833fb>] io_schedule+0x4b/0x80
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d98>] nfs_wait_bit_uninterruptible+0x8/0x10 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<c0383775>] __wait_on_bit+0x45/0x70
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d90>] ? nfs_wait_bit_uninterruptible+0x0/0x10 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d90>] ? nfs_wait_bit_uninterruptible+0x0/0x10 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<c03837f1>] out_of_line_wait_on_bit+0x51/0x60
Sep 29 22:08:02 xs-venus kernel:  [<c0142b60>] ? wake_bit_function+0x0/0x50
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d85>] nfs_wait_on_request+0x25/0x30 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e5c371>] nfs_sync_mapping_wait+0xa1/0x230 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e5c593>] nfs_wb_page+0x93/0x140 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e4d32c>] nfs_release_page+0x4c/0x60 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<c016277e>] try_to_release_page+0x2e/0x50
Sep 29 22:08:02 xs-venus kernel:  [<c016e815>] shrink_page_list+0x4e5/0x690
Sep 29 22:08:02 xs-venus kernel:  [<c016d59c>] ? isolate_pages_global+0x7c/0x1d0
Sep 29 22:08:02 xs-venus kernel:  [<c016eccf>] shrink_list+0x30f/0x7e0
Sep 29 22:08:02 xs-venus kernel:  [<c016a54f>] ? determine_dirtyable_memory+0x3f/0x60
Sep 29 22:08:02 xs-venus kernel:  [<c016a585>] ? get_dirty_limits+0x15/0x2d0
Sep 29 22:08:02 xs-venus kernel:  [<c016f534>] shrink_zone+0x274/0x360
Sep 29 22:08:02 xs-venus kernel:  [<c016fa51>] try_to_free_pages+0x1a1/0x2b0
Sep 29 22:08:02 xs-venus kernel:  [<c016d520>] ? isolate_pages_global+0x0/0x1d0
Sep 29 22:08:02 xs-venus kernel:  [<c0169028>] __alloc_pages_nodemask+0x238/0x4f0
Sep 29 22:08:02 xs-venus kernel:  [<c017afee>] handle_mm_fault+0x71e/0x1090
Sep 29 22:08:02 xs-venus kernel:  [<c0115ea9>] do_page_fault+0x109/0x2d0
Sep 29 22:08:02 xs-venus kernel:  [<c0115da0>] ? do_page_fault+0x0/0x2d0
Sep 29 22:08:02 xs-venus kernel:  [<c03854c0>] error_code+0x30/0x38
Sep 29 22:08:02 xs-venus kernel:  [<c0115da0>] ? do_page_fault+0x0/0x2d0
Sep 29 22:08:02 xs-venus kernel:  [<c0229c0c>] ? __copy_to_user_ll+0x3c/0x60
Sep 29 22:08:02 xs-venus kernel:  [<c022a07e>] copy_to_user+0x3e/0x60
Sep 29 22:08:02 xs-venus kernel:  [<c01b0271>] seq_read+0x261/0x340
Sep 29 22:08:02 xs-venus kernel:  [<c01b0010>] ? seq_read+0x0/0x340
Sep 29 22:08:02 xs-venus kernel:  [<c01d7569>] proc_reg_read+0x69/0xc0
Sep 29 22:08:02 xs-venus kernel:  [<c0196bf4>] vfs_read+0x94/0x150
Sep 29 22:08:02 xs-venus kernel:  [<c01d7500>] ? proc_reg_read+0x0/0xc0
Sep 29 22:08:02 xs-venus kernel:  [<c019708d>] sys_read+0x3d/0x70
Sep 29 22:08:02 xs-venus kernel:  [<c0104501>] syscall_call+0x7/0xb
Sep 29 22:08:02 xs-venus kernel: INFO: task xenstored:6487 blocked for more than 120 seconds.
Sep 29 22:08:02 xs-venus kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 29 22:08:02 xs-venus kernel: xenstored     D 00000002     0  6487      1 0x00000000
Sep 29 22:08:02 xs-venus kernel:  ed3d5704 00000286 00000018 00000002 00000018 00000002 c5ebf3c0 ed3d56b0
Sep 29 22:08:02 xs-venus kernel:  d5aa84d5 000d58ff ed034214 ed034104 ed034070 ed034214 c16ec100 00000003
Sep 29 22:08:02 xs-venus kernel:  eab71ac0 000d58db c04cb780 00030e86 00000000 00000005 0024bc7a 5ab5d13e
Sep 29 22:08:02 xs-venus kernel: Call Trace:
Sep 29 22:08:02 xs-venus kernel:  [<c03833fb>] io_schedule+0x4b/0x80
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d98>] nfs_wait_bit_uninterruptible+0x8/0x10 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<c0383775>] __wait_on_bit+0x45/0x70
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d90>] ? nfs_wait_bit_uninterruptible+0x0/0x10 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d90>] ? nfs_wait_bit_uninterruptible+0x0/0x10 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<c03837f1>] out_of_line_wait_on_bit+0x51/0x60
Sep 29 22:08:02 xs-venus kernel:  [<c0142b60>] ? wake_bit_function+0x0/0x50
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d85>] nfs_wait_on_request+0x25/0x30 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e5c371>] nfs_sync_mapping_wait+0xa1/0x230 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e5c593>] nfs_wb_page+0x93/0x140 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e4d32c>] nfs_release_page+0x4c/0x60 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<c016277e>] try_to_release_page+0x2e/0x50
Sep 29 22:08:02 xs-venus kernel:  [<c016e815>] shrink_page_list+0x4e5/0x690
Sep 29 22:08:02 xs-venus kernel:  [<c0106dda>] ? sched_clock+0xa/0x10
Sep 29 22:08:02 xs-venus kernel:  [<c014787b>] ? sched_clock_cpu+0x11b/0x160
Sep 29 22:08:02 xs-venus kernel:  [<c016d59c>] ? isolate_pages_global+0x7c/0x1d0
Sep 29 22:08:02 xs-venus kernel:  [<c01280bb>] ? try_to_wake_up+0xab/0x260
Sep 29 22:08:02 xs-venus kernel:  [<c016eccf>] shrink_list+0x30f/0x7e0
Sep 29 22:08:02 xs-venus kernel:  [<c016a54f>] ? determine_dirtyable_memory+0x3f/0x60
Sep 29 22:08:02 xs-venus kernel:  [<c016a585>] ? get_dirty_limits+0x15/0x2d0
Sep 29 22:08:02 xs-venus kernel:  [<c016f534>] shrink_zone+0x274/0x360
Sep 29 22:08:02 xs-venus kernel:  [<c016fa51>] try_to_free_pages+0x1a1/0x2b0
Sep 29 22:08:02 xs-venus kernel:  [<c016d520>] ? isolate_pages_global+0x0/0x1d0
Sep 29 22:08:02 xs-venus kernel:  [<c0169028>] __alloc_pages_nodemask+0x238/0x4f0
Sep 29 22:08:02 xs-venus kernel:  [<c01693a7>] __get_free_pages+0x17/0x30
Sep 29 22:08:02 xs-venus kernel:  [<c01a6190>] __pollwait+0xa0/0xd0
Sep 29 22:08:02 xs-venus kernel:  [<c036c307>] unix_poll+0x17/0xa0
Sep 29 22:08:02 xs-venus kernel:  [<c02f79af>] sock_poll+0xf/0x20
Sep 29 22:08:02 xs-venus kernel:  [<c01a5aaa>] do_select+0x35a/0x630
Sep 29 22:08:02 xs-venus kernel:  [<c01a60f0>] ? __pollwait+0x0/0xd0
Sep 29 22:08:02 xs-venus kernel:  [<c01a61c0>] ? pollwake+0x0/0x70
Sep 29 22:08:02 xs-venus last message repeated 17 times
Sep 29 22:08:02 xs-venus kernel:  [<c01a5f2a>] core_sys_select+0x1aa/0x2d0
Sep 29 22:08:02 xs-venus kernel:  [<c019631d>] ? do_sync_write+0xcd/0x110
Sep 29 22:08:02 xs-venus kernel:  [<c0142b10>] ? autoremove_wake_function+0x0/0x50
Sep 29 22:08:02 xs-venus kernel:  [<c016862a>] ? free_hot_page+0xa/0x10
Sep 29 22:08:02 xs-venus kernel:  [<c0201aaf>] ? security_file_permission+0xf/0x20
Sep 29 22:08:02 xs-venus kernel:  [<c01a607c>] sys_select+0x2c/0xa0
Sep 29 22:08:02 xs-venus kernel:  [<c0104501>] syscall_call+0x7/0xb
Sep 29 22:08:02 xs-venus kernel: INFO: task xapi:1180 blocked for more than 120 seconds.
Sep 29 22:08:02 xs-venus kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 29 22:08:02 xs-venus kernel: xapi          D cab7bad4     0  1180   6564 0x00000000
Sep 29 22:08:02 xs-venus kernel:  cab7bae8 00000282 00000002 cab7bad4 c16eb224 00000000 000d58db 084a5ff8
Sep 29 22:08:02 xs-venus kernel:  00000003 c04cb780 c81f3994 c81f3884 c81f37f0 c81f3994 c16ec100 00000003
Sep 29 22:08:02 xs-venus kernel:  ed5d8580 166411c3 00000000 00000000 00000000 cab7bae0 c014a3a6 62e020fc
Sep 29 22:08:02 xs-venus kernel: Call Trace:
Sep 29 22:08:02 xs-venus kernel:  [<c014a3a6>] ? ktime_get_ts+0xe6/0x110
Sep 29 22:08:02 xs-venus kernel:  [<c03833fb>] io_schedule+0x4b/0x80
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d98>] nfs_wait_bit_uninterruptible+0x8/0x10 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<c0383775>] __wait_on_bit+0x45/0x70
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d90>] ? nfs_wait_bit_uninterruptible+0x0/0x10 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d90>] ? nfs_wait_bit_uninterruptible+0x0/0x10 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<c03837f1>] out_of_line_wait_on_bit+0x51/0x60
Sep 29 22:08:02 xs-venus kernel:  [<c0142b60>] ? wake_bit_function+0x0/0x50
Sep 29 22:08:02 xs-venus kernel:  [<f2e57d85>] nfs_wait_on_request+0x25/0x30 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e5c371>] nfs_sync_mapping_wait+0xa1/0x230 [nfs]
Sep 29 22:08:02 xs-venus kernel:  [<f2e5c593>] nfs_wb_page+0x93/0x140 [nfs]
Sep 29 22:32:32 xs-venus -- MARK --
Sep 29 22:52:32 xs-venus -- MARK --
Sep 29 23:12:33 xs-venus -- MARK --
Sep 29 23:32:33 xs-venus -- MARK --
Sep 29 23:52:33 xs-venus -- MARK --
Sep 30 00:12:33 xs-venus -- MARK --
Sep 30 00:32:33 xs-venus -- MARK --
Sep 30 00:52:33 xs-venus -- MARK --
Sep 30 01:12:33 xs-venus -- MARK --
Sep 30 01:32:33 xs-venus -- MARK --
Sep 30 01:52:33 xs-venus -- MARK --
Sep 30 02:12:33 xs-venus -- MARK --
Sep 30 02:32:33 xs-venus -- MARK --
Sep 30 02:52:33 xs-venus -- MARK --
Sep 30 03:12:33 xs-venus -- MARK --
Sep 30 03:32:33 xs-venus -- MARK --
Sep 30 03:52:34 xs-venus -- MARK --
Sep 30 04:12:34 xs-venus -- MARK --
Sep 30 04:32:34 xs-venus -- MARK --
Sep 30 04:52:34 xs-venus -- MARK --
Sep 30 05:12:34 xs-venus -- MARK --
Sep 30 05:32:34 xs-venus -- MARK --
Sep 30 05:52:34 xs-venus -- MARK --
Sep 30 06:12:34 xs-venus -- MARK --
Sep 30 06:32:34 xs-venus -- MARK --
Sep 30 06:52:34 xs-venus -- MARK --
Sep 30 07:12:34 xs-venus -- MARK --
Sep 30 07:32:34 xs-venus -- MARK --
Sep 30 07:52:34 xs-venus -- MARK --
Sep 30 08:12:34 xs-venus -- MARK --
Sep 30 08:32:34 xs-venus -- MARK --
Sep 30 08:52:35 xs-venus -- MARK --
Sep 30 09:12:35 xs-venus -- MARK --
Sep 30 09:32:35 xs-venus -- MARK --
Sep 30 09:52:35 xs-venus -- MARK --
Sep 30 10:12:35 xs-venus -- MARK --
Sep 30 10:32:35 xs-venus -- MARK --
Sep 30 10:52:35 xs-venus -- MARK --
Sep 30 11:12:35 xs-venus -- MARK --
Sep 30 11:32:35 xs-venus -- MARK --
Sep 30 11:52:35 xs-venus -- MARK --
Sep 30 12:12:35 xs-venus -- MARK --
Sep 30 12:32:35 xs-venus -- MARK --
Sep 30 12:52:35 xs-venus -- MARK --
Sep 30 13:12:35 xs-venus -- MARK --
Sep 30 13:32:36 xs-venus -- MARK --
Sep 30 13:52:36 xs-venus -- MARK --
Sep 30 14:12:36 xs-venus -- MARK --
Sep 30 14:32:36 xs-venus -- MARK --
Sep 30 14:52:36 xs-venus -- MARK --
Sep 30 15:07:45 xs-venus syslogd 1.4.1: restart.

15:07:45 — перезапуск физического сервера

Насколько я смог понять: ovs-vswitchd перезапустил соединение, NFS шара стала недоступна и кто-то стал этим фактом весьма недоволен.

Куда дальше копать пока непонятно.

Написано более трёх лет назад

Пригласить эксперта

Ответы на вопрос 2

1 комментарий

stboris @stboris Автор вопроса

[root@xs-venus ~]# ls -al /var/log/xen/
total 160
drwxr-xr-x 2 root root   4096 Dec  7  2011 .
drwxr-xr-x 9 root root  20480 Oct  2 13:21 ..
-rw-r--r-- 1 root root 132743 Sep 30 15:32 domain-builder-ng.log

Написано более трёх лет назад

Комментировать

Ваш ответ на вопрос

Войдите, чтобы написать ответ

Войти через центр авторизации

Похожие вопросы

Linux

+1 ещё

Простой
Не запускается убунту, как решить?
- 1 подписчик
- 4 часа назад
- 74 просмотра
2

ответа
Linux

+2 ещё

Простой
Диск не расширяется на пустое место, но том создается?
- 1 подписчик
- 6 часов назад
- 95 просмотров
2

ответа
Linux

+1 ещё

Средний
Как настроить прокси для code-server?
- 1 подписчик
- 9 часов назад
- 43 просмотра
1

ответ
Linux

Простой
Можно ли установить Arch Linux на Dell Latitude 7410, какие потенциальные проблемы можно ожидать?
- 1 подписчик
- вчера
- 179 просмотров
3

ответа
Серверное оборудование

+3 ещё

Сложный
Как настроить компьютер, чтобы можно было работать на нём независимо друг от друга в 3ds Max?
- 1 подписчик
- 05 нояб.
- 83 просмотра
1

ответ
Linux

+1 ещё

Простой
Зачем нужен Wayland и что нужно чтобы нарисовать пиксель на экране?
- 1 подписчик
- 05 нояб.
- 2622 просмотра
0

ответов
Linux

+2 ещё

Средний
Как запустить Electron на Linux удалённо по ssh?
- 1 подписчик
- 05 нояб.
- 156 просмотров
2

ответа
Linux

Простой
Почему не работает спящий режим на дистрибутивах Linux?
- 2 подписчика
- 04 нояб.
- 219 просмотров
1

ответ
Linux

+2 ещё

Простой
Как менять AllowIPs на WireGuard?
- 1 подписчик
- 04 нояб.
- 120 просмотров
1

ответ
Linux

+3 ещё

Простой
Почему при подключении WireGuard пропадает интернет?
- 1 подписчик
- 04 нояб.
- 503 просмотра
1

ответ
Показать ещё Загружается…

Системный администратор Astra Linux

Гринатом • Новосибирск

До 60 000 ₽

Системный инженер (Windows/Astra Linux)

Гринатом • Новосибирск

До 57 000 ₽

Ведущий инженер Linux

Интер РАО – Управление сервисами • Москва

от 180 000 ₽

Телеграм бот-меню для заказа еды

07 нояб. 2024, в 18:48

5000 руб./за проект

Веб сервис для печатной мастерской (php+laravel/yii2+mysql)

07 нояб. 2024, в 18:17

40000 руб./за проект

Фильтрация файла и его структурирование, скрипт

07 нояб. 2024, в 17:51

10000 руб./за проект

Очень похожая проблема описывается в одной теме на форуме Citrix.

Answer 1 · 2012-10-02 10:11:19

Не плохо было бы установить на сервере, где dom0, чтото вроде monit и следить за LA. это виртуалка резервируется в момент какой то dom0-системной активности. Или активности другой виртуалки. И процессу экспорта, тупо не хватает ресурсов.

Покажите ls -al /var/log/xen/, пожалуйста.

Answer 2 · 2012-10-03 10:50:32

amarao @amarao

Ошибка где-то в ядре dom0 — видно по hunged tasks.

Ответ написан более трёх лет назад

Комментировать

XenServer зависает при экспорте виртуальной машины

Войдите, чтобы написать ответ

Минуточку внимания

Войдите на сайт