danielmayer
Enthusiast
Thread Starter
- Mitglied seit
- 30.03.2005
- Beiträge
- 1.046
Moin!
Ich habe 4x8TB@HWRaid5 für Videodateien. PC (Win2012R2) und Server (Ubuntu 16.04.1) mit 10G-Direktlink verbunden.
Übertragung per 10G von PC auf Server läuft zunächst mal fröhlich mit 1GByte/s, bis nach ca. 12GB offensichtlich der Cache des Servers voll ist und die Platten nicht hinterherkommen
Danach aber immer noch schön mit ca. 450MB/s.
Bei zwei gleichzeitigen Zugriffen oder einer sehr großen Datei habe ich Kernel-Fehler im dmesg:
[793331.672894] kworker/u416:19: page allocation failure: order:0, mode:0x208012 0(GFP_ATOMIC|__GFP_COLD)
[793331.672902] CPU: 13 PID: 42671 Comm: kworker/u416:19 Tainted: P O 4.10.0-rc2 #1
[793331.672903] Hardware name: Dell Inc. PowerEdge T630/0W9WXC, BIOS 2.1.5 04/13 /2016
[793331.672909] Workqueue: kcryptd kcryptd_crypt [dm_crypt]
[793331.672910] Call Trace:
[793331.672912] <IRQ>
[793331.672918] dump_stack+0x4d/0x65
[793331.672923] warn_alloc+0x13a/0x160
[793331.672926] __alloc_pages_slowpath+0x26e/0xa50
[793331.672928] ? get_page_from_freelist+0x3fc/0xaa0
[793331.672932] __alloc_pages_nodemask+0x294/0x2e0
[793331.672935] alloc_pages_current+0x95/0x140
[793331.672941] mlx4_alloc_pages.isra.18+0x199/0x1b0 [mlx4_en]
[793331.672944] mlx4_en_prepare_rx_desc+0x172/0x380 [mlx4_en]
[793331.672948] mlx4_en_process_rx_cq+0xb04/0xdf0 [mlx4_en]
[793331.672951] mlx4_en_poll_rx_cq+0x30/0xb0 [mlx4_en]
[793331.672954] net_rx_action+0x22c/0x380
[793331.672958] __do_softirq+0xe7/0x28b
[793331.672960] irq_exit+0xb0/0xc0
[793331.672962] do_IRQ+0x4f/0xd0
[793331.672964] common_interrupt+0x86/0x86
[793331.672968] RIP: 0010:_find_next_bit.part.0+0x1f/0x70
[793331.672969] RSP: 0018:ffffaa2de4c0bae0 EFLAGS: 00000246 ORIG_RAX: ffffffffff ffff40
[793331.672970] RAX: ffffffffffffffff RBX: 000000000000046a RCX: 000000000000000 2
[793331.672970] RDX: 0000000000000000 RSI: 0000000000000100 RDI: ffffffff9ed3c5c 0
[793331.672971] RBP: ffffaa2de4c0baf0 R08: 0000000000000000 R09: 000000000000fff f
[793331.672971] R10: 0000000000000001 R11: 0000000000000002 R12: ffff929cffffb00 0
[793331.672972] R13: ffff929cffffd0a0 R14: 0000000002031202 R15: 000000000000000 0
[793331.672973] </IRQ>
[793331.672975] ? find_next_bit+0x15/0x20
[793331.672977] pgdat_reclaimable+0x4f/0x80
[793331.672979] node_reclaim+0x61/0x220
[793331.672981] get_page_from_freelist+0x47e/0xaa0
[793331.672984] ? __kernel_fpu_end+0x33/0xe0
[793331.672985] __alloc_pages_nodemask+0x12a/0x2e0
[793331.672987] alloc_pages_current+0x95/0x140
[793331.672989] mempool_alloc_pages+0xe/0x10
[793331.672990] mempool_alloc+0x66/0x160
[793331.672993] ? bio_alloc_bioset+0x17e/0x280
[793331.672995] kcryptd_crypt+0x18b/0x360 [dm_crypt]
[793331.672997] process_one_work+0x160/0x480
[793331.672999] worker_thread+0x48/0x4d0
[793331.673001] kthread+0x101/0x140
[793331.673002] ? process_one_work+0x480/0x480
[793331.673004] ? kthread_create_on_node+0x60/0x60
[793331.673005] ? kthread_create_on_node+0x60/0x60
[793331.673006] ret_from_fork+0x22/0x30
[793331.673007] Mem-Info:
[793331.673011] active_anon:2557455 inactive_anon:646331 isolated_anon:0
active_file:35981 inactive_file:3909005 isolated_file:32
unevictable:1090 dirty:99 writeback:313022 unstable:0
slab_reclaimable:161336 slab_unreclaimable:296904
mapped:38272 shmem:46487 pagetables:13230 bounce:0
free:34657 free_pcp:3705 free_cma:0
[793331.673015] Node 0 active_anon:10229820kB inactive_anon:2585324kB active_fil e:143924kB inactive_file:15636020kB unevictable:4360kB isolated(anon):0kB isolat ed(file):128kB mapped:153088kB dirty:396kB writeback:1252088kB shmem:0kB shmem_t hp: 0kB shmem_pmdmapped: 8685568kB anon_thp: 185948kB writeback_tmp:0kB unstable :0kB pages_scanned:3791 all_unreclaimable? no
[793331.673016] Node 0 DMA free:15844kB min:0kB low:12kB high:24kB active_anon:0 kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepend ing:0kB present:15988kB managed:15904kB mlocked:0kB slab_reclaimable:0kB slab_un reclaimable:60kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_p cp:0kB free_cma:0kB
[793331.673019] lowmem_reserve[]: 0 1711 31872 31872 31872
[793331.673021] Node 0 DMA32 free:120592kB min:60kB low:2044kB high:4028kB activ e_anon:657208kB inactive_anon:207812kB active_file:4kB inactive_file:536364kB un evictable:0kB writepending:30588kB present:1985256kB managed:1985256kB mlocked:0 kB slab_reclaimable:10908kB slab_unreclaimable:5448kB kernel_stack:420kB pagetab les:248kB bounce:0kB free_pcp:5448kB local_pcp:556kB free_cma:0kB
[793331.673024] lowmem_reserve[]: 0 0 30161 30161 30161
[793331.673026] Node 0 Normal free:2192kB min:960kB low:31844kB high:62728kB act ive_anon:9572652kB inactive_anon:2377756kB active_file:143788kB inactive_file:15 099332kB unevictable:4360kB writepending:1221732kB present:31457280kB managed:30 887952kB mlocked:4360kB slab_reclaimable:634436kB slab_unreclaimable:1182108kB k ernel_stack:16192kB pagetables:52672kB bounce:0kB free_pcp:9372kB local_pcp:720k B free_cma:0kB
[793331.673028] lowmem_reserve[]: 0 0 0 0 0
[793331.673030] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 1*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15844kB
[793331.673037] Node 0 DMA32: 128*4kB (UME) 85*8kB (UM) 813*16kB (UME) 219*32kB (UME) 341*64kB (UM) 155*128kB (UM) 51*256kB (ME) 18*512kB (UM) 6*1024kB (M) 12*2 048kB (UM) 1*4096kB (U) = 119960kB
[793331.673045] Node 0 Normal: 5*4kB (H) 3*8kB (H) 5*16kB (H) 0*32kB 2*64kB (H) 5*128kB (H) 2*256kB (H) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1404kB
[793331.673053] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugep ages_size=1048576kB
[793331.673053] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugep ages_size=2048kB
[793331.673054] 3993174 total pagecache pages
[793331.673055] 1519 pages in swap cache
[793331.673056] Swap cache stats: add 220931, delete 219412, find 11400/16701
[793331.673056] Free swap = 32752400kB
[793331.673056] Total swap = 33554428kB
[793331.673057] 8364631 pages RAM
[793331.673057] 0 pages HighMem/MovableOnly
[793331.673058] 142353 pages reserved
[793331.673058] 0 pages cma reserved
[793331.673058] 0 pages hwpoisoned
[792958.228461] kworker/u416:16: page allocation failure: order:0, mode:0x208012 0(GFP_ATOMIC|__GFP_COLD)
[792958.228469] CPU: 14 PID: 73485 Comm: kworker/u416:16 Tainted: P O 4.10.0-rc2 #1
[792958.228470] Hardware name: Dell Inc. PowerEdge T630/0W9WXC, BIOS 2.1.5 04/13 /2016
[792958.228476] Workqueue: kcryptd kcryptd_crypt [dm_crypt]
[792958.228477] Call Trace:
[792958.228479] <IRQ>
[792958.228484] dump_stack+0x4d/0x65
[792958.228489] warn_alloc+0x13a/0x160
[792958.228492] __alloc_pages_slowpath+0x26e/0xa50
[792958.228494] ? get_page_from_freelist+0x3fc/0xaa0
[792958.228497] __alloc_pages_nodemask+0x294/0x2e0
[792958.228500] alloc_pages_current+0x95/0x140
[792958.228505] mlx4_alloc_pages.isra.18+0x199/0x1b0 [mlx4_en]
[792958.228508] mlx4_en_prepare_rx_desc+0x172/0x380 [mlx4_en]
[792958.228512] mlx4_en_process_rx_cq+0xb04/0xdf0 [mlx4_en]
[792958.228515] mlx4_en_poll_rx_cq+0x30/0xb0 [mlx4_en]
[792958.228518] net_rx_action+0x22c/0x380
[792958.228522] __do_softirq+0xe7/0x28b
[792958.228525] irq_exit+0xb0/0xc0
[792958.228527] do_IRQ+0x4f/0xd0
[792958.228529] common_interrupt+0x86/0x86
[792958.228532] RIP: 0010:mutex_spin_on_owner+0x3c/0x50
[792958.228533] RSP: 0018:ffffaa2defbe3ce0 EFLAGS: 00000246 ORIG_RAX: ffffffffff ffff93
[792958.228535] RAX: ffff929cc85f8e43 RBX: 0000000000000000 RCX: ffff929c9fa2c74 0
[792958.228535] RDX: ffff929cc85f8e40 RSI: 0000000000000001 RDI: ffff929ad7330e2 8
[792958.228536] RBP: ffffaa2defbe3ce0 R08: 0000000000000000 R09: 000000000000000 0
[792958.228537] R10: 0000000000000018 R11: 0000000000000000 R12: ffff929c9fa2c74 0
[792958.228538] R13: ffff929c9fa2c740 R14: 0000000000000001 R15: ffff929ad7330e2 8
[792958.228539] </IRQ>
[792958.228541] mutex_optimistic_spin+0x7f/0x180
[792958.228543] __mutex_lock_slowpath+0x1d1/0x280
[792958.228545] mutex_lock+0x23/0x30
[792958.228547] kcryptd_crypt+0x1ca/0x360 [dm_crypt]
[792958.228550] process_one_work+0x160/0x480
[792958.228552] worker_thread+0x48/0x4d0
[792958.228554] kthread+0x101/0x140
[792958.228556] ? process_one_work+0x480/0x480
[792958.228557] ? kthread_create_on_node+0x60/0x60
[792958.228559] ret_from_fork+0x22/0x30
[792958.228560] Mem-Info:
[792958.228565] active_anon:2667273 inactive_anon:657879 isolated_anon:513
active_file:40293 inactive_file:3925941 isolated_file:0
unevictable:1090 dirty:86288 writeback:154224 unstable:0
slab_reclaimable:162082 slab_unreclaimable:296623
mapped:44301 shmem:72664 pagetables:13032 bounce:0
free:34566 free_pcp:328 free_cma:0
[792958.228570] Node 0 active_anon:10669092kB inactive_anon:2631516kB active_fil e:161172kB inactive_file:15703764kB unevictable:4360kB isolated(anon):2052kB iso lated(file):0kB mapped:177204kB dirty:345152kB writeback:616896kB shmem:0kB shme m_thp: 0kB shmem_pmdmapped: 8912896kB anon_thp: 290656kB writeback_tmp:0kB unsta ble:0kB pages_scanned:49442 all_unreclaimable? no
[792958.228571] Node 0 DMA free:15844kB min:0kB low:12kB high:24kB active_anon:0 kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepend ing:0kB present:15988kB managed:15904kB mlocked:0kB slab_reclaimable:0kB slab_un reclaimable:60kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_p cp:0kB free_cma:0kB
[792958.228575] lowmem_reserve[]: 0 1711 31872 31872 31872
[792958.228578] Node 0 DMA32 free:120668kB min:60kB low:2044kB high:4028kB activ e_anon:736448kB inactive_anon:255344kB active_file:72kB inactive_file:364464kB u nevictable:0kB writepending:26872kB present:1985256kB managed:1985256kB mlocked: 0kB slab_reclaimable:3532kB slab_unreclaimable:3748kB kernel_stack:116kB pagetab les:24kB bounce:0kB free_pcp:800kB local_pcp:0kB free_cma:0kB
[792958.228582] lowmem_reserve[]: 0 0 30161 30161 30161
[792958.228585] Node 0 Normal free:1752kB min:960kB low:31844kB high:62728kB act ive_anon:9932292kB inactive_anon:2376160kB active_file:161100kB inactive_file:15 339424kB unevictable:4360kB writepending:935976kB present:31457280kB managed:308 87952kB mlocked:4360kB slab_reclaimable:644796kB slab_unreclaimable:1182684kB ke rnel_stack:15744kB pagetables:52104kB bounce:0kB free_pcp:512kB local_pcp:0kB fr ee_cma:0kB
[792958.228589] lowmem_reserve[]: 0 0 0
[792958.228591] smbd: page allocation failure: order:0
[792958.228593] 0 0
[792958.228595] , mode:0x2080120(GFP_ATOMIC|__GFP_COLD)
[792958.228596] Node 0
[792958.228598] CPU: 7 PID: 35526 Comm: smbd Tainted: P O 4.10.0-rc 2 #1
[792958.228599] Hardware name: Dell Inc. PowerEdge T630/0W9WXC, BIOS 2.1.5 04/13 /2016
[792958.228600] DMA:
[792958.228601] Call Trace:
[792958.228602] 1*4kB
[792958.228603] <IRQ>
[792958.228604] (U)
[792958.228607] dump_stack+0x4d/0x65
[792958.228610] warn_alloc+0x13a/0x160
[792958.228611] 0*8kB 0*16kB
[792958.228614] __alloc_pages_slowpath+0x26e/0xa50
[792958.228616] ? get_page_from_freelist+0x3fc/0xaa0
[792958.228617] 1*32kB (U) 1*64kB
[792958.228621] __alloc_pages_nodemask+0x294/0x2e0
[792958.228621] (U)
[792958.228624] alloc_pages_current+0x95/0x140
[792958.228624] 1*128kB (U)
[792958.228629] mlx4_alloc_pages.isra.18+0x199/0x1b0 [mlx4_en]
[792958.228629] 1*256kB
[792958.228632] mlx4_en_prepare_rx_desc+0x172/0x380 [mlx4_en]
[792958.228633] (U)
[792958.228636] mlx4_en_process_rx_cq+0xb04/0xdf0 [mlx4_en]
[792958.228637] 0*512kB 1*1024kB (U)
[792958.228641] mlx4_en_poll_rx_cq+0x30/0xb0 [mlx4_en]
[792958.228643] net_rx_action+0x22c/0x380
[792958.228644] 1*2048kB (M)
[792958.228647] __do_softirq+0xe7/0x28b
[792958.228648] 3*4096kB (M)
[792958.228651] irq_exit+0xb0/0xc0
[792958.228652] = 15844kB
[792958.228654] do_IRQ+0x4f/0xd0
[792958.228654] Node 0 DMA32:
[792958.228657] common_interrupt+0x86/0x86
[792958.228660] RIP: 0010:int_sqrt+0x1b/0x40
[792958.228660] 52*4kB (M) 42*8kB
[792958.228663] RSP: 0018:ffffaa2dcc1db600 EFLAGS: 00000206 ORIG_RAX: ffffffffff ffffb1
[792958.228665] RAX: 0000000000000000 RBX: 000000000001d18a RCX: 000000000000001 1
[792958.228666] (UM) 34*16kB
[792958.228668] RDX: 0000000100000000 RSI: 0000000400000000 RDI: 000000000000000 a
[792958.228669] RBP: ffffaa2dcc1db600 R08: 0000000000000000 R09: ffffaa2dcc1db70 0
[792958.228670] (ME) 7*32kB
[792958.228672] R10: 0000000000000020 R11: 0000000000000000 R12: 000000000005743 b
[792958.228673] R13: ffff929cffffb000 R14: 0000000000000000 R15: ffffaa2dcc1db7d 8
[792958.228674] (M) 6*64kB
[792958.228675] </IRQ>
[792958.228676] (UME) 2*128kB
[792958.228679] inactive_list_is_low+0x110/0x120
[792958.228681] shrink_node_memcg+0x26d/0x790
[792958.228682] (ME) 2*256kB
[792958.228686] ? css_next_descendant_pre+0x4c/0x60
[792958.228688] ? css_next_descendant_pre+0x4c/0x60
[792958.228689] (UM) 3*512kB
[792958.228691] shrink_node+0xe1/0x320
[792958.228692] (UME)
[792958.228694] node_reclaim+0x1f9/0x220
[792958.228695] 2*1024kB
[792958.228697] get_page_from_freelist+0x47e/0xaa0
[792958.228698] (UM)
[792958.228700] __alloc_pages_nodemask+0x12a/0x2e0
[792958.228701] 56*2048kB
[792958.228703] alloc_pages_vma+0xb6/0x260
[792958.228704] (U)
[792958.228706] handle_mm_fault+0xff5/0x11b0
[792958.228707] 0*4096kB
[792958.228709] __do_page_fault+0x22f/0x4c0
[792958.228710] = 120736kB
[792958.228712] do_page_fault+0xc/0x10
[792958.228714] page_fault+0x22/0x30
[792958.228715] Node 0
[792958.228717] RIP: 0010:copy_user_enhanced_fast_string+0x5/0x10
[792958.228718] RSP: 0018:ffffaa2dcc1dbc10 EFLAGS: 00010202
[792958.228719] Normal:
[792958.228721] RAX: 0000000000020000 RBX: 0000000000020000 RCX: 000000000000cb9 0
[792958.228722] RDX: 0000000000020000 RSI: ffffaa2de99f8470 RDI: 000055774129900 0
[792958.228723] 5*4kB (H)
[792958.228725] RBP: ffffaa2dcc1dbc18 R08: 00007ffffffff000 R09: ffffffffc06e4a4 0
[792958.228726] R10: ffffe21fc1e74000 R11: ffff9294f9d02fcc R12: ffffaa2dcc1dbd8 0
[792958.228727] 3*8kB
[792958.228728] R13: 0000000000020000 R14: ffffaa2de99e5000 R15: 000000000000000 0
[792958.228729] (H) 5*16kB (H) 6*32kB
[792958.228736] ? spl_kmem_cache_free+0x120/0x1b0 [spl]
[792958.228737] (H)
[792958.228739] ? _copy_to_user+0x2e/0x40
[792958.228740] 6*64kB
[792958.228745] uiomove+0x107/0x2b0 [zcommon]
[792958.228746] (H) 5*128kB
[792958.228788] dmu_read_uio_dnode+0xa6/0xf0 [zfs]
[792958.228788] (H)
[792958.228820] dmu_read_uio_dbuf+0x3f/0x60 [zfs]
[792958.228820] 2*256kB
[792958.228862] zfs_read+0x129/0x3c0 [zfs]
[792958.228863] (H)
[792958.228904] zpl_read_common_iovec+0x80/0xd0 [zfs]
[792958.228905] 0*512kB
[792958.228944] zpl_read+0x86/0xd0 [zfs]
[792958.228945] 0*1024kB
[792958.228948] __vfs_read+0x37/0x150
[792958.228949] 0*2048kB
[792958.228951] ? security_file_permission+0x9b/0xc0
[792958.228953] vfs_read+0x93/0x130
[792958.228954] 0*4096kB = 1852kB
[792958.228957] SyS_pread64+0x95/0xb0
[792958.228958] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugep ages_size=1048576kB
[792958.228960] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugep ages_size=2048kB
[792958.228961] 4040238 total pagecache pages
[792958.228963] entry_SYSCALL_64_fastpath+0x17/0x98
[792958.228964] RIP: 0033:0x7f27ff602d23
[792958.228965] RSP: 002b:00007ffd02789508 EFLAGS: 00000246
[792958.228966] 1012 pages in swap cache
[792958.228967] Swap cache stats: add 93339, delete 92327, find 9373/13510
[792958.228968] ORIG_RAX: 0000000000000011
[792958.228969] Free swap = 33250048kB
[792958.228970] Total swap = 33554428kB
[792958.228971] RAX: ffffffffffffffda RBX: 00007f27fbf06b20 RCX: 00007f27ff602d2 3
[792958.228972] 8364631 pages RAM
[792958.228973] 0 pages HighMem/MovableOnly
[792958.228974] RDX: 0000000000100000 RSI: 0000557741285b90 RDI: 000000000000002 5
[792958.228975] 142353 pages reserved
[792958.228975] 0 pages cma reserved
[792958.228977] RBP: 0000000000100071 R08: 0000000034e00000 R09: 00007ffd027895a 0
[792958.228977] 0 pages hwpoisoned
[792958.228979] R10: 0000000034e00000 R11: 0000000000000246 R12: 00000000001204e 1
[792958.228980] R13: 0000557741285b20 R14: 0000000000100000 R15: 000000000010000 0
[792958.228981] Mem-Info:
[792958.228985] active_anon:2667273 inactive_anon:657879 isolated_anon:513
active_file:40293 inactive_file:3925847 isolated_file:0
unevictable:1090 dirty:85472 writeback:155040 unstable:0
slab_reclaimable:162082 slab_unreclaimable:296623
mapped:44301 shmem:72664 pagetables:13032 bounce:0
free:34566 free_pcp:458 free_cma:0
[792958.228991] Node 0 active_anon:10669092kB inactive_anon:2631516kB active_fil e:161172kB inactive_file:15703388kB unevictable:4360kB isolated(anon):2052kB iso lated(file):0kB mapped:177204kB dirty:341888kB writeback:620160kB shmem:0kB shme m_thp: 0kB shmem_pmdmapped: 8912896kB anon_thp: 290656kB writeback_tmp:0kB unsta ble:0kB pages_scanned:49638 all_unreclaimable? no
[792958.228992] Node 0 DMA free:15844kB min:0kB low:12kB high:24kB active_anon:0 kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepend ing:0kB present:15988kB managed:15904kB mlocked:0kB slab_reclaimable:0kB slab_un reclaimable:60kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_p cp:0kB free_cma:0kB
[792958.228996] lowmem_reserve[]: 0 1711 31872 31872 31872
[792958.228999] Node 0 DMA32 free:120668kB min:60kB low:2044kB high:4028kB activ e_anon:736448kB inactive_anon:255344kB active_file:72kB inactive_file:364464kB u nevictable:0kB writepending:26872kB present:1985256kB managed:1985256kB mlocked: 0kB slab_reclaimable:3532kB slab_unreclaimable:3748kB kernel_stack:116kB pagetab les:24kB bounce:0kB free_pcp:800kB local_pcp:0kB free_cma:0kB
[792958.229003] lowmem_reserve[]: 0 0 30161 30161 30161
[792958.229006] Node 0 Normal free:1752kB min:960kB low:31844kB high:62728kB act ive_anon:9932292kB inactive_anon:2376160kB active_file:161100kB inactive_file:15 338664kB unevictable:4360kB writepending:935976kB present:31457280kB managed:308 87952kB mlocked:4360kB slab_reclaimable:644796kB slab_unreclaimable:1182684kB ke rnel_stack:15744kB pagetables:52104kB bounce:0kB free_pcp:1160kB local_pcp:508kB free_cma:0kB
[792958.229010] lowmem_reserve[]: 0 0 0 0 0
[792958.229013] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 1*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15844kB
[792958.229023] Node 0 DMA32: 52*4kB (M) 42*8kB (UM) 34*16kB (ME) 7*32kB (M) 6*6 4kB (UME) 2*128kB (ME) 2*256kB (UM) 3*512kB (UME) 2*1024kB (UM) 56*2048kB (U) 0* 4096kB = 120736kB
[792958.229035] Node 0 Normal: 8*4kB (MH) 5*8kB (MH) 7*16kB (MH) 6*32kB (H) 7*64 kB (MH) 5*128kB (H) 2*256kB (H) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1976kB
[792958.229046] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugep ages_size=1048576kB
[792958.229047] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugep ages_size=2048kB
[792958.229048] 4040147 total pagecache pages
[792958.229049] 1012 pages in swap cache
[792958.229050] Swap cache stats: add 93339, delete 92327, find 9373/13510
[792958.229050] Free swap = 33250048kB
[792958.229051] Total swap = 33554428kB
[792958.229052] 8364631 pages RAM
[792958.229052] 0 pages HighMem/MovableOnly
[792958.229053] 142353 pages reserved
[792958.229053] 0 pages cma reserved
[792958.229054] 0 pages hwpoisoned
Es scheint ein Cache->Cache oder Cache->kworker-Problem mit der Verschlüsselung zu sein, das weder ich noch meine erweitert-kompetente Bekanntschaften lösen können. Da immer NIC+Crypt+Filesystem in den crash-messages erscheinen hatte ich mehrere 10G-NIC ausprobiert (Brocade SR, Broadcom T, Mellanox SR, Tehuti SR) - ohne Auswirkungen. Filesystem sind zwischen Video und Rest unterschiedlich, die Fehlermeldungen kommen bei beiden Dateisystemen (XFS, JFS) bei sehr großen Dateien (>30GB) bzw. zwei gleichzeitigen. Die Meldungen sehen durchaus unterschiedlich aus, beginnen aber immer mit "page allocation failure".
Es kann daher nur cryptsetup/LUKS sein. Hat da jemand Ahnung, woran man schrauben könnte?
Kernel "tainted" wegen ZFS-Modul. Kernel 4.10-rc2 (nach 4.7.x, 4.8.x...kein Unterschied), cryptsetup 1.7.4-git nach 1.7.2, auch kein Unterschied.
Welche Infos sind noch hilfreich?
edit: +zweiter Spoiler.
Die Dateiübertragung(en) werden soweit erkennbar vollständig ausgeführt, i.d.R. bemerkt man den Kernel-Fehler durch ein "Stocken" bei der Übertragung, allerdings an unterschiedlicher Stelle bzw. unterschiedlicher Zeit. Eben nicht z.B. nach 8GB o.ä.
Ich habe 4x8TB@HWRaid5 für Videodateien. PC (Win2012R2) und Server (Ubuntu 16.04.1) mit 10G-Direktlink verbunden.
Übertragung per 10G von PC auf Server läuft zunächst mal fröhlich mit 1GByte/s, bis nach ca. 12GB offensichtlich der Cache des Servers voll ist und die Platten nicht hinterherkommen
Danach aber immer noch schön mit ca. 450MB/s.Bei zwei gleichzeitigen Zugriffen oder einer sehr großen Datei habe ich Kernel-Fehler im dmesg:
[793331.672894] kworker/u416:19: page allocation failure: order:0, mode:0x208012 0(GFP_ATOMIC|__GFP_COLD)
[793331.672902] CPU: 13 PID: 42671 Comm: kworker/u416:19 Tainted: P O 4.10.0-rc2 #1
[793331.672903] Hardware name: Dell Inc. PowerEdge T630/0W9WXC, BIOS 2.1.5 04/13 /2016
[793331.672909] Workqueue: kcryptd kcryptd_crypt [dm_crypt]
[793331.672910] Call Trace:
[793331.672912] <IRQ>
[793331.672918] dump_stack+0x4d/0x65
[793331.672923] warn_alloc+0x13a/0x160
[793331.672926] __alloc_pages_slowpath+0x26e/0xa50
[793331.672928] ? get_page_from_freelist+0x3fc/0xaa0
[793331.672932] __alloc_pages_nodemask+0x294/0x2e0
[793331.672935] alloc_pages_current+0x95/0x140
[793331.672941] mlx4_alloc_pages.isra.18+0x199/0x1b0 [mlx4_en]
[793331.672944] mlx4_en_prepare_rx_desc+0x172/0x380 [mlx4_en]
[793331.672948] mlx4_en_process_rx_cq+0xb04/0xdf0 [mlx4_en]
[793331.672951] mlx4_en_poll_rx_cq+0x30/0xb0 [mlx4_en]
[793331.672954] net_rx_action+0x22c/0x380
[793331.672958] __do_softirq+0xe7/0x28b
[793331.672960] irq_exit+0xb0/0xc0
[793331.672962] do_IRQ+0x4f/0xd0
[793331.672964] common_interrupt+0x86/0x86
[793331.672968] RIP: 0010:_find_next_bit.part.0+0x1f/0x70
[793331.672969] RSP: 0018:ffffaa2de4c0bae0 EFLAGS: 00000246 ORIG_RAX: ffffffffff ffff40
[793331.672970] RAX: ffffffffffffffff RBX: 000000000000046a RCX: 000000000000000 2
[793331.672970] RDX: 0000000000000000 RSI: 0000000000000100 RDI: ffffffff9ed3c5c 0
[793331.672971] RBP: ffffaa2de4c0baf0 R08: 0000000000000000 R09: 000000000000fff f
[793331.672971] R10: 0000000000000001 R11: 0000000000000002 R12: ffff929cffffb00 0
[793331.672972] R13: ffff929cffffd0a0 R14: 0000000002031202 R15: 000000000000000 0
[793331.672973] </IRQ>
[793331.672975] ? find_next_bit+0x15/0x20
[793331.672977] pgdat_reclaimable+0x4f/0x80
[793331.672979] node_reclaim+0x61/0x220
[793331.672981] get_page_from_freelist+0x47e/0xaa0
[793331.672984] ? __kernel_fpu_end+0x33/0xe0
[793331.672985] __alloc_pages_nodemask+0x12a/0x2e0
[793331.672987] alloc_pages_current+0x95/0x140
[793331.672989] mempool_alloc_pages+0xe/0x10
[793331.672990] mempool_alloc+0x66/0x160
[793331.672993] ? bio_alloc_bioset+0x17e/0x280
[793331.672995] kcryptd_crypt+0x18b/0x360 [dm_crypt]
[793331.672997] process_one_work+0x160/0x480
[793331.672999] worker_thread+0x48/0x4d0
[793331.673001] kthread+0x101/0x140
[793331.673002] ? process_one_work+0x480/0x480
[793331.673004] ? kthread_create_on_node+0x60/0x60
[793331.673005] ? kthread_create_on_node+0x60/0x60
[793331.673006] ret_from_fork+0x22/0x30
[793331.673007] Mem-Info:
[793331.673011] active_anon:2557455 inactive_anon:646331 isolated_anon:0
active_file:35981 inactive_file:3909005 isolated_file:32
unevictable:1090 dirty:99 writeback:313022 unstable:0
slab_reclaimable:161336 slab_unreclaimable:296904
mapped:38272 shmem:46487 pagetables:13230 bounce:0
free:34657 free_pcp:3705 free_cma:0
[793331.673015] Node 0 active_anon:10229820kB inactive_anon:2585324kB active_fil e:143924kB inactive_file:15636020kB unevictable:4360kB isolated(anon):0kB isolat ed(file):128kB mapped:153088kB dirty:396kB writeback:1252088kB shmem:0kB shmem_t hp: 0kB shmem_pmdmapped: 8685568kB anon_thp: 185948kB writeback_tmp:0kB unstable :0kB pages_scanned:3791 all_unreclaimable? no
[793331.673016] Node 0 DMA free:15844kB min:0kB low:12kB high:24kB active_anon:0 kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepend ing:0kB present:15988kB managed:15904kB mlocked:0kB slab_reclaimable:0kB slab_un reclaimable:60kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_p cp:0kB free_cma:0kB
[793331.673019] lowmem_reserve[]: 0 1711 31872 31872 31872
[793331.673021] Node 0 DMA32 free:120592kB min:60kB low:2044kB high:4028kB activ e_anon:657208kB inactive_anon:207812kB active_file:4kB inactive_file:536364kB un evictable:0kB writepending:30588kB present:1985256kB managed:1985256kB mlocked:0 kB slab_reclaimable:10908kB slab_unreclaimable:5448kB kernel_stack:420kB pagetab les:248kB bounce:0kB free_pcp:5448kB local_pcp:556kB free_cma:0kB
[793331.673024] lowmem_reserve[]: 0 0 30161 30161 30161
[793331.673026] Node 0 Normal free:2192kB min:960kB low:31844kB high:62728kB act ive_anon:9572652kB inactive_anon:2377756kB active_file:143788kB inactive_file:15 099332kB unevictable:4360kB writepending:1221732kB present:31457280kB managed:30 887952kB mlocked:4360kB slab_reclaimable:634436kB slab_unreclaimable:1182108kB k ernel_stack:16192kB pagetables:52672kB bounce:0kB free_pcp:9372kB local_pcp:720k B free_cma:0kB
[793331.673028] lowmem_reserve[]: 0 0 0 0 0
[793331.673030] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 1*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15844kB
[793331.673037] Node 0 DMA32: 128*4kB (UME) 85*8kB (UM) 813*16kB (UME) 219*32kB (UME) 341*64kB (UM) 155*128kB (UM) 51*256kB (ME) 18*512kB (UM) 6*1024kB (M) 12*2 048kB (UM) 1*4096kB (U) = 119960kB
[793331.673045] Node 0 Normal: 5*4kB (H) 3*8kB (H) 5*16kB (H) 0*32kB 2*64kB (H) 5*128kB (H) 2*256kB (H) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1404kB
[793331.673053] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugep ages_size=1048576kB
[793331.673053] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugep ages_size=2048kB
[793331.673054] 3993174 total pagecache pages
[793331.673055] 1519 pages in swap cache
[793331.673056] Swap cache stats: add 220931, delete 219412, find 11400/16701
[793331.673056] Free swap = 32752400kB
[793331.673056] Total swap = 33554428kB
[793331.673057] 8364631 pages RAM
[793331.673057] 0 pages HighMem/MovableOnly
[793331.673058] 142353 pages reserved
[793331.673058] 0 pages cma reserved
[793331.673058] 0 pages hwpoisoned
[792958.228461] kworker/u416:16: page allocation failure: order:0, mode:0x208012 0(GFP_ATOMIC|__GFP_COLD)
[792958.228469] CPU: 14 PID: 73485 Comm: kworker/u416:16 Tainted: P O 4.10.0-rc2 #1
[792958.228470] Hardware name: Dell Inc. PowerEdge T630/0W9WXC, BIOS 2.1.5 04/13 /2016
[792958.228476] Workqueue: kcryptd kcryptd_crypt [dm_crypt]
[792958.228477] Call Trace:
[792958.228479] <IRQ>
[792958.228484] dump_stack+0x4d/0x65
[792958.228489] warn_alloc+0x13a/0x160
[792958.228492] __alloc_pages_slowpath+0x26e/0xa50
[792958.228494] ? get_page_from_freelist+0x3fc/0xaa0
[792958.228497] __alloc_pages_nodemask+0x294/0x2e0
[792958.228500] alloc_pages_current+0x95/0x140
[792958.228505] mlx4_alloc_pages.isra.18+0x199/0x1b0 [mlx4_en]
[792958.228508] mlx4_en_prepare_rx_desc+0x172/0x380 [mlx4_en]
[792958.228512] mlx4_en_process_rx_cq+0xb04/0xdf0 [mlx4_en]
[792958.228515] mlx4_en_poll_rx_cq+0x30/0xb0 [mlx4_en]
[792958.228518] net_rx_action+0x22c/0x380
[792958.228522] __do_softirq+0xe7/0x28b
[792958.228525] irq_exit+0xb0/0xc0
[792958.228527] do_IRQ+0x4f/0xd0
[792958.228529] common_interrupt+0x86/0x86
[792958.228532] RIP: 0010:mutex_spin_on_owner+0x3c/0x50
[792958.228533] RSP: 0018:ffffaa2defbe3ce0 EFLAGS: 00000246 ORIG_RAX: ffffffffff ffff93
[792958.228535] RAX: ffff929cc85f8e43 RBX: 0000000000000000 RCX: ffff929c9fa2c74 0
[792958.228535] RDX: ffff929cc85f8e40 RSI: 0000000000000001 RDI: ffff929ad7330e2 8
[792958.228536] RBP: ffffaa2defbe3ce0 R08: 0000000000000000 R09: 000000000000000 0
[792958.228537] R10: 0000000000000018 R11: 0000000000000000 R12: ffff929c9fa2c74 0
[792958.228538] R13: ffff929c9fa2c740 R14: 0000000000000001 R15: ffff929ad7330e2 8
[792958.228539] </IRQ>
[792958.228541] mutex_optimistic_spin+0x7f/0x180
[792958.228543] __mutex_lock_slowpath+0x1d1/0x280
[792958.228545] mutex_lock+0x23/0x30
[792958.228547] kcryptd_crypt+0x1ca/0x360 [dm_crypt]
[792958.228550] process_one_work+0x160/0x480
[792958.228552] worker_thread+0x48/0x4d0
[792958.228554] kthread+0x101/0x140
[792958.228556] ? process_one_work+0x480/0x480
[792958.228557] ? kthread_create_on_node+0x60/0x60
[792958.228559] ret_from_fork+0x22/0x30
[792958.228560] Mem-Info:
[792958.228565] active_anon:2667273 inactive_anon:657879 isolated_anon:513
active_file:40293 inactive_file:3925941 isolated_file:0
unevictable:1090 dirty:86288 writeback:154224 unstable:0
slab_reclaimable:162082 slab_unreclaimable:296623
mapped:44301 shmem:72664 pagetables:13032 bounce:0
free:34566 free_pcp:328 free_cma:0
[792958.228570] Node 0 active_anon:10669092kB inactive_anon:2631516kB active_fil e:161172kB inactive_file:15703764kB unevictable:4360kB isolated(anon):2052kB iso lated(file):0kB mapped:177204kB dirty:345152kB writeback:616896kB shmem:0kB shme m_thp: 0kB shmem_pmdmapped: 8912896kB anon_thp: 290656kB writeback_tmp:0kB unsta ble:0kB pages_scanned:49442 all_unreclaimable? no
[792958.228571] Node 0 DMA free:15844kB min:0kB low:12kB high:24kB active_anon:0 kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepend ing:0kB present:15988kB managed:15904kB mlocked:0kB slab_reclaimable:0kB slab_un reclaimable:60kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_p cp:0kB free_cma:0kB
[792958.228575] lowmem_reserve[]: 0 1711 31872 31872 31872
[792958.228578] Node 0 DMA32 free:120668kB min:60kB low:2044kB high:4028kB activ e_anon:736448kB inactive_anon:255344kB active_file:72kB inactive_file:364464kB u nevictable:0kB writepending:26872kB present:1985256kB managed:1985256kB mlocked: 0kB slab_reclaimable:3532kB slab_unreclaimable:3748kB kernel_stack:116kB pagetab les:24kB bounce:0kB free_pcp:800kB local_pcp:0kB free_cma:0kB
[792958.228582] lowmem_reserve[]: 0 0 30161 30161 30161
[792958.228585] Node 0 Normal free:1752kB min:960kB low:31844kB high:62728kB act ive_anon:9932292kB inactive_anon:2376160kB active_file:161100kB inactive_file:15 339424kB unevictable:4360kB writepending:935976kB present:31457280kB managed:308 87952kB mlocked:4360kB slab_reclaimable:644796kB slab_unreclaimable:1182684kB ke rnel_stack:15744kB pagetables:52104kB bounce:0kB free_pcp:512kB local_pcp:0kB fr ee_cma:0kB
[792958.228589] lowmem_reserve[]: 0 0 0
[792958.228591] smbd: page allocation failure: order:0
[792958.228593] 0 0
[792958.228595] , mode:0x2080120(GFP_ATOMIC|__GFP_COLD)
[792958.228596] Node 0
[792958.228598] CPU: 7 PID: 35526 Comm: smbd Tainted: P O 4.10.0-rc 2 #1
[792958.228599] Hardware name: Dell Inc. PowerEdge T630/0W9WXC, BIOS 2.1.5 04/13 /2016
[792958.228600] DMA:
[792958.228601] Call Trace:
[792958.228602] 1*4kB
[792958.228603] <IRQ>
[792958.228604] (U)
[792958.228607] dump_stack+0x4d/0x65
[792958.228610] warn_alloc+0x13a/0x160
[792958.228611] 0*8kB 0*16kB
[792958.228614] __alloc_pages_slowpath+0x26e/0xa50
[792958.228616] ? get_page_from_freelist+0x3fc/0xaa0
[792958.228617] 1*32kB (U) 1*64kB
[792958.228621] __alloc_pages_nodemask+0x294/0x2e0
[792958.228621] (U)
[792958.228624] alloc_pages_current+0x95/0x140
[792958.228624] 1*128kB (U)
[792958.228629] mlx4_alloc_pages.isra.18+0x199/0x1b0 [mlx4_en]
[792958.228629] 1*256kB
[792958.228632] mlx4_en_prepare_rx_desc+0x172/0x380 [mlx4_en]
[792958.228633] (U)
[792958.228636] mlx4_en_process_rx_cq+0xb04/0xdf0 [mlx4_en]
[792958.228637] 0*512kB 1*1024kB (U)
[792958.228641] mlx4_en_poll_rx_cq+0x30/0xb0 [mlx4_en]
[792958.228643] net_rx_action+0x22c/0x380
[792958.228644] 1*2048kB (M)
[792958.228647] __do_softirq+0xe7/0x28b
[792958.228648] 3*4096kB (M)
[792958.228651] irq_exit+0xb0/0xc0
[792958.228652] = 15844kB
[792958.228654] do_IRQ+0x4f/0xd0
[792958.228654] Node 0 DMA32:
[792958.228657] common_interrupt+0x86/0x86
[792958.228660] RIP: 0010:int_sqrt+0x1b/0x40
[792958.228660] 52*4kB (M) 42*8kB
[792958.228663] RSP: 0018:ffffaa2dcc1db600 EFLAGS: 00000206 ORIG_RAX: ffffffffff ffffb1
[792958.228665] RAX: 0000000000000000 RBX: 000000000001d18a RCX: 000000000000001 1
[792958.228666] (UM) 34*16kB
[792958.228668] RDX: 0000000100000000 RSI: 0000000400000000 RDI: 000000000000000 a
[792958.228669] RBP: ffffaa2dcc1db600 R08: 0000000000000000 R09: ffffaa2dcc1db70 0
[792958.228670] (ME) 7*32kB
[792958.228672] R10: 0000000000000020 R11: 0000000000000000 R12: 000000000005743 b
[792958.228673] R13: ffff929cffffb000 R14: 0000000000000000 R15: ffffaa2dcc1db7d 8
[792958.228674] (M) 6*64kB
[792958.228675] </IRQ>
[792958.228676] (UME) 2*128kB
[792958.228679] inactive_list_is_low+0x110/0x120
[792958.228681] shrink_node_memcg+0x26d/0x790
[792958.228682] (ME) 2*256kB
[792958.228686] ? css_next_descendant_pre+0x4c/0x60
[792958.228688] ? css_next_descendant_pre+0x4c/0x60
[792958.228689] (UM) 3*512kB
[792958.228691] shrink_node+0xe1/0x320
[792958.228692] (UME)
[792958.228694] node_reclaim+0x1f9/0x220
[792958.228695] 2*1024kB
[792958.228697] get_page_from_freelist+0x47e/0xaa0
[792958.228698] (UM)
[792958.228700] __alloc_pages_nodemask+0x12a/0x2e0
[792958.228701] 56*2048kB
[792958.228703] alloc_pages_vma+0xb6/0x260
[792958.228704] (U)
[792958.228706] handle_mm_fault+0xff5/0x11b0
[792958.228707] 0*4096kB
[792958.228709] __do_page_fault+0x22f/0x4c0
[792958.228710] = 120736kB
[792958.228712] do_page_fault+0xc/0x10
[792958.228714] page_fault+0x22/0x30
[792958.228715] Node 0
[792958.228717] RIP: 0010:copy_user_enhanced_fast_string+0x5/0x10
[792958.228718] RSP: 0018:ffffaa2dcc1dbc10 EFLAGS: 00010202
[792958.228719] Normal:
[792958.228721] RAX: 0000000000020000 RBX: 0000000000020000 RCX: 000000000000cb9 0
[792958.228722] RDX: 0000000000020000 RSI: ffffaa2de99f8470 RDI: 000055774129900 0
[792958.228723] 5*4kB (H)
[792958.228725] RBP: ffffaa2dcc1dbc18 R08: 00007ffffffff000 R09: ffffffffc06e4a4 0
[792958.228726] R10: ffffe21fc1e74000 R11: ffff9294f9d02fcc R12: ffffaa2dcc1dbd8 0
[792958.228727] 3*8kB
[792958.228728] R13: 0000000000020000 R14: ffffaa2de99e5000 R15: 000000000000000 0
[792958.228729] (H) 5*16kB (H) 6*32kB
[792958.228736] ? spl_kmem_cache_free+0x120/0x1b0 [spl]
[792958.228737] (H)
[792958.228739] ? _copy_to_user+0x2e/0x40
[792958.228740] 6*64kB
[792958.228745] uiomove+0x107/0x2b0 [zcommon]
[792958.228746] (H) 5*128kB
[792958.228788] dmu_read_uio_dnode+0xa6/0xf0 [zfs]
[792958.228788] (H)
[792958.228820] dmu_read_uio_dbuf+0x3f/0x60 [zfs]
[792958.228820] 2*256kB
[792958.228862] zfs_read+0x129/0x3c0 [zfs]
[792958.228863] (H)
[792958.228904] zpl_read_common_iovec+0x80/0xd0 [zfs]
[792958.228905] 0*512kB
[792958.228944] zpl_read+0x86/0xd0 [zfs]
[792958.228945] 0*1024kB
[792958.228948] __vfs_read+0x37/0x150
[792958.228949] 0*2048kB
[792958.228951] ? security_file_permission+0x9b/0xc0
[792958.228953] vfs_read+0x93/0x130
[792958.228954] 0*4096kB = 1852kB
[792958.228957] SyS_pread64+0x95/0xb0
[792958.228958] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugep ages_size=1048576kB
[792958.228960] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugep ages_size=2048kB
[792958.228961] 4040238 total pagecache pages
[792958.228963] entry_SYSCALL_64_fastpath+0x17/0x98
[792958.228964] RIP: 0033:0x7f27ff602d23
[792958.228965] RSP: 002b:00007ffd02789508 EFLAGS: 00000246
[792958.228966] 1012 pages in swap cache
[792958.228967] Swap cache stats: add 93339, delete 92327, find 9373/13510
[792958.228968] ORIG_RAX: 0000000000000011
[792958.228969] Free swap = 33250048kB
[792958.228970] Total swap = 33554428kB
[792958.228971] RAX: ffffffffffffffda RBX: 00007f27fbf06b20 RCX: 00007f27ff602d2 3
[792958.228972] 8364631 pages RAM
[792958.228973] 0 pages HighMem/MovableOnly
[792958.228974] RDX: 0000000000100000 RSI: 0000557741285b90 RDI: 000000000000002 5
[792958.228975] 142353 pages reserved
[792958.228975] 0 pages cma reserved
[792958.228977] RBP: 0000000000100071 R08: 0000000034e00000 R09: 00007ffd027895a 0
[792958.228977] 0 pages hwpoisoned
[792958.228979] R10: 0000000034e00000 R11: 0000000000000246 R12: 00000000001204e 1
[792958.228980] R13: 0000557741285b20 R14: 0000000000100000 R15: 000000000010000 0
[792958.228981] Mem-Info:
[792958.228985] active_anon:2667273 inactive_anon:657879 isolated_anon:513
active_file:40293 inactive_file:3925847 isolated_file:0
unevictable:1090 dirty:85472 writeback:155040 unstable:0
slab_reclaimable:162082 slab_unreclaimable:296623
mapped:44301 shmem:72664 pagetables:13032 bounce:0
free:34566 free_pcp:458 free_cma:0
[792958.228991] Node 0 active_anon:10669092kB inactive_anon:2631516kB active_fil e:161172kB inactive_file:15703388kB unevictable:4360kB isolated(anon):2052kB iso lated(file):0kB mapped:177204kB dirty:341888kB writeback:620160kB shmem:0kB shme m_thp: 0kB shmem_pmdmapped: 8912896kB anon_thp: 290656kB writeback_tmp:0kB unsta ble:0kB pages_scanned:49638 all_unreclaimable? no
[792958.228992] Node 0 DMA free:15844kB min:0kB low:12kB high:24kB active_anon:0 kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepend ing:0kB present:15988kB managed:15904kB mlocked:0kB slab_reclaimable:0kB slab_un reclaimable:60kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_p cp:0kB free_cma:0kB
[792958.228996] lowmem_reserve[]: 0 1711 31872 31872 31872
[792958.228999] Node 0 DMA32 free:120668kB min:60kB low:2044kB high:4028kB activ e_anon:736448kB inactive_anon:255344kB active_file:72kB inactive_file:364464kB u nevictable:0kB writepending:26872kB present:1985256kB managed:1985256kB mlocked: 0kB slab_reclaimable:3532kB slab_unreclaimable:3748kB kernel_stack:116kB pagetab les:24kB bounce:0kB free_pcp:800kB local_pcp:0kB free_cma:0kB
[792958.229003] lowmem_reserve[]: 0 0 30161 30161 30161
[792958.229006] Node 0 Normal free:1752kB min:960kB low:31844kB high:62728kB act ive_anon:9932292kB inactive_anon:2376160kB active_file:161100kB inactive_file:15 338664kB unevictable:4360kB writepending:935976kB present:31457280kB managed:308 87952kB mlocked:4360kB slab_reclaimable:644796kB slab_unreclaimable:1182684kB ke rnel_stack:15744kB pagetables:52104kB bounce:0kB free_pcp:1160kB local_pcp:508kB free_cma:0kB
[792958.229010] lowmem_reserve[]: 0 0 0 0 0
[792958.229013] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 1*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15844kB
[792958.229023] Node 0 DMA32: 52*4kB (M) 42*8kB (UM) 34*16kB (ME) 7*32kB (M) 6*6 4kB (UME) 2*128kB (ME) 2*256kB (UM) 3*512kB (UME) 2*1024kB (UM) 56*2048kB (U) 0* 4096kB = 120736kB
[792958.229035] Node 0 Normal: 8*4kB (MH) 5*8kB (MH) 7*16kB (MH) 6*32kB (H) 7*64 kB (MH) 5*128kB (H) 2*256kB (H) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1976kB
[792958.229046] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugep ages_size=1048576kB
[792958.229047] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugep ages_size=2048kB
[792958.229048] 4040147 total pagecache pages
[792958.229049] 1012 pages in swap cache
[792958.229050] Swap cache stats: add 93339, delete 92327, find 9373/13510
[792958.229050] Free swap = 33250048kB
[792958.229051] Total swap = 33554428kB
[792958.229052] 8364631 pages RAM
[792958.229052] 0 pages HighMem/MovableOnly
[792958.229053] 142353 pages reserved
[792958.229053] 0 pages cma reserved
[792958.229054] 0 pages hwpoisoned
Es scheint ein Cache->Cache oder Cache->kworker-Problem mit der Verschlüsselung zu sein, das weder ich noch meine erweitert-kompetente Bekanntschaften lösen können. Da immer NIC+Crypt+Filesystem in den crash-messages erscheinen hatte ich mehrere 10G-NIC ausprobiert (Brocade SR, Broadcom T, Mellanox SR, Tehuti SR) - ohne Auswirkungen. Filesystem sind zwischen Video und Rest unterschiedlich, die Fehlermeldungen kommen bei beiden Dateisystemen (XFS, JFS) bei sehr großen Dateien (>30GB) bzw. zwei gleichzeitigen. Die Meldungen sehen durchaus unterschiedlich aus, beginnen aber immer mit "page allocation failure".
Es kann daher nur cryptsetup/LUKS sein. Hat da jemand Ahnung, woran man schrauben könnte?
Kernel "tainted" wegen ZFS-Modul. Kernel 4.10-rc2 (nach 4.7.x, 4.8.x...kein Unterschied), cryptsetup 1.7.4-git nach 1.7.2, auch kein Unterschied.
Welche Infos sind noch hilfreich?
edit: +zweiter Spoiler.
Die Dateiübertragung(en) werden soweit erkennbar vollständig ausgeführt, i.d.R. bemerkt man den Kernel-Fehler durch ein "Stocken" bei der Übertragung, allerdings an unterschiedlicher Stelle bzw. unterschiedlicher Zeit. Eben nicht z.B. nach 8GB o.ä.
Zuletzt bearbeitet:
