Dump header from device: /dev/ada0p2 Architecture: amd64 Architecture Version: 2 Dump Length: 2013057024 Blocksize: 512 Compression: none Dumptime: 2023-05-27 03:41:03 +0100 Hostname: mowa219-gjp4-8570p-freebsd Magic: FreeBSD Kernel Dump Version String: FreeBSD 14.0-CURRENT #3 main-n263189-c2c9ac88c2bb-dirty: Sat May 27 01:04:23 BST 2023 grahamperrin@mowa219-gjp4-8570p-freebsd:/usr/obj/usr/src/amd64.amd64/sys/GENERIC Panic String: VERIFY3(dev->l2ad_hand <= dev->l2ad_evict) failed (6704865280 <= 6704857600) Dump Parity: 4196367481 Bounds: 2 Dump Status: good ---- … Unread portion of the kernel message buffer: . <118>. <118>Terminated <118>May 27 03:40:26 mowa219-gjp4-8570p-freebsd syslogd: exiting on signal 15 <6>wlan0: link state changed to DOWN <118>Enter full pathname of shell or RETURN for /bin/sh: # mount -uw / <118># zfs mount -a <118># zpool offli# zfs mount -a# zpool online august gpt/cache-august <118># zpool online august gpt/cache2-august <118># zpool online august gpt/cache3-august panic: VERIFY3(dev->l2ad_hand <= dev->l2ad_evict) failed (6704865280 <= 6704857600) cpuid = 2 time = 1685155263 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00c6bd8c90 vpanic() at vpanic+0x150/frame 0xfffffe00c6bd8ce0 spl_panic() at spl_panic+0x3a/frame 0xfffffe00c6bd8d40 l2arc_feed_thread() at l2arc_feed_thread+0x2401/frame 0xfffffe00c6bd8ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00c6bd8f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00c6bd8f30 --- trap 0x2f2a2072, rip = 0x949504154415f4d, rsp = 0x7265747061644120, rbp = 0x52505f4253550965 --- KDB: enter: panic Uptime: 22m7s Dumping 1919 out of 16260 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:59 59 __asm("movq %%gs:%P1,%0" : "=r" (td) : "n" (offsetof(struct pcpu, (kgdb) #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:59 #1 doadump (textdump=textdump@entry=1) at /usr/src/sys/kern/kern_shutdown.c:407 #2 0xffffffff80b5102c in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:528 #3 0xffffffff80b5154d in vpanic (fmt=, ap=ap@entry=0xfffffe00c6bd8d20) at /usr/src/sys/kern/kern_shutdown.c:972 #4 0xffffffff8205727a in spl_panic (file=, func=, line=, fmt=) at /usr/src/sys/contrib/openzfs/module/os/freebsd/spl/spl_misc.c:103 #5 0xffffffff820b31e1 in l2arc_write_buffers (spa=0xfffffe0110b77000, dev=0x0, target_sz=16777216) at /usr/src/sys/contrib/openzfs/module/zfs/arc.c:9445 #6 l2arc_feed_thread (unused=) at /usr/src/sys/contrib/openzfs/module/zfs/arc.c:9559 #7 0xffffffff80b077b0 in fork_exit ( callout=0xffffffff820b0de0 , arg=0x0, frame=0xfffffe00c6bd8f40) at /usr/src/sys/kern/kern_fork.c:1102 #8 #9 0x0949504154415f4d in ?? () Backtrace stopped: Cannot access memory at address 0x7265747061644120 (kgdb) ------------------------------------------------------------------------ ps -axlww UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 0 0 3 -16 0 0 18005604586963200 swapin DLs - 3:57.46 [kernel] …