EPICS Home

Experimental Physics and Industrial Control System


 
2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  <2017>  2018  2019  2020  2021  2022  2023  2024  Index 2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  <2017>  2018  2019  2020  2021  2022  2023  2024 
<== Date ==> <== Thread ==>
Subject: scanIoTest hangup on 3.15 (Cygwin)
From: Andrew Johnson <[email protected]>
To: EPICS core-talk <[email protected]>
Date: Fri, 12 May 2017 10:12:56 -0500 
I got a back-trace from this test hangup, which has happened many times
before and IIRC not just on Cygwin.

Here's the 'make tapfiles' output. It shows "Terminated" because I
killed the process after taking the back-trace (it was hung all night):

> perl -CSD scanIoTest.t -tap > scanIoTest.tap
> Starting iocInit
> iocRun: All initialization complete
> Starting iocInit
> iocRun: All initialization complete
> /bin/sh: line 1:  2996 Terminated              perl -CSD scanIoTest.t -tap > scanIoTest.tap

The generated .tap file contains:

> 1..10
> ############################################################################
> ## EPICS R3.15.5-DEV
> ## EPICS Base built May 11 2017
> ############################################################################
> # Testing single callback thread
> #     using 11 ioscan sources, 5 records for each, and 101 loops
> ok  1 - No out-of-order processing
> ok  2 - All per-record process counters match number of loops
> dbmfFinish: not all free
> Warning: Registration already done.
> ############################################################################
> ## EPICS R3.15.5-DEV
> ## EPICS Base built May 11 2017
> ############################################################################
> # Testing multiple parallel callback threads
> #     using 11 ioscan sources, 5 records for each, 53 loops, and 7 parallel threads
> ok  3 - No thread took more than one request per loop
> not ok  4 - Correct number of requests were being processed in parallel in each loop
> # Process counter for record g0m0 (28) does not match loop count (53)
> # Process counter for record g0m1 (28) does not match loop count (53)
> # Process counter for record g0m2 (28) does not match loop count (53)
> # Process counter for record g0m3 (28) does not match loop count (53)
> # Process counter for record g0m4 (28) does not match loop count (53)
> # Process counter for record g1m0 (28) does not match loop count (53)
> # Process counter for record g1m1 (28) does not match loop count (53)
> # Process counter for record g1m2 (28) does not match loop count (53)
> # Process counter for record g1m3 (28) does not match loop count (53)
> # Process counter for record g1m4 (28) does not match loop count (53)
> # Process counter for record g2m0 (22) does not match loop count (53)
> # Process counter for record g2m1 (21) does not match loop count (53)
> # Process counter for record g2m2 (21) does not match loop count (53)
> # Process counter for record g2m3 (21) does not match loop count (53)
> # Process counter for record g2m4 (21) does not match loop count (53)
> # Process counter for record g3m0 (27) does not match loop count (53)
> # Process counter for record g3m1 (27) does not match loop count (53)
> # Process counter for record g3m2 (27) does not match loop count (53)
> # Process counter for record g3m3 (27) does not match loop count (53)
> # Process counter for record g3m4 (27) does not match loop count (53)
> # Process counter for record g4m0 (27) does not match loop count (53)
> # Process counter for record g4m1 (27) does not match loop count (53)
> # Process counter for record g4m2 (27) does not match loop count (53)
> # Process counter for record g4m3 (27) does not match loop count (53)
> # Process counter for record g4m4 (27) does not match loop count (53)
> # Process counter for record g5m0 (27) does not match loop count (53)
> # Process counter for record g5m1 (27) does not match loop count (53)
> # Process counter for record g5m2 (27) does not match loop count (53)
> # Process counter for record g5m3 (27) does not match loop count (53)
> # Process counter for record g5m4 (27) does not match loop count (53)
> # Process counter for record g6m0 (27) does not match loop count (53)
> # Process counter for record g6m1 (27) does not match loop count (53)
> # Process counter for record g6m2 (27) does not match loop count (53)
> # Process counter for record g6m3 (27) does not match loop count (53)
> # Process counter for record g6m4 (27) does not match loop count (53)
> # Process counter for record g7m0 (27) does not match loop count (53)
> # Process counter for record g7m1 (27) does not match loop count (53)
> # Process counter for record g7m2 (27) does not match loop count (53)
> # Process counter for record g7m3 (27) does not match loop count (53)
> # Process counter for record g7m4 (27) does not match loop count (53)
> # Process counter for record g8m0 (27) does not match loop count (53)
> # Process counter for record g8m1 (27) does not match loop count (53)
> # Process counter for record g8m2 (27) does not match loop count (53)
> # Process counter for record g8m3 (27) does not match loop count (53)
> # Process counter for record g8m4 (27) does not match loop count (53)
> # Process counter for record g9m0 (27) does not match loop count (53)
> # Process counter for record g9m1 (27) does not match loop count (53)
> # Process counter for record g9m2 (27) does not match loop count (53)
> # Process counter for record g9m3 (27) does not match loop count (53)
> # Process counter for record g9m4 (27) does not match loop count (53)
> # Process counter for record g10m0 (27) does not match loop count (53)
> # Process counter for record g10m1 (27) does not match loop count (53)
> # Process counter for record g10m2 (27) does not match loop count (53)
> # Process counter for record g10m3 (27) does not match loop count (53)
> # Process counter for record g10m4 (27) does not match loop count (53)
> not ok  5 - All per-record process counters match number of loops


Here's the back-trace:

> (gdb) bt
> #0  0x00000000771eafb1 in ntdll!DbgBreakPoint ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x0000000077292e08 in ntdll!DbgUiRemoteBreakin ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #2  0x00000000770959cd in KERNEL32!BaseThreadInitThunk ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000000771ca561 in ntdll!RtlUserThreadStart ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #4  0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> (gdb) thread apply all bt
> 
> Thread 25 (Thread 2624.0x848):
> #0  0x00000000771eafb1 in ntdll!DbgBreakPoint ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x0000000077292e08 in ntdll!DbgUiRemoteBreakin ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #2  0x00000000770959cd in KERNEL32!BaseThreadInitThunk ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000000771ca561 in ntdll!RtlUserThreadStart ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #4  0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 24 (Thread 2624.0x13a4):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x00000001801417f4 in pthread_cond_timedwait () from /usr/bin/cygwin1.dll
> #6  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #7  0x00000005cf2b69ee in epicsEventWaitWithTimeout (pevent=0x600013c60, 
>     timeout=0.050000000000000003)
>     at ../../../src/libCom/osi/os/posix/osdEvent.c:130
> #8  0x0000000549a04b72 in periodicTask (arg=0x600013aa0)
>     at ../../../src/ioc/db/dbScan.c:749
> #9  0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 23 (Thread 2624.0x1ee8):
> #0  0x000000018013e49f in pthread_mutex::lock() () from /usr/bin/cygwin1.dll
> #1  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #2  0x00000005cf2b6234 in mutexLock (id=<optimized out>)
>     at ../../../src/libCom/osi/os/posix/osdMutex.c:46
> #3  epicsMutexOsdLock (pmutex=0x600013810)
>     at ../../../src/libCom/osi/os/posix/osdMutex.c:279
> #4  0x0000000549a04770 in scanList (psl=psl@entry=0x6000137b0)
>     at ../../../src/ioc/db/dbScan.c:901
> #5  0x0000000549a04d38 in periodicTask (arg=0x6000137b0)
>     at ../../../src/ioc/db/dbScan.c:707
> #6  0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 22 (Thread 2624.0xf00):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x00000001801417f4 in pthread_cond_timedwait () from /usr/bin/cygwin1.dll
> #6  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #7  0x00000005cf2b69ee in epicsEventWaitWithTimeout (pevent=0x600013680, 
>     timeout=0.49937310000000001)
>     at ../../../src/libCom/osi/os/posix/osdEvent.c:130
> #8  0x0000000549a04b72 in periodicTask (arg=0x6000134e0)
>     at ../../../src/ioc/db/dbScan.c:749
> #9  0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 21 (Thread 2624.0x1ea8):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x00000001801417f4 in pthread_cond_timedwait () from /usr/bin/cygwin1.dll
> #6  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #7  0x00000005cf2b69ee in epicsEventWaitWithTimeout (pevent=0x600017a60, 
>     timeout=0.99937299999999996)
>     at ../../../src/libCom/osi/os/posix/osdEvent.c:130
> #8  0x0000000549a04b72 in periodicTask (arg=0x6000178a0)
>     at ../../../src/ioc/db/dbScan.c:749
> #9  0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 20 (Thread 2624.0x1e40):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x00000001801417f4 in pthread_cond_timedwait () from /usr/bin/cygwin1.dll
> #6  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #7  0x00000005cf2b69ee in epicsEventWaitWithTimeout (pevent=0x600017770, 
>     timeout=1.9993730000000001)
>     at ../../../src/libCom/osi/os/posix/osdEvent.c:130
> #8  0x0000000549a04b72 in periodicTask (arg=0x6000175b0)
>     at ../../../src/ioc/db/dbScan.c:749
> #9  0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 19 (Thread 2624.0x1aa4):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x00000001801417f4 in pthread_cond_timedwait () from /usr/bin/cygwin1.dll
> #6  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #7  0x00000005cf2b69ee in epicsEventWaitWithTimeout (pevent=0x600017480, 
>     timeout=5.0001574) at ../../../src/libCom/osi/os/posix/osdEvent.c:130
> #8  0x0000000549a04b72 in periodicTask (arg=0x6000172c0)
>     at ../../../src/ioc/db/dbScan.c:749
> #9  0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 18 (Thread 2624.0x1adc):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x00000001801417f4 in pthread_cond_timedwait () from /usr/bin/cygwin1.dll
> #6  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #7  0x00000005cf2b69ee in epicsEventWaitWithTimeout (pevent=0x600017190, 
>     timeout=9.9998374000000005)
>     at ../../../src/libCom/osi/os/posix/osdEvent.c:130
> #8  0x0000000549a04b72 in periodicTask (arg=0x600016fd0)
>     at ../../../src/ioc/db/dbScan.c:749
> #9  0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 17 (Thread 2624.0x113c):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #6  0x00000005cf2b685b in epicsEventWait (pevent=0x6000a3870)
>     at ../../../src/libCom/osi/os/posix/osdEvent.c:103
> #7  0x00000005cf2ac849 in epicsEventMustWait (id=<optimized out>)
>     at ../../../src/libCom/osi/epicsEvent.cpp:125
> #8  0x0000000549a049c6 in onceTask (arg=<optimized out>)
>     at ../../../src/ioc/db/dbScan.c:651
> #9  0x00000005cf2b3d32 in start_routine (arg=0x600013dc0)
>     at ../../../src/libCom/osi/os/posix/osdThread.c:403
> #10 0x000000018013e969 in pthread::thread_init_wrapper(void*) ()
>    from /usr/bin/cygwin1.dll
> #11 0x00000001800bdf31 in pthread_wrapper () from /usr/bin/cygwin1.dll
> #12 0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 16 (Thread 2624.0x1eb0):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #6  0x00000005cf2b627b in condWait (mutexId=<optimized out>, 
>     condId=<optimized out>) at ../../../src/libCom/osi/os/posix/osdMutex.c:267
> #7  epicsMutexOsdLock (pmutex=0x600070170)
>     at ../../../src/libCom/osi/os/posix/osdMutex.c:286
> #8  0x00000005499f2dbe in dbScanLock (precord=precord@entry=0x600071ba0)
>     at ../../../src/ioc/db/dbLock.c:265
> #9  0x0000000549a047bc in scanList (psl=psl@entry=0x60009c088)
>     at ../../../src/ioc/db/dbScan.c:910
> #10 0x0000000549a0494f in ioscanCallback (pcallback=<optimized out>)
>     at ../../../src/ioc/db/dbScan.c:861
> #11 0x0000000549a0f011 in callbackTask (arg=<optimized out>)
>     at ../../../src/ioc/db/callback.c:170
> #12 0x00000005cf2b3d32 in start_routine (arg=0x600090c60)
>     at ../../../src/libCom/osi/os/posix/osdThread.c:403
> #13 0x000000018013e969 in pthread::thread_init_wrapper(void*) ()
>    from /usr/bin/cygwin1.dll
> #14 0x00000001800bdf31 in pthread_wrapper () from /usr/bin/cygwin1.dll
> #15 0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 15 (Thread 2624.0x6b4):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #6  0x00000005cf2b627b in condWait (mutexId=<optimized out>, 
>     condId=<optimized out>) at ../../../src/libCom/osi/os/posix/osdMutex.c:267
> #7  epicsMutexOsdLock (pmutex=0x600070170)
>     at ../../../src/libCom/osi/os/posix/osdMutex.c:286
> #8  0x00000005499f2dbe in dbScanLock (precord=precord@entry=0x600071ba0)
>     at ../../../src/ioc/db/dbLock.c:265
> #9  0x0000000549a047bc in scanList (psl=psl@entry=0x60009c088)
>     at ../../../src/ioc/db/dbScan.c:910
> #10 0x0000000549a0494f in ioscanCallback (pcallback=<optimized out>)
>     at ../../../src/ioc/db/dbScan.c:861
> #11 0x0000000549a0f011 in callbackTask (arg=<optimized out>)
>     at ../../../src/ioc/db/callback.c:170
> #12 0x00000005cf2b3d32 in start_routine (arg=0x600090070)
>     at ../../../src/libCom/osi/os/posix/osdThread.c:403
> #13 0x000000018013e969 in pthread::thread_init_wrapper(void*) ()
>    from /usr/bin/cygwin1.dll
> #14 0x00000001800bdf31 in pthread_wrapper () from /usr/bin/cygwin1.dll
> #15 0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 14 (Thread 2624.0x19f8):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #6  0x00000005cf2b685b in epicsEventWait (pevent=0x600092d60)
>     at ../../../src/libCom/osi/os/posix/osdEvent.c:103
> #7  0x00000005cf2ac849 in epicsEventMustWait (id=<optimized out>)
>     at ../../../src/libCom/osi/epicsEvent.cpp:125
> #8  0x00000001004017fc in process (prec=<optimized out>) at ../scanIoTest.c:168
> #9  0x00000005499f4723 in dbProcess (precord=precord@entry=0x600071ba0)
>     at ../../../src/ioc/db/dbAccess.c:593
> #10 0x0000000549a047c4 in scanList (psl=psl@entry=0x60009c088)
>     at ../../../src/ioc/db/dbScan.c:911
> #11 0x0000000549a0494f in ioscanCallback (pcallback=<optimized out>)
>     at ../../../src/ioc/db/dbScan.c:861
> #12 0x0000000549a0f011 in callbackTask (arg=<optimized out>)
>     at ../../../src/ioc/db/callback.c:170
> #13 0x00000005cf2b3d32 in start_routine (arg=0x6000912c0)
>     at ../../../src/libCom/osi/os/posix/osdThread.c:403
> #14 0x000000018013e969 in pthread::thread_init_wrapper(void*) ()
>    from /usr/bin/cygwin1.dll
> #15 0x00000001800bdf31 in pthread_wrapper () from /usr/bin/cygwin1.dll
> #16 0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 13 (Thread 2624.0x1de8):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #6  0x00000005cf2b627b in condWait (mutexId=<optimized out>, 
>     condId=<optimized out>) at ../../../src/libCom/osi/os/posix/osdMutex.c:267
> #7  epicsMutexOsdLock (pmutex=0x600070170)
>     at ../../../src/libCom/osi/os/posix/osdMutex.c:286
> #8  0x00000005499f2dbe in dbScanLock (precord=precord@entry=0x600071ba0)
>     at ../../../src/ioc/db/dbLock.c:265
> #9  0x0000000549a047bc in scanList (psl=psl@entry=0x60009c088)
>     at ../../../src/ioc/db/dbScan.c:910
> #10 0x0000000549a0494f in ioscanCallback (pcallback=<optimized out>)
>     at ../../../src/ioc/db/dbScan.c:861
> #11 0x0000000549a0f011 in callbackTask (arg=<optimized out>)
>     at ../../../src/ioc/db/callback.c:170
> #12 0x00000005cf2b3d32 in start_routine (arg=0x600090b70)
>     at ../../../src/libCom/osi/os/posix/osdThread.c:403
> #13 0x000000018013e969 in pthread::thread_init_wrapper(void*) ()
>    from /usr/bin/cygwin1.dll
> #14 0x00000001800bdf31 in pthread_wrapper () from /usr/bin/cygwin1.dll
> #15 0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 12 (Thread 2624.0x117c):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #6  0x00000005cf2b627b in condWait (mutexId=<optimized out>, 
>     condId=<optimized out>) at ../../../src/libCom/osi/os/posix/osdMutex.c:267
> #7  epicsMutexOsdLock (pmutex=0x600070170)
>     at ../../../src/libCom/osi/os/posix/osdMutex.c:286
> #8  0x00000005499f2dbe in dbScanLock (precord=precord@entry=0x600071ba0)
>     at ../../../src/ioc/db/dbLock.c:265
> #9  0x0000000549a047bc in scanList (psl=psl@entry=0x60009c088)
>     at ../../../src/ioc/db/dbScan.c:910
> #10 0x0000000549a0494f in ioscanCallback (pcallback=<optimized out>)
>     at ../../../src/ioc/db/dbScan.c:861
> #11 0x0000000549a0f011 in callbackTask (arg=<optimized out>)
>     at ../../../src/ioc/db/callback.c:170
> #12 0x00000005cf2b3d32 in start_routine (arg=0x60008fec0)
>     at ../../../src/libCom/osi/os/posix/osdThread.c:403
> #13 0x000000018013e969 in pthread::thread_init_wrapper(void*) ()
>    from /usr/bin/cygwin1.dll
> #14 0x00000001800bdf31 in pthread_wrapper () from /usr/bin/cygwin1.dll
> #15 0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 11 (Thread 2624.0x1b5c):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #6  0x00000005cf2b627b in condWait (mutexId=<optimized out>, 
>     condId=<optimized out>) at ../../../src/libCom/osi/os/posix/osdMutex.c:267
> #7  epicsMutexOsdLock (pmutex=0x600070170)
>     at ../../../src/libCom/osi/os/posix/osdMutex.c:286
> #8  0x00000005499f2dbe in dbScanLock (precord=precord@entry=0x600071ba0)
>     at ../../../src/ioc/db/dbLock.c:265
> #9  0x0000000549a047bc in scanList (psl=psl@entry=0x60009c088)
>     at ../../../src/ioc/db/dbScan.c:910
> #10 0x0000000549a0494f in ioscanCallback (pcallback=<optimized out>)
>     at ../../../src/ioc/db/dbScan.c:861
> #11 0x0000000549a0f011 in callbackTask (arg=<optimized out>)
>     at ../../../src/ioc/db/callback.c:170
> #12 0x00000005cf2b3d32 in start_routine (arg=0x600091b60)
>     at ../../../src/libCom/osi/os/posix/osdThread.c:403
> #13 0x000000018013e969 in pthread::thread_init_wrapper(void*) ()
>    from /usr/bin/cygwin1.dll
> #14 0x00000001800bdf31 in pthread_wrapper () from /usr/bin/cygwin1.dll
> #15 0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 10 (Thread 2624.0x1124):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #6  0x00000005cf2b627b in condWait (mutexId=<optimized out>, 
>     condId=<optimized out>) at ../../../src/libCom/osi/os/posix/osdMutex.c:267
> #7  epicsMutexOsdLock (pmutex=0x600070170)
>     at ../../../src/libCom/osi/os/posix/osdMutex.c:286
> #8  0x00000005499f2dbe in dbScanLock (precord=precord@entry=0x600071ba0)
>     at ../../../src/ioc/db/dbLock.c:265
> #9  0x0000000549a047bc in scanList (psl=psl@entry=0x60009c088)
>     at ../../../src/ioc/db/dbScan.c:910
> #10 0x0000000549a0494f in ioscanCallback (pcallback=<optimized out>)
>     at ../../../src/ioc/db/dbScan.c:861
> #11 0x0000000549a0f011 in callbackTask (arg=<optimized out>)
>     at ../../../src/ioc/db/callback.c:170
> #12 0x00000005cf2b3d32 in start_routine (arg=0x60008fe00)
>     at ../../../src/libCom/osi/os/posix/osdThread.c:403
> #13 0x000000018013e969 in pthread::thread_init_wrapper(void*) ()
>    from /usr/bin/cygwin1.dll
> #14 0x00000001800bdf31 in pthread_wrapper () from /usr/bin/cygwin1.dll
> #15 0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 9 (Thread 2624.0xee0):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #6  0x00000005cf2b685b in epicsEventWait (pevent=0x6000978a0)
>     at ../../../src/libCom/osi/os/posix/osdEvent.c:103
> #7  0x00000005cf2ac849 in epicsEventMustWait (id=<optimized out>)
>     at ../../../src/libCom/osi/epicsEvent.cpp:125
> #8  0x0000000549a0f037 in callbackTask (arg=<optimized out>)
>     at ../../../src/ioc/db/callback.c:163
> #9  0x00000005cf2b3d32 in start_routine (arg=0x600092450)
>     at ../../../src/libCom/osi/os/posix/osdThread.c:403
> #10 0x000000018013e969 in pthread::thread_init_wrapper(void*) ()
>    from /usr/bin/cygwin1.dll
> #11 0x00000001800bdf31 in pthread_wrapper () from /usr/bin/cygwin1.dll
> #12 0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 8 (Thread 2624.0x1844):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #6  0x00000005cf2b685b in epicsEventWait (pevent=0x6000978a0)
>     at ../../../src/libCom/osi/os/posix/osdEvent.c:103
> #7  0x00000005cf2ac849 in epicsEventMustWait (id=<optimized out>)
>     at ../../../src/libCom/osi/epicsEvent.cpp:125
> #8  0x0000000549a0f037 in callbackTask (arg=<optimized out>)
>     at ../../../src/ioc/db/callback.c:163
> #9  0x00000005cf2b3d32 in start_routine (arg=0x60006a810)
>     at ../../../src/libCom/osi/os/posix/osdThread.c:403
> #10 0x000000018013e969 in pthread::thread_init_wrapper(void*) ()
>    from /usr/bin/cygwin1.dll
> #11 0x00000001800bdf31 in pthread_wrapper () from /usr/bin/cygwin1.dll
> #12 0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 7 (Thread 2624.0xe58):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #6  0x00000005cf2b685b in epicsEventWait (pevent=0x6000978a0)
>     at ../../../src/libCom/osi/os/posix/osdEvent.c:103
> #7  0x00000005cf2ac849 in epicsEventMustWait (id=<optimized out>)
>     at ../../../src/libCom/osi/epicsEvent.cpp:125
> #8  0x0000000549a0f037 in callbackTask (arg=<optimized out>)
>     at ../../../src/ioc/db/callback.c:163
> #9  0x00000005cf2b3d32 in start_routine (arg=0x600091610)
>     at ../../../src/libCom/osi/os/posix/osdThread.c:403
> #10 0x000000018013e969 in pthread::thread_init_wrapper(void*) ()
>    from /usr/bin/cygwin1.dll
> #11 0x00000001800bdf31 in pthread_wrapper () from /usr/bin/cygwin1.dll
> #12 0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 6 (Thread 2624.0x200):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #6  0x00000005cf2b685b in epicsEventWait (pevent=0x600068c90)
>     at ../../../src/libCom/osi/os/posix/osdEvent.c:103
> #7  0x00000005cf2ac849 in epicsEventMustWait (id=<optimized out>)
>     at ../../../src/libCom/osi/epicsEvent.cpp:125
> #8  0x0000000549a0f037 in callbackTask (arg=<optimized out>)
>     at ../../../src/ioc/db/callback.c:163
> #9  0x00000005cf2b3d32 in start_routine (arg=0x60006e880)
>     at ../../../src/libCom/osi/os/posix/osdThread.c:403
> #10 0x000000018013e969 in pthread::thread_init_wrapper(void*) ()
>    from /usr/bin/cygwin1.dll
> #11 0x00000001800bdf31 in pthread_wrapper () from /usr/bin/cygwin1.dll
> #12 0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 5 (Thread 2624.0x1e68):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x00000001801417f4 in pthread_cond_timedwait () from /usr/bin/cygwin1.dll
> #6  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #7  0x00000005cf2b69ee in epicsEventWaitWithTimeout (pevent=0x600095aa0, 
>     timeout=1.7976931348623157e+308)
>     at ../../../src/libCom/osi/os/posix/osdEvent.c:130
> #8  0x00000005cf2ac71c in epicsEvent::wait (this=this@entry=0x600069b20, 
>     timeOut=<optimized out>) at ../../../src/libCom/osi/epicsEvent.cpp:75
> #9  0x00000005cf2bea99 in timerQueueActive::run (this=0x600069a60)
>     at ../../../src/libCom/timer/timerQueueActive.cpp:95
> #10 0x00000005cf2aacea in epicsThreadCallEntryPoint (pPvt=0x600069b30)
>     at ../../../src/libCom/osi/epicsThread.cpp:83
> #11 0x00000005cf2b3d32 in start_routine (arg=0x60006a5f0)
>     at ../../../src/libCom/osi/os/posix/osdThread.c:403
> #12 0x000000018013e969 in pthread::thread_init_wrapper(void*) ()
>    from /usr/bin/cygwin1.dll
> #13 0x00000001800bdf31 in pthread_wrapper () from /usr/bin/cygwin1.dll
> #14 0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 4 (Thread 2624.0xbbc):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x00000001801417f4 in pthread_cond_timedwait () from /usr/bin/cygwin1.dll
> #6  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #7  0x00000005cf2b69ee in epicsEventWaitWithTimeout (pevent=0x600076350, 
>     timeout=timeout@entry=6) at ../../../src/libCom/osi/os/posix/osdEvent.c:130
> #8  0x00000005cf2bbe10 in twdTask (arg=<optimized out>)
>     at ../../../src/libCom/taskwd/taskwd.c:125
> #9  0x00000005cf2b3d32 in start_routine (arg=0x6000765b0)
>     at ../../../src/libCom/osi/os/posix/osdThread.c:403
> #10 0x000000018013e969 in pthread::thread_init_wrapper(void*) ()
>    from /usr/bin/cygwin1.dll
> #11 0x00000001800bdf31 in pthread_wrapper () from /usr/bin/cygwin1.dll
> #12 0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 3 (Thread 2624.0x1a2c):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #6  0x00000005cf2b685b in epicsEventWait (pevent=0x600071220)
>     at ../../../src/libCom/osi/os/posix/osdEvent.c:103
> #7  0x00000005cf2ac849 in epicsEventMustWait (id=<optimized out>)
>     at ../../../src/libCom/osi/epicsEvent.cpp:125
> #8  0x00000005cf29baa8 in errlogThread ()
>     at ../../../src/libCom/error/errlog.c:569
> #9  0x00000005cf2b3d32 in start_routine (arg=0x600075790)
>     at ../../../src/libCom/osi/os/posix/osdThread.c:403
> #10 0x000000018013e969 in pthread::thread_init_wrapper(void*) ()
>    from /usr/bin/cygwin1.dll
> #11 0x00000001800bdf31 in pthread_wrapper () from /usr/bin/cygwin1.dll
> #12 0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 2 (Thread 2624.0x1e0c):
> #0  0x00000000771ebd9a in ntdll!ZwReadFile ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041a7a in ReadFile ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770909f9 in ReadFile ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x000000018011d9d3 in wait_sig(void*) () from /usr/bin/cygwin1.dll
> #4  0x0000000180044603 in cygthread::callfunc(bool) ()
>    from /usr/bin/cygwin1.dll
> #5  0x0000000180044b9a in cygthread::stub(void*) () from /usr/bin/cygwin1.dll
> #6  0x00000001800455e3 in _cygtls::call2(unsigned int (*)(void*, void*), void*, void*) () from /usr/bin/cygwin1.dll
> #7  0x0000000180045694 in _cygtls::call(unsigned int (*)(void*, void*), void*)
>     () from /usr/bin/cygwin1.dll
> #8  0x00000000770959cd in KERNEL32!BaseThreadInitThunk ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #9  0x00000000771ca561 in ntdll!RtlUserThreadStart ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #10 0x0000000000000000 in ?? ()
> Backtrace stopped: previous frame inner to this frame (corrupt stack?)
> 
> Thread 1 (Thread 2624.0x1f00):
> #0  0x00000000771ec2ea in ntdll!ZwWaitForMultipleObjects ()
>    from /cygdrive/c/windows/SYSTEM32/ntdll.dll
> #1  0x000007fefd041430 in KERNELBASE!GetCurrentProcess ()
>    from /cygdrive/c/windows/system32/KERNELBASE.dll
> #2  0x00000000770906c0 in WaitForMultipleObjects ()
>    from /cygdrive/c/windows/system32/kernel32.dll
> #3  0x00000001800458ac in cygwait(void*, _LARGE_INTEGER*, unsigned int) ()
>    from /usr/bin/cygwin1.dll
> #4  0x000000018013f451 in pthread_cond::wait(pthread_mutex*, _LARGE_INTEGER*)
>     () from /usr/bin/cygwin1.dll
> #5  0x0000000180116d5b in _sigfe () from /usr/bin/cygwin1.dll
> #6  0x00000005cf2b627b in condWait (mutexId=<optimized out>, 
>     condId=<optimized out>) at ../../../src/libCom/osi/os/posix/osdMutex.c:267
> #7  epicsMutexOsdLock (pmutex=0x600070170)
>     at ../../../src/libCom/osi/os/posix/osdMutex.c:286
> #8  0x00000005499f2dbe in dbScanLock (precord=precord@entry=0x600071ba0)
>     at ../../../src/ioc/db/dbLock.c:265
> #9  0x0000000549a2ccd8 in doCloseLinks (user=<optimized out>, 
>     precord=<optimized out>, pdbRecordType=<optimized out>)
>     at ../../../src/ioc/misc/iocInit.c:671
> #10 iterateRecords (func=<optimized out>, user=0x0)
>     at ../../../src/ioc/misc/iocInit.c:472
> #11 iocShutdown () at ../../../src/ioc/misc/iocInit.c:705
> #12 0x0000000549a2d6e8 in iocShutdown () at ../../../src/ioc/misc/iocInit.c:704
> #13 0x0000000549a18f49 in testIocShutdownOk ()
>     at ../../../src/ioc/db/dbUnitTest.c:53
> #14 0x0000000100401e10 in stopMockIoc () at ../scanIoTest.c:235
> #15 0x0000000100402d02 in main (argc=<optimized out>, argv=<optimized out>)
>     at ../scanIoTest.c:420
> (gdb) 


- Andrew

-- 
Arguing for surveillance because you have nothing to hide is no
different than making the claim, "I don't care about freedom of
speech because I have nothing to say." -- Edward Snowdon
Navigate by Date:
Prev: Build failed in Jenkins: epics-base-3.15-win64-test #108 APS Jenkins
Next: Jenkins build is back to normal : epics-base-3.15-win64-test #109 APS Jenkins
Index: 2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  <2017>  2018  2019  2020  2021  2022  2023  2024 
Navigate by Thread:
Prev: Jenkins build is back to normal : epics-base-3.15-win64-test #109 APS Jenkins
Next: Interest in JUnit xml Test Results? Andrew Johnson
Index: 2002  2003  2004  2005  2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  2016  <2017>  2018  2019  2020  2021  2022  2023  2024