| 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 <2009> 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 | Index | 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 <2009> 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 |
| <== Date ==> | <== Thread ==> |
|---|
| Subject: | RE: CA problem w EPICS 3.14.11 & VxWorks 6.7 |
| From: | "GOURNAY Jean-Francois" <[email protected]> |
| To: | "Jeff Hill" <[email protected]>, <[email protected]>, "Kazuro FURUKAWA" <[email protected]> |
| Date: | Wed, 25 Nov 2009 11:28:00 +0100 |
|
Hello Jeff, hello Kazuro Thanks for your replies. Jeff, I have included the trace
of the 2 following commands : Dbcar “VMETST-CA-O”,
“2” Casr “1” Before these commands, I
did a dbtr “VMETST-CA-O”, surprisingly UDF becomes 0 but the value (supposed
to be retrieved through a CA link to VMETST) is 0 (it should be “223”). Both VxWorks IOCs are on
the same network (132.166.33.10 and 132.166.33.11) Kazuro, I will pass the
information to my colleague in charge of the VxWorks support. He had already a
lot of trouble with the IP stack of the new release of VxWorks (2nd Ethernet
port of our MVME5500 not working, problem of connection with rlogin, problem
with connect function of socket.h). Recompiling with gnu instead of diab helps
for some point (wancomEnd.c) but there are still pending problems. J.F. Gournay CEA Saclay IRFU/SIS De :
Jeff Hill [mailto:[email protected]] Hello Jean-Francois, I had a quick look at what has changed between
R3.14.10 and R3.14.11 WRT EPICS_CA_AUTO_ADDR_LIST
and EPICS_CA_ADDR_LIST. I do
see that in R3.14.11 Mantis 331 was fixed. This is certainly a relevant change,
but I don’t at this time expect the side effect that you are observing. Ø This problem arises also with CA links between VxWorks an
Linux. Ø On the other hand, no problem with CA links between 2 Linux
IOCs The above might be a very useful bit of information.
Presumably the same vxWorks version, vxWorks 6.7, was also used with R3.14.10?
Frequently vxWorks systems boot by default with routes limiting access only to
the local subnet. If a EPICS system is operating in a WAN environment it may be
necessary to configure routes into the vxWorks system which enable a vxWorks
based CA server to respond to requests originating outside it's subnet. These
routing restrictions might also apply to vxWorks based CA clients communicating
with off subnet servers. See "routeLib" in the vxWorks reference
manual. Of course, the other difference between vxWorks and
Linux in your situation might be PPC (big-endian) versus Intel (little-endian),
and that might imply a missing byte swap in the CA code, but I haven’t
identified one at this time based on the source code differences. Ø We have “CA beacon routing … ECONNREFUSED”
on the 1st booted IOC. This indicates that the IOC is unable to identify a
route for a beacon message. A list of addresses is also configured for the
beacons. When EPICS_CA_AUTO_ADDR_LIST is YES, please type ‘casr <integer interest level>’ and
send the result. This will reveal what the address list is being set to at
higher interest levels. One can also receive an overwhelming amount of
information by typing ‘dbcar “record name”, <integer
interest level>’. At some higher interest level you should see also
the CA address list for the db ca client. You might also try
“routeShow” on this vxWorks system. If there is a problem with auto
configuring the client’s address list we should see clear evidence in
this diagnostic. With the above information, fault isolation should
proceed quickly, and maybe I won’t need to spend as much time staring at
the source code. Thanks for your help, Jeff ______________________________________________________ Message
content: TSPA From:
[email protected] [mailto:[email protected]] On Behalf Of GOURNAY Jean-Francois Hello, We have 2 IOCs running EPICS 3.14.11 with VxWorks
6.7. Any record on an IOC with a CA link on a record
located in the other IOC stays UDF=1 forever. This problem arises with
EPICS_CA_AUTO_ADDR_LIST= YES. With EPICS_CA_AUTO_ADDR_LIST=NO and
EPICS-CA-ADDR-LIST= … it works. But we would like to avoid to have this
parameter to “NO” and having to maintain the host list in
ADDR-LIST. Especially in the case where: On IOC1 : EPICS-CA-ADDR-LIST=<IP IOC2> And on IOC2: EPICS-CA-ADDR-LIST=<IP IOC1> (needed for CA links in both directions) We have “CA beacon routing …
ECONNREFUSED” on the 1rst booted IOC. We did’nt have this problem with the previous
release. This problem arises also with CA links between
VxWorks an Linux. On the other hand, no problem with CA links between 2
Linux IOCs Thanks Jeff (I think it is probably a problem for you
. . .) J.F. Gournay CEA Saclay IRFU/SIS |
sigvm11->
sigvm11->dbtr "VMETST-CA-O"
ACKS: INVALID ACKT: YES ADEL: 0 ALST: 0
AOFF: 0 ASG: ASLO: 0 BKPT: 00
DESC: DISA: 0 DISP: 0 DISS: NO_ALARM
DISV: 1 DOL:CA_LINK VMETST CA NMS DRVH: 0
DRVL: 0 DTYP: Soft Channel EGU: EGUF: 0
EGUL: 0 EOFF: 0 ESLO: 1 EVNT: 0
FLNK:CONSTANT 0 HHSV: NO_ALARM HIGH: 0 HIHI: 0
HOPR: 0 HSV: NO_ALARM HYST: 0 INIT: 0
IVOA: Continue normally IVOV: 0 LALM: 0
LBRK: 0 LCNT: 0 LINR: NO CONVERSION LLSV: NO_ALARM
LOLO: 0 LOPR: 0 LOW: 0 LSV: NO_ALARM
MDEL: 0 MLST: 0 NAME: VMETST-CA-O NSEV: NO_ALARM
NSTA: NO_ALARM OIF: Full OMOD: 0 OMSL: closed_loop
ORAW: 0 ORBV: 0 OROC: 0 OUT:CONSTANT
OVAL: 0 PACT: 0 PHAS: 0 PINI: NO
PREC: 0 PRIO: LOW PROC: 0 PUTF: 0
PVAL: 0 RBV: 0 ROFF: 0 RPRO: 0
RVAL: 0 SCAN: Passive SDIS:CONSTANT SEVR: INVALID
SIML:CONSTANT SIMM: NO SIMS: NO_ALARM SIOL:CONSTANT
STAT: LINK TIME: 2009-11-25 11:05:56.218660126 TPRO: 0
TSE: 0 TSEL:CONSTANT UDF: 0 VAL: 0
value = 0 = 0x0
sigvm11->
sigvm11->
sigvm11->
sigvm11->
sigvm11->
sigvm11->
sigvm11->
sigvm11->
sigvm11->
sigvm11->
sigvm11->dbcar "VMETST-CA-O","2"
CA links in record named 'VMETST-CA-O'
VMETST-CA-O.DOL --> VMETST (0, 0)
Total 1 CA link; 0 connected, 1 not connected.
0 can't read, 0 can't write. (0 disconnects, 0 writes prohibited)
ca_client_context at 0x6d2f20 pndRecvCnt=0 ioSeqNo=0
dbContext at 0x6d3250
event call back cache location 0x0, and its size 0
dbContextReadNotifyCache
dbContextReadNotifyCacheAlocator
count 0 and size 0
epicsMutexId 0x6d3070 source ../../../src/libCom/osi/epicsMutex.cpp line 224
Semaphore Id : 0x6d2ff0
Semaphore Name : N/A
Semaphore Type : MUTEX
Task Queuing : PRIORITY
Pended Tasks : 0
Owner : 0x702880 (tShell0)
Options : 0xd SEM_Q_PRIORITY
SEM_DELETE_SAFE
SEM_INVERSION_SAFE
VxWorks Events
--------------
Registered Task : NONE
Event(s) to Send : N/A
Options : N/A
Channel Access Client Context at 0x623140 for user vw
revision "@(#) EPICS 3.14.11, CA Client Library Nov 5 2009"
Hash table with 0 buckets and 0 items of type 6tcpiiu installed
connection time out watchdog period 30.000000
Datagram IO circuit (and disconnected channel repository)
repeater port 5065
default server port 5064
Channel Access Address List
localhost:5064
socket identifier 21
bytes in xmit buffer 16
shut down command bool 0
recv thread exit signal:
repeater subscribe timer: attempts=2 registered=1 once=0
disconnect governor timer: with 0 channels pending
searchTimer with period 0.032000
channels with search request pending = 0
channels with search response pending = 0
searchTimer with period 0.064000
channels with search request pending = 0
channels with search response pending = 0
searchTimer with period 0.128000
channels with search request pending = 0
channels with search response pending = 0
searchTimer with period 0.256000
channels with search request pending = 0
channels with search response pending = 0
searchTimer with period 0.512000
channels with search request pending = 0
channels with search response pending = 0
searchTimer with period 1.024000
channels with search request pending = 0
channels with search response pending = 0
searchTimer with period 2.048000
channels with search request pending = 0
channels with search response pending = 0
searchTimer with period 4.096000
channels with search request pending = 0
channels with search response pending = 0
searchTimer with period 8.192000
channels with search request pending = 0
channels with search response pending = 0
searchTimer with period 16.384000
channels with search request pending = 0
channels with search response pending = 0
searchTimer with period 32.768000
channels with search request pending = 0
channels with search response pending = 0
searchTimer with period 65.536000
channels with search request pending = 0
channels with search response pending = 0
searchTimer with period 131.072000
channels with search request pending = 0
channels with search response pending = 3
Channel "VMETST" is disconnected
network IO pointer = 0x839930
server identifier 4294967295
search retry number=17
name length=7
Channel "VMETST" is disconnected
network IO pointer = 0x839930
server identifier 4294967295
search retry number=17
name length=7
Channel "ASGVAL" is disconnected
network IO pointer = 0x839930
server identifier 4294967295
search retry number=17
name length=7
searchTimer with period 262.144000
channels with search request pending = 0
channels with search response pending = 0
Program begin time:
epicsTime: WED NOV 25 2009 11:01:29.920030178
epicsTime: revision "@(#) EPICS 3.14.11, Common Utilities Library Nov 5 2009"
Channel identifier hash table:
Hash table with 512 buckets and 3 items of type 4nciu installed
Channel "VMETST" is disconnected
network IO pointer = 0x839930
server identifier 4294967295
search retry number=17
name length=7
Channel "VMETST" is disconnected
network IO pointer = 0x839930
server identifier 4294967295
search retry number=17
name length=7
Channel "ASGVAL" is disconnected
network IO pointer = 0x839930
server identifier 4294967295
search retry number=17
name length=7
Channel "VMETST" is disconnected
network IO pointer = 0x839930
server identifier 4294967295
search retry number=17
name length=7
Channel "VMETST" is disconnected
network IO pointer = 0x839930
server identifier 4294967295
search retry number=17
name length=7
Channel "ASGVAL" is disconnected
network IO pointer = 0x839930
server identifier 4294967295
search retry number=17
name length=7
entries per bucket: mean = 0.005859 std dev = 0.076322 max = 1
509 empty buckets
IO identifier hash table:
Hash table with 0 buckets and 0 items of type 8baseNMIU installed
Beacon source identifier hash table:
Hash table with 512 buckets and 10 items of type 3bhe installed
CA beacon hash entry for 132.166.14.59:41499 with period estimate 15.000716
beacon number 179, on WED NOV 25 2009 11:06:04
CA beacon hash entry for 132.166.31.217:5064 with period estimate 15.002840
beacon number 132882, on WED NOV 25 2009 11:06:01
CA beacon hash entry for 132.166.35.171:5064 with period estimate 29.999938
beacon number 0, on WED NOV 25 2009 11:05:39
CA beacon hash entry for 132.166.35.172:5064 with period estimate 30.959020
beacon number 0, on WED NOV 25 2009 11:05:43
CA beacon hash entry for 132.166.35.160:5064 with period estimate 15.000000
beacon number 0, on WED NOV 25 2009 11:06:03
CA beacon hash entry for 132.166.35.185:5064 with period estimate 30.934866
beacon number 0, on WED NOV 25 2009 11:05:42
CA beacon hash entry for 132.166.35.190:5064 with period estimate 5.042589
beacon number 0, on WED NOV 25 2009 11:06:04
CA beacon hash entry for 132.166.35.181:5064 with period estimate 30.941204
beacon number 0, on WED NOV 25 2009 11:05:58
CA beacon hash entry for 192.168.1.1:5064 with period estimate 15.000000
beacon number 28057, on WED NOV 25 2009 11:06:00
CA beacon hash entry for 132.166.14.59:5064 with period estimate 15.000626
beacon number 179, on WED NOV 25 2009 11:06:04
CA beacon hash entry for 132.166.14.59:41499 with period estimate 15.000716
beacon number 179, on WED NOV 25 2009 11:06:04
CA beacon hash entry for 132.166.31.217:5064 with period estimate 15.002840
beacon number 132882, on WED NOV 25 2009 11:06:01
CA beacon hash entry for 132.166.35.171:5064 with period estimate 29.999938
beacon number 0, on WED NOV 25 2009 11:05:39
CA beacon hash entry for 132.166.35.172:5064 with period estimate 30.959020
beacon number 0, on WED NOV 25 2009 11:05:43
CA beacon hash entry for 132.166.35.160:5064 with period estimate 15.000000
beacon number 0, on WED NOV 25 2009 11:06:03
CA beacon hash entry for 132.166.35.185:5064 with period estimate 30.934866
beacon number 0, on WED NOV 25 2009 11:05:42
CA beacon hash entry for 132.166.35.190:5064 with period estimate 5.042589
beacon number 0, on WED NOV 25 2009 11:06:04
CA beacon hash entry for 132.166.35.181:5064 with period estimate 30.941204
beacon number 0, on WED NOV 25 2009 11:05:58
CA beacon hash entry for 192.168.1.1:5064 with period estimate 15.000000
beacon number 28057, on WED NOV 25 2009 11:06:00
CA beacon hash entry for 132.166.14.59:5064 with period estimate 15.000626
beacon number 179, on WED NOV 25 2009 11:06:04
entries per bucket: mean = 0.019531 std dev = 0.138383 max = 1
502 empty buckets
Timer queue:
EPICS threaded timer queue at 0x70a690
epicsThread at 0x838300
NAME ENTRY TID PRI STATUS PC SP ERRNO DELAY
---------- ------------ -------- --- ---------- -------- -------- ------- -----
timerQueue 9e5470 838300 148 PEND+T 27c2d0 838180 3d0004 1
epicsTimerQueue with 15 items pending
timer, state = pending, delay = 0.019667
searchTimer with period 0.128000
channels with search request pending = 0
channels with search response pending = 0
timer, state = pending, delay = 0.022333
searchTimer with period 0.064000
channels with search request pending = 0
channels with search response pending = 0
timer, state = pending, delay = 0.023667
searchTimer with period 0.032000
channels with search request pending = 0
channels with search response pending = 0
timer, state = pending, delay = 0.097667
searchTimer with period 0.256000
channels with search request pending = 0
channels with search response pending = 0
timer, state = pending, delay = 0.337000
searchTimer with period 0.512000
channels with search request pending = 0
channels with search response pending = 0
timer, state = pending, delay = 0.432333
searchTimer with period 1.024000
channels with search request pending = 0
channels with search response pending = 0
timer, state = pending, delay = 0.825000
disconnect governor timer: with 0 channels pending
timer, state = pending, delay = 1.673000
searchTimer with period 2.048000
channels with search request pending = 0
channels with search response pending = 0
timer, state = pending, delay = 3.721000
searchTimer with period 4.096000
channels with search request pending = 0
channels with search response pending = 0
timer, state = pending, delay = 7.783667
searchTimer with period 8.192000
channels with search request pending = 0
channels with search response pending = 0
timer, state = pending, delay = 15.725667
searchTimer with period 16.384000
channels with search request pending = 0
channels with search response pending = 0
timer, state = pending, delay = 15.726334
searchTimer with period 32.768000
channels with search request pending = 0
channels with search response pending = 0
timer, state = pending, delay = 48.494334
searchTimer with period 65.536000
channels with search request pending = 0
channels with search response pending = 0
timer, state = pending, delay = 114.030334
searchTimer with period 131.072000
channels with search request pending = 0
channels with search response pending = 3
Channel "VMETST" is disconnected
network IO pointer = 0x839930
server identifier 4294967295
search retry number=17
name length=7
Channel "VMETST" is disconnected
network IO pointer = 0x839930
server identifier 4294967295
search retry number=17
name length=7
Channel "ASGVAL" is disconnected
network IO pointer = 0x839930
server identifier 4294967295
search retry number=17
name length=7
timer, state = pending, delay = 245.119001
searchTimer with period 262.144000
channels with search request pending = 0
channels with search response pending = 0
reschedule event
Semaphore Id : 0x623c50
Semaphore Name : N/A
Semaphore Type : BINARY
Task Queuing : FIFO
Pended Tasks : 1
State : EMPTY
Options : 0x0 SEM_Q_FIFO
VxWorks Events
--------------
Registered Task : NONE
Event(s) to Send : N/A
Options : N/A
Pended Tasks
------------
NAME TID PRI TIMEOUT
---------- -------- --- -------
timerQueue 838300 148 1
exit event
Semaphore Id : 0x623cd0
Semaphore Name : N/A
Semaphore Type : BINARY
Task Queuing : FIFO
Pended Tasks : 0
State : EMPTY
Options : 0x0 SEM_Q_FIFO
VxWorks Events
--------------
Registered Task : NONE
Event(s) to Send : N/A
Options : N/A
exitFlag = F, terminateFlag = F
IP address to name conversion engine:
ipAddrToAsciiEngine at 0x7afea0 with 0 requests pending
mutex:
epicsMutexId 0x7b0440 source ../../../src/libCom/osi/epicsMutex.cpp line 224
Semaphore Id : 0x7b03c0
Semaphore Name : N/A
Semaphore Type : MUTEX
Task Queuing : PRIORITY
Pended Tasks : 0
Owner : 0x702880 (tShell0)
Options : 0xd SEM_Q_PRIORITY
SEM_DELETE_SAFE
SEM_INVERSION_SAFE
VxWorks Events
--------------
Registered Task : NONE
Event(s) to Send : N/A
Options : N/A
laborEvent:
Semaphore Id : 0x7b0470
Semaphore Name : N/A
Semaphore Type : BINARY
Task Queuing : FIFO
Pended Tasks : 1
State : EMPTY
Options : 0x0 SEM_Q_FIFO
VxWorks Events
--------------
Registered Task : NONE
Event(s) to Send : N/A
Options : N/A
Pended Tasks
------------
NAME TID PRI TIMEOUT
---------- -------- --- -------
ipToAsciiProxy 7b5d10 189 0
exitFlag boolean = 0
exit event:
Default mutex:
epicsMutexId 0x6d3070 source ../../../src/libCom/osi/epicsMutex.cpp line 224
Semaphore Id : 0x6d2ff0
Semaphore Name : N/A
Semaphore Type : MUTEX
Task Queuing : PRIORITY
Pended Tasks : 0
Owner : 0x702880 (tShell0)
Options : 0xd SEM_Q_PRIORITY
SEM_DELETE_SAFE
SEM_INVERSION_SAFE
VxWorks Events
--------------
Registered Task : NONE
Event(s) to Send : N/A
Options : N/A
mutex:
epicsMutexId 0x6d3070 source ../../../src/libCom/osi/epicsMutex.cpp line 224
Semaphore Id : 0x6d2ff0
Semaphore Name : N/A
Semaphore Type : MUTEX
Task Queuing : PRIORITY
Pended Tasks : 0
Owner : 0x702880 (tShell0)
Options : 0xd SEM_Q_PRIORITY
SEM_DELETE_SAFE
SEM_INVERSION_SAFE
VxWorks Events
--------------
Registered Task : NONE
Event(s) to Send : N/A
Options : N/A
preemptive callback is enabled
there are 0 unsatisfied IO operations blocking ca_pend_io()
the current io sequence number is 0
IO done event:
Semaphore Id : 0x6d3150
Semaphore Name : N/A
Semaphore Type : BINARY
Task Queuing : FIFO
Pended Tasks : 0
State : EMPTY
Options : 0x0 SEM_Q_FIFO
VxWorks Events
--------------
Registered Task : NONE
Event(s) to Send : N/A
Options : N/A
Synchronous group identifier hash table:
Hash table with 0 buckets and 0 items of type 4CASG installed
value = 0 = 0x0
sigvm11->
sigvm11->
sigvm11->
sigvm11->
sigvm11->
sigvm11->casr "1"
Channel Access Server V4.11
No clients connected.
UDP Server:
UDP 132.166.35.181:1029(): User="", V4.0, 0 Channels, Priority=0
Task Id=0x817900, Socket FD=29
Secs since last send 366.52, Secs since last receive 0.03
Unprocessed request bytes=16, Undelivered response bytes=0
State=up
180 bytes allocated
Send Lock
epicsMutexId 0x81cc20 source ../caservertask.c line 732
Semaphore Id : 0x81cba0
Semaphore Name : N/A
Semaphore Type : MUTEX
Task Queuing : PRIORITY
Pended Tasks : 0
Owner : NONE
Options : 0xd SEM_Q_PRIORITY
SEM_DELETE_SAFE
SEM_INVERSION_SAFE
VxWorks Events
--------------
Registered Task : NONE
Event(s) to Send : N/A
Options : N/A
Put Notify Lock
epicsMutexId 0x81ccd0 source ../caservertask.c line 733
Semaphore Id : 0x81cc50
Semaphore Name : N/A
Semaphore Type : MUTEX
Task Queuing : PRIORITY
Pended Tasks : 0
Owner : NONE
Options : 0xd SEM_Q_PRIORITY
SEM_DELETE_SAFE
SEM_INVERSION_SAFE
VxWorks Events
--------------
Registered Task : NONE
Event(s) to Send : N/A
Options : N/A
Address Queue Lock
epicsMutexId 0x81cd80 source ../caservertask.c line 734
Semaphore Id : 0x81cd00
Semaphore Name : N/A
Semaphore Type : MUTEX
Task Queuing : PRIORITY
Pended Tasks : 0
Owner : NONE
Options : 0xd SEM_Q_PRIORITY
SEM_DELETE_SAFE
SEM_INVERSION_SAFE
VxWorks Events
--------------
Registered Task : NONE
Event(s) to Send : N/A
Options : N/A
Event Queue Lock
epicsMutexId 0x81ce30 source ../caservertask.c line 735
Semaphore Id : 0x81cdb0
Semaphore Name : N/A
Semaphore Type : MUTEX
Task Queuing : PRIORITY
Pended Tasks : 0
Owner : NONE
Options : 0xd SEM_Q_PRIORITY
SEM_DELETE_SAFE
SEM_INVERSION_SAFE
VxWorks Events
--------------
Registered Task : NONE
Event(s) to Send : N/A
Options : N/A
Block Semaphore
Semaphore Id : 0x81cb20
Semaphore Name : N/A
Semaphore Type : BINARY
Task Queuing : FIFO
Pended Tasks : 0
State : EMPTY
Options : 0x0 SEM_Q_FIFO
VxWorks Events
--------------
Registered Task : NONE
Event(s) to Send : N/A
Options : N/A
There are currently 1260 bytes on the server's free list
7 client(s), 0 channel(s), 0 event(s) (monitors) 0 putNotify(s)
0 small buffers (16384 bytes ea), and 0 jumbo buffers (16408 bytes ea)
The server's resource id conversion table:
Bucket entries in use = 0 bytes in use = 16404
Bucket entries/hash id - mean = 0.000000 std dev = 0.000000 max = 0
The server's array size limit is 16408 bytes max
Channel Access Address List
value = 28 = 0x1c