Argonne National Laboratory

Experimental Physics and
Industrial Control System

1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  <20102011  2012  2013  2014  2015  2016  2017  Index 1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  <20102011  2012  2013  2014  2015  2016  2017 
<== Date ==> <== Thread ==>

Subject: RE: ChannelArchiver 2GB Index File Size Limit
From: <james.rowland@diamond.ac.uk>
To: <james.rowland@diamond.ac.uk>, <tech-talk@aps.anl.gov>
Date: Thu, 10 Jun 2010 09:22:34 +0100
I have another question about the hashtable size in the index, that's set to 1009 as a compile-time parameter. Has anyone successfully increased this as we have an average list length of more than 10 with 40 sub-archives and we hope to be able to combine these into one master index with potentially 100,000 channels.
 

From: tech-talk-bounces@aps.anl.gov [mailto:tech-talk-bounces@aps.anl.gov] On Behalf Of james.rowland@diamond.ac.uk
Sent: 09 June 2010 10:01
To: tech-talk@aps.anl.gov
Subject: ChannelArchiver 2GB Index File Size Limit

Hi
 
We are using the RTree ChannelArchiver at Diamond and we are at the point where we have a large number of master index files due to the 2GB file size limit. We have modified the index files to use 64 bit file offsets, has anyone had similar problems and tried this? We're not in a position to move to a new format for the data files (10TB+) in the short term.
 
Thanks

James
 

 

-- 

This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail.
Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd.
Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message.
Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom
 



 

-- 

This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail.
Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd.
Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message.
Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom
 



References:
ChannelArchiver 2GB Index File Size Limit james.rowland

Navigate by Date:
Prev: RE: unsigned long record value Mark Rivers
Next: Re: unsigned long record value Andrew Johnson
Index: 1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  <20102011  2012  2013  2014  2015  2016  2017 
Navigate by Thread:
Prev: ChannelArchiver 2GB Index File Size Limit james.rowland
Next: hypertable archiver james.rowland
Index: 1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004  2005  2006  2007  2008  2009  <20102011  2012  2013  2014  2015  2016  2017 
ANJ, 02 Sep 2010 Valid HTML 4.01! · Home · News · About · Base · Modules · Extensions · Distributions · Download ·
· EPICS V4 · IRMIS · Talk · Bugs · Documents · Links · Licensing ·