From gmendell@ligo-wa.caltech.edu Sun Oct 23 18:51:59 2005 Date: Sun, 23 Oct 2005 15:45:58 -0700 From: Gregory Mendell To: Keith Riles Cc: Peter Shawhan , Ben Johnson , Igor Yakushin , Stuart Anderson Subject: Re: Data access for M7 Hi Keith, As per my previous reply to your email about M7 data access, similarly M8 data can be found from the computers listed in that email under /archive/frames/M8 at LLO and at CIT (except raw full-frame data will be shipped to CIT later in the week on tape). The raw data is under: /archive/frames/M8/L0/LHO The Level 1 RDS data is under: /archive/frames/M8/L1/LHO The Level 3 RDS data is under: /archive/frames/M8/L3/LHO The Level 4 RDS data is under: /archive/frames/M8/L4/LHO at LLO. (Note that there was a configuration error that temporarily put the L4 data at CIT under /archive/frames/M8/R/LLO/, but this will get corrected very soon.) Cheers, Greg Gregory Mendell wrote: > Keith Riles wrote: > >>Hi Greg, >> >>I'm finally getting around to assembling an M7 web page. >>One link we had on the M5 page was to an e-mail you had >>written on SAM data access. Would you double check it >>and make sure the basic contents are still applicable. >>(sending me a revised version without references to M3 >>data would be nice!) >> >>thanks, >>Keith >> >> > > > Hi Keith, > > I was out of town from Oct 6-10, so sorry about the late reply. > > Below I give up-to-date general instructions on where to look for data, > and the exact location of the M7 data as an example. > > 1. For those with a general computing accoun, data is available from > > fortress.ligo-wa.caltech.edu > > and > > padilla.ligo-wa.caltech.edu > > at LHO and from > > decatur.ligo-la.caltech.edu > > at LLO. > > 2. For those with a grid account, data is available at LHO from > > ldas-grid.ligo-wa.caltech.edu > > or > > ldas-pcdev1.ligo-wa.caltech.edu > > and from > > ldas-grid.ligo-la.caltech.edu > > or > > ldas-pcdev1.ligo-la.caltech.edu > > at LLO, and from > > ldas-grid.ligo.caltech.edu > > or > > ldas-pcdev1.ligo.caltech.edu > > at CIT. > >>From a grid computer, one can run LSCsegFind to locate times with locked > data and LSCdataFind to locate the data frame files themselves. Run > these commands with the -h option to learn more. Or one can look in the > directly in the directories listed below using the unix "ls" command. > > 3. All archived data is found under > > /archive/frames > > at LHO, LLO, and CIT. > > During a run, raw and RDS data should show up in the archive within 20 > minutes of real-time at the sites, most of the time. There will be a ~ > 1-2 week delay for raw data to show up at CIT, since it is being shipped > via tape. However, RDS data should show up at CIT within a few hours of > real-time, most of the time. > > For example, for the M7 run the data is under > > /archive/frames/M7 > > at LHO and CIT. (This data is not being sent to LLO as far as I know.) > > The raw data is under: > > /archive/frames/M7/L0/LHO > > The Level 1 RDS data is under: > > /archive/frames/M7/L1/LHO > > The Level 3 RDS data is under: > > /archive/frames/M7/L3/LHO > > As of Tue. Oct. 11, the raw M7 data is not at CIT yet, but it will be > once the tapes are shipped and put into the library there. > > 4. The DMT data is visible under > > /dmt > > from most of the computers listed above. This data is rsynced and > archived under /archive/dmt/LHO at LHO and CIT, and under > > /archive/dmt/LLO > > at LHO and CIT. > > However, /archive/dmt is not mounted on all the computers I listed. (If > you need access to DMT trend data from M7 and cannot find it under /dmt > or /archive/dmt/LHO, let Ben Johnson and myself know, and we will make > it visible.) > > At the sites, the DMT trend data is available in real-time under /dmt. > > It is available within (I think) a 6 hour latency under /archive/dmt, > and within (I think) 24 hours at CIT under /archive/dmt. > > 5. Minute and Second trend data is archived under > > /archive/frames/trend > > I think this data is available within a 6 hour latency at the sites and > within 24 hours at CIT. > > 6. Raw and trend data is available in real-time at the sites under > /frames from most of the computers I listed above. > > Raw full-frame data is under /frames/full. > > Minute and second trend data is under /frames/trend. > > 7. When accessing data under /archive, you may encounter the following > message: > > "file temporarily unavailable on the server, retrying..." > > This means the file is on tape and is being staged to disk. This may > take a minute or two to complete. If it takes longer than 30 minutes, > talk to either Greg Mendell or myself about it. The tape drive status > page(s) can be found at > > http://www.ldas.ligo-wa.caltech.edu/ldas_outgoing/archiver/Status_Pages/tape_status.html > http://www.ldas.ligo-la.caltech.edu/ldas_outgoing/archiver/Status_Pages/tape_status.html > > > (Ignore "notrdy" messages under "State", these are normal.) > > 8. If you need help, please send an email to ldas_admin_all@ligo.caltech.edu > > Cheers, > Greg > -- Gregory Mendell | Ph: 509-372-8300 ext. 189 | Fax: 509-372-8137 LIGO Hanford Observatory, PO Box 159, MS S9-02, Richland WA 99352 http://www.ligo.caltech.edu | http://www.ligo-wa.caltech.edu