Joint Astronomy Centre
Show document only
JAC Home
JCMT
UKIRT
Contact info
JAC Divisions
OMP
Outreach
Seminars
Staff-only Wiki
Weather
Web Cameras
____________________

JCMT home
Observing at JCMT
OMP Observation Manager
Telescope
Spectral Line Observing
Continuum Observing
Schedule
Data Archive
Future Developments
Legacy Surveys
Newsletter & Publications

A Note on Observing Overheads

In the widely-circulated report of the most recent meeting of the JCMT Advisory Panel (on June 12) it is stated that"...overheads on typical heterodyne observations have decreased from 40% to 20%". These numbers were provided by a JCMT Staff Scientist very soon after the new control computer was installed; in fact they refer to 'wasted' time as defined here. Since prospective observers may be tempted to base their time requirements on this statement some clarification is in order. In the general sense implied, for most line observations, such a major decrease is NOT the case, although there has been some improvement over the past year due to upgrades in hardware and a considerable software effort. The principal improvement has in fact come from the introduction of raster ('on-the-fly') spectral line mapping, and users should seriously consider using this mode where appropriate. Below I consider some specific common examples of observing overheads, and comment on the overall efficiency of observing.

What I have done is look through some recent observing sessions, mostly those with which I have been closely involved. Generally, I have used sequences of scans which have been more or less continuous, that is, there has been essentially no dead time due to uncertainty on the part of the observer or some other delay. Usually in such cases, an ICL procedure has been active, or the Telescope Operator has typed ahead to allow several observations to proceed without additional intervention. In such cases the dead time does not exceed a few seconds. I calculate the elapsed time (Te) for an average scan to complete in such a sequence, and any software/hardware overhead in starting a scan is naturally included. The total integration time (Ti) requested is known from the observing log (e.g. the JOURNAL program) and the on-source (signal phase) time (Ts) can be derived knowing the observing mode. Then I derive the overhead (Over), defined as (Te - Ti)/Ti, the on-source efficiency (OSE), given by Ts/Te, and the 'wasted' time, defined as (Te - Ti)/Te. 'Wasted' time is the time when the system is not recording data of any kind.

Case	Rx	Mode	sec/cyc	Te	Ti	Ts	Over	OSE	wasted	Notes

1 A2 PSSW 60x10 14:25 10:00 5:00 44 35 31 switch 20'

2(a) B3i BMSW 60x10 13:35 10:00 5:00 36 37 26 with cal.

(b) 12:40 10:00 5:00 27 39 21 w/o cal.

3 B3i FRSW 60x10 11:20 10:00 10:00 13 88 12 hardw.fr.sw.

4(a) C2 BMSW 60x10 14:46 10:00 5:00 48 34 32 with cal.

(b) 13:23 10:00 5:00 34 37 25 w/o cal.

5(a) A2 Raster 3x59x15 61:00 50:00 44:15 22 73 18 May 20

(b) 58:00 50:00 44:15 16 76 14 June 25

(c) 58:30 50:00 44:15 17 76 15 July 29

6 UKT14 Raster 1x61x77 86:00 78:17 78:17 10 91 9 dual-beam

Most of the entries in this table are self-explanatory, particularly for those with some experience of observing with the JCMT. PSSW, BMSW, FRSW are position-, beam- and frequency-switching respectively. 'Raster' refers to the 'on-the-fly' continuous scanning mode. Particulars relating to the various examples are given in the last column. 'With' and without ('w/o') cal(ibration) refers to whether an off- source calibration is done prior to the scan or not. Generally the latter is the norm, now that continuous calibration has been enabled with the DAS.

In preparing proposals the prospective user will be most interested in the 'overhead' column. If you have calculated the total integration time (Ti; sig. + ref.) then a typical observation will take that much percentage longer to actually perform. The OSE column tells you how much of the elapsed time is actually spent on source. Most of the common modes split the integration time 50-50; the rastering and frequency-switching modes spend most, or all, of the time on-source, respectively. For UKT14 dual-beam raster maps, included for comparison, both beams are included in the map, and so almost no time is lost.

The most inefficient modes are position-switching (the actual overhead depends somewhat on the distance to the reference), and C2 observations with intervening calibration (the calibration action is very slow in the hardware). The on-source efficiency is also low for these modes. The modes with the lowest overhead, and the highest on-source fractional times are frequency-switching and rastering. With the latter note that for a spectral line raster each row of n points, t secs per point, is accompanied by a reference spectrum of length tÖ(n) secs. Three instances of case 5 are given for different dates; similar obs. were done on the same source. Case 5(a) appears to have significantly higher overhead than either of the other two. Probably this is due to software development of the procedure in the interim. However, there is no difference between cases 5(b) and 5(c). This may be interesting, in that the later data were taken with a faster telescope control computer (VAX 4000/90 vs 4000/60).

This table illustrates the point that the spectral line overhead is anywhere in the region between about 13% and almost 50%. 20% is not a representative number. My experiments, incomplete as they are, do however suggest that for these standard modes, one should be able to scale the results to arrive at sensible estimates of elapsed time. The position- and beam-switching and raster modes are independent of the receiver being used. They also say that there has been a significant improvement in overhead since the last version of the Guide for the Prospective User was made available (25th January).

Finally, it is of interest not just to calculate the efficiency of individual scans, but also of a complete observing shift. I have modified the JOURNAL routine to do this (new version available soon). What it reports is that, for the few shifts I have examined in developing the program, the telescope is gathering photons for typically 55-65% of the time elapsed between the beginning of the first scan and the end of the last. This includes pointing and focus measurements. However, the program has no knowledge of what happened before the first scan started, although it does make a guess as to when the last scan ended. If one adds on the 15-30 minutes taken to set up the system, open doors and roof, tune receivers and so on, then one arrives at the estimate of the total time needed for a given program is approaching twice that of the total integration time needed. Experienced observers have felt this in their bones for a long time, but now I can prove it.

Henry Matthews, JAC

Information Coordinator

Contact: Jonathan Kemp. Updated: Tue Aug 17 17:32:17 HST 2004

Return to top ^