Joint Astronomy Centre
Show document only
JAC Home
JCMT
UKIRT
Contact info
JAC Divisions
OMP
Outreach
Seminars
Staff-only Wiki
Weather
Web Cameras
____________________

Observing at UKIRT
Service Observing
UKIDSS Survey Operations
Target of Opportunity
Calibration & Utilities
UKIRT Archive
Public wiki
Accessing Flexed Data
Accessing UKIDSS Data
Reduction Cookbooks
Telescope
Site Quality
Instruments
Newsletter/Publications
UKIRT Faults
JAC Safety Manual

The UKIRT Observatory Reduction and Acquisition Control (ORAC) Project

Gillian Wright1, Alan Bridger1, Frossie Economou2 and Malcolm Currie1

1 : Royal Observatory Edinburgh, Blackford Hill, Edinburgh EH9 3HJ, UK

2 : Joint Astronomy Centre, 660 N. A'ohoku Place, Hilo, Hawaii 96720, USA

 

1. Introduction

The ORAC project has been set up to improve the efficiency and ease of observing at UKIRT.  All of the software that currently interacts with the observer will be replaced with a modern, user friendly, UNIX based system.  As well as providing a better, more efficient, user-interface to UKIRT, the observatory control system will define a standard
software interface for all future UKIRT instruments.  This, together with the use of pre-existing software for data reduction, will streamline the instrument software support requirements for UKIRT operations.

The project team consists of Alan Bridger (Project manager, software design), Gillian Wright (project scientist), Frossie Economou, and Malcolm Currie.  In addition the Michelle and UIST teams at ROE are contributing software, and the UKIRT support scientists and project scientists are participating the specification.  The external project scientist is Andy Adamson of the University of Central Lancashire. All of the documentation for the ORAC project, including scientific and technical specifications, is publically available on the WWW at: http://www.roe.ac.uk/abwww/orac/, with a mirror site on the UKIRT software group pages at /UKIRT/software/orac/.

The project has three main components: a new observation preparation system; a new overall observatory control system; and a new flexible on-line data reduction system. The figure shows schematically how the new system will look when it is completed, and in the following sections we describe very briefly what the new components will do. The system is based around the concept that an observation can be described by an "Observation Definition" that consists of:
 

  1. an instrument configuration (much like a current "Config")
  2. a target description (source position, cross-head offsets)
  3. an observing sequence (a generalised "EXEC", that describes the sequence of telescope moves and exposures needed)
  4. a data reduction recipe (the steps for reducing the data)
  5. scheduling information (e.g. seeing, priority)
These components can be thought of as modules that can be combined in multiple observation definitions. So, you always use the same pattern of telescope moves and exposures (cf. quad_slide in a CGS4 EXEC), you don't have to write a new EXEC for each instrument configuration or each source as you do at present.  The Observatory Control System (OCS) reads the Observation Definitions, distributes the information to the appropriate sub-systems and carries out the specified actions. The ORAC system is intended to provide more capability, with efficient and flexible software, while retaining the flavour and functionality of the current system.
** ORAC Schematic Diagram **

2. Observation Preparation System.

The new UKIRT Observation Preparation System will replace the functionality of UKIRT_PREP with a number of improvements and additions. For example it will be possible to run it from your home institute before observing and it will have a modern GUI interface, allowing easy selection and modification of components of an observation definition.

The system will be based on the Gemini Phase-2 Observing Tool (which will provide remote observation preparation for Gemini).  We are collaborating with the Gemini team to produce a UKIRT version of their system.  The idea is that although the menu choices presented to you will be UKIRT specific (e.g. CGS4 items), much of the underlying software will be in common between the two systems, and the overall "look and feel" will be the same (e.g. the same icon will be used for instrument configuration in both cases).  Obviously this might mean some stylistic compromises for UKIRT, but there are many advantages. For example, the Gemini observing tool has a very powerful and useful position editor for defining mosaics, guide-star selection, etc., which could not be recreated for UKIRT within the effort available to the ORAC project.

The top level of the user-interface will be very astronomically orientated, allowing auto-selection of instrument parameters if desired. There will be libraries of standard instrument configurations and observing sequences to select from.  The output will be checked for inconsistencies and errors and the software will warn you of potential problems. For example it will check that CGS4 grating orders are suitable for the selected wavelength.  Once created the programme file will be stored in (submitted to) the UKIRT observing database.
 

3. Observatory Control System

The Observatory Control System (OCS) performs the sequencing role between the instruments and telescope, and will also control the scheduling of observation definitions.  The use of EXECs at UKIRT already automates some sequencing, but the new system will have the capability of doing much more.  It will be possible to run two instruments  simultaneously, though with only one of them having access to telescope control functions, which should make instrument switches for over-rides and during service observing more efficient and easier.  It will also be possible to carry out some operations of a sequence in parallel - for example reconfiguring an instrument while nodding the telescope (obviously the desirability of this depends on the instrument). The OCS will be backwards compatible for CGS4 and IRCAM. It has two main components: a Scheduler and the Observation Sequencer.

The function of the Scheduler is to determine which observation to perform next and to provide this information to the sequencer. The initial version of the Scheduler will be a simple user interface that allows you to list the available Observation Definitions and select which one to do next.  Eventually the Scheduler could maintain a queue of Observation Definitions, and you would manipulate the queue to control the system for normal observing.  A fully developed Scheduler would automatically create the queue, based on the scheduling information provided in your Observation Definitions, so that the system could be used for queue-scheduled observing.

The Observation Sequencer can be thought of as broadly equivalent to the EXEC handling portion of the current software, with some enhancements. It informs instruments of their required configuration and sequences a set of operations to generate a particular observation - e.g. set to the configuration, take an exposure, offset the telescope, take another exposure etc.
 

4. Data Reduction System

While CGS4DR has been successful in allowing users to assess the quality of their data, there are a number of desired improvements which are not easy to achieve with the current design.  Examples include changes to correct for tilted and distorted spectra or to extract cross-dispersed spectra from future instruments.  In addition there is a need to extend automatic reduction to imaging instruments. From the operational point of view CGS4DR is a large body of code requiring support and it would be more efficient for UKIRT if pre-existing software, supported elsewhere, could be used to provide auto-mated reduction.  To provide both increased flexibility and reduced support requirements, the new ORAC data reduction system will use a "pipeline" to control existing data reduction packages.

The design is based on the concept of Recipes and Scripts.  A Recipe is a series of high level instructions detailing how to perform a complex series of data reduction operations.  A Script is a set of instructions (code) implementing a particular recipe in a given data reduction package.  The user will request a particular reduction sequence by drawing from a series of pre-defined Recipes.  Standard observing sequences such as photometry jitter patterns and nodding along the slit will have corresponding standard reduction Recipes. The name of the Recipe to use will be obtained by the Observatory Control System from the Observation Definition, and written into the data file header.  A pipeline manager will detect the arrival of new data on disk, read the Recipe name from the header, send the necessary messages to run the scripts for the appropriate data reduction package and hence reduce the data.  Initially the data reduction will be carried out by the major packages supported by Starlink (KAPPA, FIGARO, CCDPACK, PHOTOM) and the data format will be NDF.
 

5. Timescales

The modules that make up the ORAC system will be delivered to UKIRT in phases, so that the observatory software will gradually evolve into the new form. The first functional versions of the preparation system and data reduction will be delivered in the summer of 1998, to be in place for the arrival of UFTI.  In this initial version, the Gemini Observing Tool output will be translated into Configs and EXECs off-line, and the data reduction system will not have its full functionality.  The observing sequencer, the first version of the scheduler, and the complete data reduction system are targeted for delivery towards the end of 1998 along with Michelle.  It is intended that Michelle will be the first instrument at UKIRT for which the user-interface is the full ORAC system.  Since the observatory control system has been designed with backwards compatibility in mind, CGS4 and IRCAM control software will be modified to run from ORAC after it has been commissioned with Michelle.  Delivery of a more sophisticated scheduler depends on the outcome of a design study in early 1999 and on how future plans for UKIRT develop.  It could be used by observers as a tool for planning and carrying out a night's observing more efficiently, as well as for queue scheduled modes of operation if they are desired.
 

Back to the Contents

Contact: Chris Davis. Updated: Thu Dec 23 14:50:14 HST 2004

Return to top ^