CSIRO Computing History, Chapter 5

Introduction

By early 1989, it was probably clear to all that CSIRO science research was not going to be well served by PAXUS, with its decision to go to an all IBM-compatible host services.  Pressure was probably mounted by the Divisions with large computing needs (e.g. Atmospheric Research), for a replacement system and service for the Cyber 205 and CSIRONET.  The CSIRO Policy Committee on Computing managed the policy on CSIRO computing facilities. In 1989, it set up the Supercomputing Facilities Task Force (SFTF), to decide on follow-on facilities from the Cyber 205.

The ETA options

In 1989, CSIRO, and in particular the Division of Atmospheric Research, was looking at options to replace the Csironet Cyber 205 (although by then CSIRO had taken over ownership).

CDC had spun off a new company, ETA Systems, to develop a compatible follow-on product from the Cyber 205, producing a range of four systems – ETA-10E ETA-10G, ETA-10P and ETA-10Q – the first two being immersed in liquid nitrogen to allow for higher clock speeds, and the others being air-cooled.  Each machine used one of more common single-board processors.

The Bureau of Meteorology had ordered an air-cooled model.

Unfortunately, on 17 April 1989, CDC/ETA announced the closure of ETA systems.  There were offers made for CSIRO and in particular DAR to host an ETA system as an interim solution.

Papers documenting the negotiations have been scanned.

SFTF

This was set up in early 1989, and was chaired by Mike Coulthard from CSIRO Applied Geomechanics. Other members of the team included Charles Johnson from Materials Science and Technology, Bob Smart from the Division of Information Technology, Robert Bell from the Division of Atmospheric Research, Dick Manchester from Radiophysics, David McCullough from Administration, and with Peter Price from the ACSG and Jose Varghese from Biotechnology contributing. CSIRO issued a call for expressions of interest, asked for a replacement for the 205, that had to be faster, run UNIX, had 10 Gbyte of disc storage, with a few other criteria.

Benchmarks were developed to allow vendors to demonstrate performance.

Proposals were received from CDC (ETA), Convex, Cray Research (one for an X-MP, one for a Y-MP in conjunction with Leading Edge Technologies), IBM and Fujitsu.

Proposals from Cray and Convex were short-listed, and Bob Smart and Rob Bell left on 29th July 1989 to visit Purdue University, CDC, Cray Research, Convex and the National Center for Atmospheric Research, to carry out benchmarking, and to gather information.

At Purdue, Bob and Rob evaluated an ETA-10 running UNIX. After about half the benchmarks didn’t even compile, it was clear that although the ETA-10 might have been an attractive follow-on from the 205, that this was a lost cause, with CDC pulling the plug on the ETA enterprise in April 1989. A visit to CDC in Minneapolis gave no further assurance. (As an aside, while walking around Purdue on a Sunday afternoon, Bob went in pursuit of a network link, and found a staff member who was logged in.  Bob exchanged messages with Robert Elz at the University of Melbourne, who was on-line.  Bob asked about the cricket test match which was in progress – a crucial match in the Ashes series.  Robert Elz reported on Australia’s score which indicated that the Ashes had been won – this was an important demonstration of the usefulness of the Internet!)

Bob and Rob then visited Cray Research, Convex and NCAR.  (Still jet-lagged after travelling on 4 flights in one day on a long Saturday, Bob and Rob arrived at Cray on the following Tuesday afternoon to find that benchmarking was scheduled from 10 PM to 2 AM!) At Convex, performance issues became evident in access to memory.  There also appeared to be a fault in the floating-point arithmetic.

Two propositions were then put to the PCC by the SFTF: one a proposal from Convex for several of its C series vector machines, and a proposal from Cray Research and Leading Edge Technologies to share in a 2-processor Cray Y-MP.  (A proposal from Cray Research for a CSIRO-only Cray X-MP was not recommended.)

At a meeting in August 1989, the PCC decided on the Cray Research/Leading Edge Technologies shared Cray Y-MP proposal.  (This happened while Bob Frater, the PCC chair, was absent from the meeting to attend an event at CSIRO Radiophysics, and Alan Reid took over as chair.)  Minter Ellison was called on to do due diligence on LET.

See https://news.google.com/newspapers?nid=1300&dat=19891113&id=mQAzAAAAIBAJ&sjid=pJEDAAAAIBAJ&pg=5570,5349828&hl=en for a report in “The Age” from 13 November 1989 about the setting up of the JSF and the Strategic Research Foundation.

(In 1989, Rob Bell analysed the CSIRO usage of the CDC Cyber 205, and found that 91% of the usage came from researchers based in the Melbourne area: given the state of network bandwidths available at the time at the dawn of AARNet, the decision was made to base the supercomputer in Melbourne).

Bob Smart wrote in 1989: “My role on that committee is to ensure that adequate networking infrastructure is provided to give CSIRO researchers convenient access to the supercomputers.”  It was clear that providing links from the researches to the supercomputer over Csironet was not an option, and that the TCP/IP networks were the way of the future.  Bob Smart advocated for CSIRO to join AARNet, which it did, and so was able to benefit from the AARNet backbone connecting the capitals, and the associated regional networks.  However, it was a busy time in early 1990 setting up access from all the CSIRO sites to AARNet, and hence the supercomputer.  Some of Bob’s advocacy and planning can be seen here.  A history of AARnet can be found here.

Then, negotiations began with LET to establish the Joint Supercomputer Facility service and the machine room to house the Y-MP (which was owned by CSIRO).  (LET already had an X-MP, and had an established seismic data processing business with Tensor Pacific.).

• The Cray Research Y-MP was installed at Leading Edge Technologies premises in 283 Normanby Road Port Melbourne in February/March 1990, with acceptance testing (16 hours per day) being run in March.  The system was opened by Barry Jones on the day before a Federal Election, and was named “cherax”. The name was chosen as a play on cherax – the scientific name for the yabby, the Australian Cray :-). We initially pronounced cherax with a starting sound like “chips”, but at the opening of the first CSIRO Cray on 23rd March 1990, Barry Jones AC FAA FACE FAHA FASSA FTSE, then Minister for Science in the Hawke government, remarked that “since the name is derived from the Greek, the pronunciation is cherax, as in chemistry” (with a hard “k” sound). We stood corrected.Here is a link to a report on the opening in CoResearch (page 29 – May 1990 page 1).
• Bob Smart arranged for the loan of a SUN system from the Division of Information Technology to act as a front-end, and set up network access.
• Here is a picture of the Y-MP.  In the foreground is the input/output system (IOS), based on Cray X-MP technology, and in Cray’s traditional shape with ‘seats’ around a ‘circular’ cabinet.  The next part is the Y-MP itself, in a rectangular cabinet.  Further back still is another red cabinet, possibly the refrigerant unit, while behind that, against the wall, is an air handler.  On the left is one of the front-end workstations.  On the right is a row of DD-49 disc units – each unit had a capacity of 1.2 Gbyte, but with access times comparable with current disc drives.  CSIRO had one unit for its entire on-line storage (1 Gbyte formatted).

• 1990-1997: Supercomputing Support Group

  This was formed in 1990, with Robert Bell being appointed as leader (initially part-time on secondment from the Division of Atmospheric Research) from May, and recruitment led to the addition of Len Makin, Marek Michalewicz and Simon McClenahan.  The group was co-located with CSIRO Division of Information Technology at its Melbourne laboratory, firstly at 55 Barry St, then from June 1991 at 723 Swanston St (with University of Melbourne, RMIT, IBM, ACCI, CITRI, etc), Carlton. The SSG reported to John O’Callaghan, Chief of the Division of Information Technology.  LET provided Help Desk services, with Eva Hatzi being appointed, and system and other management.

• On 14th November 1991, CSIRO initiated the Data Migration Facility on its home filesystem on cherax, with data being written to two 3480-compatible tape cartridges (each capable of holding about 240 Mbyte).  This provided a hierarchical storage management system, restoring to CSIRO what it had lost in the mid-1970s.  However, the tapes had to be mounted by operators, but as LET had a large tape-base operation to support field data processing for the seismic industry, the load was probably not too great.  (LET did get access to new StorageTek cartridge tape drives, which CSIRO purchased).  CSIRO staff can see a history of what became known as the CSIRO Scientific Computing Data Store here .
• By 1991, things were starting to turn bad for LET.  Martin Sachs had established the company in response to a suggestion from Barry Jones about how he could assist Australia in gratitude for what he had been able to achieve as a post-war migrant from war-torn Europe.  However, economic conditions soured (as Treasurer in 1990, Paul Keating famously described the 1990s recession as “the recession we had to have“), and a planned merger by LET with Boeing to host supercomputing services in Australia failed to come to fruition, possibly because the ‘offset’ arrangements allowing Australia to import Boeing planes in exchange for Boeing contributing to the Australian economy faltered.
• In early 1992, Rob Bell was asked by Greg Batchelor, General Manager, CSIRO ITSB (the equivalent of CSIRO’s CIO), what could be done to protect the CSIRO data at LET.  A DMF backup procedure was started, which took a copy of CSIRO’s data offsite at monthly intervals.
• In May 1992 Cray Research (Australia) took over the running of the system to continue to provide a service to CSIRO.
• It was subsequently disclosed that the Cray Research engineers had installed a secret network link to cherax, with the equipment hidden in the underfloor, to help protect the asset.
• Cray Research stepped in, and prepared a proposal to CSIRO for CSIRO to acquire another Cray Y-MP to replace the current one, for it to be hosted at the University of Melbourne, for Cray Research and the University to provide hosting and management services, and for about 10% of the resources to be made available to University users and Cray Research clients.  See the next chapter.
• LET did become bankrupt – Martin Sachs was rumoured to have lost money, and the liquidators sold off the equipment, most of which went for a song – the value was in the service around it.  Rob. Bell followed some to the auction houses, and purchased about 3500 cartridge tapes at about 20c each, compared with a new price of about $7 each.  Martin Sachs was a successful architect and builder in Melbourne – see here and Beaumaris Modern.  He died on 13 September 2020 at the age of 95 at his home in Toorak (personal communication, Eva Hatzi).

Here’s a JSF brochure:

LET’s managing director was Tom Kopp, it employed Peter Boek as general manager, Mark Watson as systems analyst, Richard Hume, and Eva Hatzi as Help Desk person (who became a favourite with many of the CSIRO users), Ken Ho Le as systems administrator and many operators.