• Mitchell, Daniel
• Bastholm, Eric
• Ord, Stephen
• Lenc, Emil
• Van Diepen, Ger
• Whiting, Matthew
• Khoo, Jonathan
• Collins, Daniel
• Wu, Xinyu
• Marquarding, Malte
• Bannister, Keith
• Lahur, Paulus
• Maher, Tony
• Voronkov, Max
• Guzman, Juan

Abstract

ASKAPsoft, the ASKAP Science Data Processor, provides data processing functionality, including:* Calibration * Spectral line imaging * Continuum imaging * Source detection and generation of source catalogs * Transient detectionASKAPsoft is developed as a part of the CSIRO Australian Square Kilometre Array Pathfinder (ASKAP) Science Data Processor component. ASKAPsoft is a key component in the ASKAP system. It is the primary software for storing and processing raw data, and initiating the archiving of resulting science data products into the data archive (CASDA).The processing pipelines within ASKAPsoft are largely written in C++ built on top of casacore and other third party libraries. The software is designed to be parallelised, where possible, for performance.ASKAPsoft is designed to be built and executed in a standard Unix/Linux environment and core dependencies must be fulfilled by the platform. These include, but are not limited to, a C/C++/Fortran compiler, Make, Python 2.7, Java 7 and MPI. More specific dependencies are downloaded by the ASKAPsoft build system and are installed within the ASKAPsoft development tree. Specific to the Debian platform, after a standard installation of Debian Wheezy (7.x) the following packages will need to be installed with apt-get:* g++ * gfortran * openjdk-7-jdk * python-dev * flex * bison * openmpi-bin * libopenmpi-dev * libfreetype6-dev * libpng12-devMore information regarding the building, installation and running of the software can be found in the README file in the root of the file structure that forms this collection.Source code can be accessed via the links in Related Materials section.----- A major release, addressing a number of issues with the processing software and the pipeline scripts.Pipelines:* When multiple raw MSs are provided for a given beam (split up byfrequency range), the pipeline is capable of recognising this,merging (after any necessary splitting), and handling all requiredmetadata appropriately. The functionality should be the same nomatter the structure of the raw data.* The selfcal job allocation (for the sbatch call) has been alteredto request a number of nodes, rather than cores +cores-per-node. This should provide more predictable allocations.* The weights cutoff parameter given to Selavy is now fullyconsistent with the linmos cutoff.* Fixed a bug that meant the raw data was overwritten whencalibration was applied, even when KEEP_RAW_AV_MS=true.* The TELESCOP keyword is now added to the FITS headers.* A bug was fixed that was preventing the full-resolution MSs beingincluded in the CASDA upload.* New parameters SPECTRAL_IMAGE_MAXUV and SPECTRAL_IMAGE_MINUV thatallow control over the UV distances passed to the spectral imager.* Various improvements to the gatherStats job, so that it will stillrun after the killAll script has been called, and that looks forthe pipeline-errors directory before trying to use it.* Making the cubeStats script more robust against failures of asingle process (so that it doesn't hang but instead carries on asbest it can).Processing:* Imaging:- Fix a coordinate shift that was seen in spectral imaging, due to adifferent direction being provided by the advise functionality.* Calibration:- Efficiency improvements to ccalapply to help speed it up* Utilities:- Adjustment of the maximum cache size in mssplit to avoidout-of-memory issues- Trimming down of the pointing table in MSs produced by msconcat,so that very large tables do not result.* Selavy:- The restoring beam is now written into the component maps.- A significant change to the handling of the initial estimates forthe Gaussian fits, making it more robust and avoiding downstreamWCS errors that were hampering the analysis.- Minor catalogue fixes for component & HI catalogues- Segfaults in selfcal (3145)

Topics

• impedance spectroscopy
• mass spectrometry
• atom probe tomography