next up previous
Next: Measuring the Image Quality Up: Simulations Previous: Simulations

The Simulations Themselves

The simulations were done entirely within AIPS, using UVSIM to produce the data sets, UVMOD to replace the uv data by random noise, and UVSUB to add in the model. Since we are primarily interested in the effects of uv-coverage, systematic errors (e.g. calibration and pointing errors) which could muddy the waters were not included. However, the deconvolution routines, being intrinsically non-linear, might lead to different results for different signal-to-noise ratios, so the simulations do include random, thermal noise. The parameters of the simulations were as follows:

$\bullet$
Frequency: all simulations were carried out at a nominal frequency of 1.42 GHz. This is basically irrelevant but leads to more concrete source sizes, resolutions, etc. This choice also facilitates the comparison of these simulations with previous work, which has all been carried out at this nominal frequency.
$\bullet$
Configurations: the uv-coverage is that of the C, CS (as in 1997), C-2, and CS-2 configurations, for a long synthesis (HA= $\pm4\rm\,hours$) and a 6-minute snapshot (HA= $0.0-0.1\rm\,hours$). The source was taken to be at $\delta=60^\circ$. The integration time was 30 seconds, and the source was observed continuously, i.e. no time was removed to simulate calibrator scans.
$\bullet$
Thermal noise: Gaussian noise with rms 8.3 mJy per 30s visibility was added independently to every baseline, simulating the VLA's thermal noise at 20cm as given in the Observational Status Summary. Unless otherwise noted, all simulations of a given configuration were carried out using the same noise realization. The tests described in §[*] show that this does not affect the results.
$\bullet$
Models: ideally the simulations should span the range of sources which might be imaged with the C/CS configuration, concentrating on those sources which in size and complexity might be expected to be most sensitive to the possible shortcomings of CS configuration, as outlined in the introduction. I took this to mean that the sources should be very complex, reasonably strong, and characteristic of typical sources imaged by the VLA. Unfortunately each suite of simulations takes quite a bit of time, so only a few sources could be used. Here I chose two of the best images yet made with the VLA, based on four-configuration observations of the supernova remnant Cassiopeia A (Cas A; donated by Rick Perley) at 20cm and the radio galaxy Cygnus A (Cyg A; donated by Chris Carilli) at 6cm. These were both VTESS models made at very high resolution (1.3 arcsec for Cas A; 0.5 arcsec for Cyg A).
$\bullet$
Imaging and Deconvolution: There are many different ways of weighting the data when Fourier transforming, and several important variations in deconvolving the resulting images. For instance, it might be argued that large, bright sources would be best deconvolved with some variety of MEM, while faint, small ones should be subjected to CLEAN; and in practice big, bright objects are likely to be worked on for many days in order to obtain the best possible images, with several versions of those images produced to best match the desired science. Simulations, involving many data sets and no direct scientific return, cannot practically be subjected to the same scrutiny as real data. My approach here has been to adopt a single, simple way of making the images, which seems not too different from what typical observers might actually do for at least a first stab at the processing. In particular, all images were made using the AIPS task IMAGR with the following parameters: The choice of deconvolution method is one of the main sources of uncertainty in the results of these simulations - the resulting CLEAN models differ from the truth images in ways characteristic of well-known CLEAN instabilities (see below), and one would expect changes in the deconvolution algorithm to lead to changes in the fidelity of the maps. Some comparisons with VTESS are given below (§[*]).
$\bullet$
Convolving to a Common Resolution: As discussed below, the available measures of image quality vary considerably with the resolution, and to compare configurations one must compare images made at the same resolution. Holdaway (1998, priv. comm.) does this using one of Dan Briggs' very pretty programs in SDE, which figures out how to weight the uv-data to give any (reasonable) desired beam size. Unfortunately this is not yet available in AIPS, and in the interests of simplicity3 I simply convolved the CLEAN images (with residuals restored) to a common Gaussian beam using CONVL. This will introduce some errors because the residuals do not have the same point-spread-function as the CLEAN components, but for the deep CLEANs considered here this should be a small effect. At any rate the fidelity seems reasonably robust to minor differences in the restoring beams.

These simulations are summarized in Tables 1-4, with a few sample contour plots of the resulting images and difference maps (simulations-truth) shown in Figures [*]-[*]. In all cases IMAGR recovered the proper total flux density was recovered to within 1%; the case of VTESS is covered below (§[*]). The contour plots are not terribly informative, except to show that these four configurations all produce images which appear visually to be of similar (and reasonable) quality. Even the snapshots, although rather `blotchy,' recover the main, and even some of the subtler, features of the sources. The difference maps basically illustrate the tendency of CLEAN to produce a mottled structure4, as well as (in the case of snapshot observations of Cas A) the alternating positive/negative ripple characteristic of CLEAN when applied to a large, bright disk. For Cas A in particular one might expect MEM to do a better job, and the two deconvolution algorithms are compared for a few sample simulations in §[*] below.

In sum, there are no major, obvious differences between images made with C or CS configuration of small or moderate-size sources: as expected, any differences due to the change in intermediate baselines are subtle. I therefore turn next to quantitative measurements of the image quality.


next up previous
Next: Measuring the Image Quality Up: Simulations Previous: Simulations
Stephan Witz 2003-04-15