Commit summary from repository starlink ------------------------------------ (Malcolm J. Currie) .gitgnore: KAPLIBS notes and instantiated new generic routine added. (Malcolm J. Currie) KAPLIBS: Protect against zero second moment before deriving skewness and kurtosis. 100.0% libraries/kaplibs/kpg/ (Malcolm J. Currie) KAPPA: Keep valgrind happy. (Malcolm J. Currie) KAPPA: Tidying recently changed apps. 100.0% applications/kappa/libkappa/ (Malcolm J. Currie) KAPLIBS: Wrap long lines closer to normal VMS-help width. 100.0% libraries/kaplibs/ (Malcolm J. Currie) KAPLIBS: Tidying stats o/p routines. 100.0% libraries/kaplibs/kpg/ (Malcolm J. Currie) KAPPA/KAPLIBS: Derive skewness and kurtosis in STATS. 37.3% applications/kappa/libkappa/ 12.0% applications/kappa/ 12.0% libraries/kaplibs/kpg/ 38.5% libraries/kaplibs/ (Malcolm J. Currie) KAPLIBS: Add new statistics routine to supersede KPG1_STATx. 100.0% libraries/kaplibs/kpg/ (Tim Jenness) smurf: Fix small 32-bit compiler warning 100.0% applications/smurf/libsmf/ (Tim Jenness) smurf: Remove boolean definition for the moment 100.0% applications/smurf/libsc2fts/ (Jessica Dempsey) smurf: Reference calibration SPIE paper in cookbook 100.0% applications/smurf/docs/sc19/ (Tim Jenness) smurf: Lots of typography tidying up. 100.0% applications/smurf/docs/sc19/ (Tim Jenness) smurf: Extract the correct part of the keymap in EXTINCTION 100.0% applications/smurf/libsmurf/ (Remo Tilanus) smurf: added a couple of missed figures and corrected one typo 100.0% applications/smurf/docs/sc19/ (Remo Tilanus) smurf: added Data Characteristics and Issues 100.0% applications/smurf/docs/sc19/ Commits from repository starlink ----------------------------- commit c3deeb8b48f8ff727f040c3eb56fee5c31df0e1a Author: Malcolm J. Currie <[log in to unmask]> Date: Thu Aug 5 02:18:14 2010 +0000 .gitgnore: KAPLIBS notes and instantiated new generic routine added. .gitignore | 7 +++++++ 1 files changed, 7 insertions(+), 0 deletions(-) commit b2e892ea21ed428906bab979cd12784c8258d883 Author: Malcolm J. Currie <[log in to unmask]> Date: Wed Aug 4 23:56:22 2010 +0000 KAPLIBS: Protect against zero second moment before deriving skewness and kurtosis. libraries/kaplibs/kpg/kpg_osta.gn | 18 ++++++++++++------ 1 files changed, 12 insertions(+), 6 deletions(-) commit ef12e6523f00b2c7d32f42b3bbc4f4a4079e0d9a Author: Malcolm J. Currie <[log in to unmask]> Date: Wed Aug 4 23:54:00 2010 +0000 KAPPA: Keep valgrind happy. Valgrind seems to have problems with ITYPE and DTYPE returned from various NDF routines, regarding them as uninitialised. applications/kappa/libkappa/stats.f | 1 + 1 files changed, 1 insertions(+), 0 deletions(-) commit dc3a24e1b55e3958c7517e69ea87e80b821fcbea Author: Malcolm J. Currie <[log in to unmask]> Date: Wed Aug 4 23:52:16 2010 +0000 KAPPA: Tidying recently changed apps. applications/kappa/libkappa/histat.f | 6 +++--- applications/kappa/libkappa/outset.f | 10 ++++++---- applications/kappa/libkappa/stats.f | 25 +++++++++++++------------ 3 files changed, 22 insertions(+), 19 deletions(-) commit 7c8d093dd54e190bc02b520f4a6b3df290b6aa1a Author: Malcolm J. Currie <[log in to unmask]> Date: Wed Aug 4 23:49:12 2010 +0000 KAPLIBS: Wrap long lines closer to normal VMS-help width. libraries/kaplibs/kaplibs.news | 38 ++++++++++++++++++++------------------ 1 files changed, 20 insertions(+), 18 deletions(-) commit 7d96d128e6aeb1ad9a71502872f62a813646111e Author: Malcolm J. Currie <[log in to unmask]> Date: Wed Aug 4 23:48:27 2010 +0000 KAPLIBS: Tidying stats o/p routines. libraries/kaplibs/kpg/kpg1_stds.gdr | 4 ++-- libraries/kaplibs/kpg/kpg1_stfl.gdr | 18 +++++++++--------- 2 files changed, 11 insertions(+), 11 deletions(-) commit 10afa1198abec276ad6f06d32f680afed38eb7b8 Author: Malcolm J. Currie <[log in to unmask]> Date: Wed Aug 4 23:26:16 2010 +0000 KAPPA/KAPLIBS: Derive skewness and kurtosis in STATS. Version 1.12-3 of KAPPA. Uses a recursive algorithm (see KPG_OSTAx) to calculate the population skewness and kurtosis. The standard deviation is now a population statistic, rather than the sample statistic formerly. HISTAT was altered to match the new APIs of KPG1_STDSx and KPG1_STFLx, extended by two arguments for the extra statistics. The KAPLIBS documentation updated for revised KPG1_STDSx and KPG1_STFLx, and the new KPG_OSTAx routine. The KAPLIBS version number (3.1) has been belatedly incremented. applications/kappa/component.xml | 2 +- applications/kappa/configure.ac | 2 +- applications/kappa/kappa.ifd.in | 16 + applications/kappa/kappa.news.in | 17 +- applications/kappa/libkappa/histat.f | 21 +- applications/kappa/libkappa/stats.f | 141 ++++-- applications/kappa/sun95.tex | 41 ++- libraries/kaplibs/component.xml | 2 +- libraries/kaplibs/configure.ac | 2 +- libraries/kaplibs/kaplibs.news | 17 +- libraries/kaplibs/kpg/kpg1_stds.gdr | 41 ++- libraries/kaplibs/kpg/kpg1_stfl.gdr | 45 ++- libraries/kaplibs/sun238.tex | 851 +++++++++++++++++++------------- libraries/kaplibs/sun_head.tex | 17 + 14 files changed, 793 insertions(+), 422 deletions(-) commit 9ec89e861ab3aef0ef2719b3e3ffe5adead725ee Author: Malcolm J. Currie <[log in to unmask]> Date: Wed Aug 4 19:19:59 2010 +0000 KAPLIBS: Add new statistics routine to supersede KPG1_STATx. The existing KPG1_STATx routine uses the standard one-pass formula for the variance. Sum (x_i)**2 - (Sum x_i)**2/n ----------------------------- n - 1 It has the disadvantage that it can be unstable to rounding errors for large datasets differencing two large and similar sums, even though we do compute in double precision, and there is no correction applied such as that of Bjorck. The simple two-pass algorithm while more robust, it can fall foul of concentrated data with extreme outliers, and rounding, and is less efficient too. For an entire population the denominator be the population size n; it is n-1 for a sample of observations. What is appropriate depends on the use being made. For decent n, such as normal use in KAPPA:STATS, it should make little practical difference. Since we needed skewness and kurtosis, I've written a new routine that uses Welford's recursive approach, extended to higher moments by Terriberry. It's a one-pass algorithm and more stable than before. For consistency and ease of interpretation I've stuck with population statistics. If users want sample statistics they can apply appropriate bias corrections. For kurtosis the corrections seem to vary in how to scale the 3 offset to derive excess kurtosis over pure kurtosis, and whether or not there is another term. Users can pick their favourite. libraries/kaplibs/kpg/Makefile.am | 2 +- libraries/kaplibs/kpg/kpg_osta.gn | 368 +++++++++++++++++++++++++++++++++++ 2 files changed, 369 insertions(+), 1 deletions(-) commit 6b071124e96c5d8ad501fa3ef23000d33d998068 Author: Tim Jenness <[log in to unmask]> Date: Wed Aug 4 13:30:25 2010 -1000 smurf: Fix small 32-bit compiler warning applications/smurf/libsmf/smf_iteratemap.c | 12 ++++++------ 1 files changed, 6 insertions(+), 6 deletions(-) commit 7a8b7a3bb996f8c5b0ba4e2523282c6991b51dcd Author: Tim Jenness <[log in to unmask]> Date: Wed Aug 4 13:28:42 2010 -1000 smurf: Remove boolean definition for the moment Some systems defined TRUE and FALSE themselves and the enum was being defined as 0 = 0 which doesn't really work. In the short term replace the one usage of TRUE and FALSE with 1 and 0 until a more robust solution can be found. applications/smurf/libsc2fts/fts2_isInBeam.c | 4 ++-- applications/smurf/libsc2fts/fts2_type.h | 20 +++++++++++--------- 2 files changed, 13 insertions(+), 11 deletions(-) commit e138628c2608058d9e052621999c0b5a0413758e Author: Jessica Dempsey <[log in to unmask]> Date: Wed Aug 4 12:59:13 2010 -1000 smurf: Reference calibration SPIE paper in cookbook applications/smurf/docs/sc19/sc19.tex | 9 ++++++++- 1 files changed, 8 insertions(+), 1 deletions(-) commit 4722a147cdcf9e5fcc951f097c279d0bc5f136ec Author: Tim Jenness <[log in to unmask]> Date: Wed Aug 4 11:00:44 2010 -1000 smurf: Lots of typography tidying up. Also fix "micron" in html version. applications/smurf/docs/sc19/sc19.tex | 361 ++++++++++++++++--------------- 1 files changed, 184 insertions(+), 177 deletions(-) commit 33513bb287771d39359c12bc52321b3db5da2bfe Author: Tim Jenness <[log in to unmask]> Date: Tue Aug 3 16:50:18 2010 -1000 smurf: Extract the correct part of the keymap in EXTINCTION We need the EXT keymap and not the parent keymap. applications/smurf/libsmurf/smurf_extinction.c | 8 +++++++- 1 files changed, 7 insertions(+), 1 deletions(-) commit 500bf571eb43af9e1179b062cf6f18b7eadde9de Author: Remo Tilanus <[log in to unmask]> Date: Tue Aug 3 21:28:55 2010 -1000 smurf: added a couple of missed figures and corrected one typo applications/smurf/docs/sc19/sc19.tex | 2 +- .../smurf/docs/sc19/sc19_concln_smallmap.eps | 6598 +++++++++++++++++ .../sc19_dimmconfig_bright_compact_smallmap.eps | 6638 ++++++++++++++++++ 3 files changed, 13237 insertions(+), 1 deletions(-) commit 315d927286cbca63dd7299c6e9a585f93cb9de5d Author: Remo Tilanus <[log in to unmask]> Date: Tue Aug 3 21:21:15 2010 -1000 smurf: added Data Characteristics and Issues applications/smurf/docs/sc19/sc19.tex | 654 +- .../smurf/docs/sc19/sc19_bsl_histogram.eps | 2118 + applications/smurf/docs/sc19/sc19_con_collapse.eps |11576 + applications/smurf/docs/sc19/sc19_con_smallmap.eps | 6651 + .../smurf/docs/sc19/sc19_conbsl_astres_13_12.eps | 4096 + .../smurf/docs/sc19/sc19_conbsl_astres_13_26.eps | 4307 + .../smurf/docs/sc19/sc19_conbsl_astres_19_19.eps | 4378 + .../docs/sc19/sc19_conbsl_astres_medianmsk.eps | 7064 + .../smurf/docs/sc19/sc19_conbsl_astres_rmsmsk.eps | 7080 + .../smurf/docs/sc19/sc19_conbsl_collapse.eps |11576 + .../smurf/docs/sc19/sc19_conbsl_gainmsk.eps | 7105 + .../smurf/docs/sc19/sc19_conbsl_smallmap.eps | 6638 + .../smurf/docs/sc19/sc19_dimm_common_mode.eps | 2691 + .../smurf/docs/sc19/sc19_gain_histogram.eps | 1663 + .../smurf/docs/sc19/sc19_sc2clean_13_31.eps | 2624 + .../smurf/docs/sc19/sc19_sc2clean_16_33.eps | 2433 + applications/smurf/docs/sc19/sc19_timeseries.eps |192279 +++++ applications/smurf/docs/sc19/sc19_timeseries2.eps |192279 +++++ .../smurf/docs/sc19/sc19_tracking_actual.eps |693437 +++++++++++++++++ .../smurf/docs/sc19/sc19_tracking_demand.eps |693511 ++++++++++++++++++ 20 files changed, 1854153 insertions(+), 7 deletions(-)