JiscMail Logo
Email discussion lists for the UK Education and Research communities

Help for STARLINK Archives


STARLINK Archives

STARLINK Archives


STARLINK@JISCMAIL.AC.UK


View:

Message:

[

First

|

Previous

|

Next

|

Last

]

By Topic:

[

First

|

Previous

|

Next

|

Last

]

By Author:

[

First

|

Previous

|

Next

|

Last

]

Font:

Proportional Font

LISTSERV Archives

LISTSERV Archives

STARLINK Home

STARLINK Home

STARLINK  October 2006

STARLINK October 2006

Options

Subscribe or Unsubscribe

Subscribe or Unsubscribe

Log In

Log In

Get Password

Get Password

Subject:

Re: defringing with starlink

From:

"Malcolm J. Currie" <[log in to unmask]>

Reply-To:

Starlink Software User Support <[log in to unmask]>

Date:

Mon, 2 Oct 2006 20:21:43 +0100

Content-Type:

TEXT/PLAIN

Parts/Attachments:

Parts/Attachments

TEXT/PLAIN (88 lines)

John,

This isn't something I've done for many years... however, since nobody
else has spoken I'll try to help.  There may be other algorithms
developed in recent years.  If there's one in particular you'd like to
recreate and it's not as described below, please mail again with
details and/or a citation.

> I'm trying to build a pipeline for wide-field data reduction and at
> the moment I'm dealing with the problem of fringes subtraction.

Have you seen ORAC-DR?  This offers the infrastructure freeing you to
concentrate on the details of the processing steps.  It's modular too,
making it easy to insert extra steps.  www.oracdr.org.

As ever much depends on the details.  I take it that you want something
automatic, i.e. no manual intervention.  It does depend what calibration
data you have.  Will your pipeline have fringe maps made by combining
lots of frames say at the start of the night?  Are the fringe maps
stable?  Can you use one from an earlier night?  Do you need to process
in realtime?

The general principle is to make a `superflat'.  This superflat often
reveals gradients in the background (e.g. from light leaks or a nearby
very bright source) or the fringe pattern.

A superflat is created by combining for each filter many flatfielded and
normalised empty or sparse fields, or even the whole night's exposures.
I wouldn't recommend the second unless the frames are devoid of bright
stars and large (with respect to the the frame size) galaxies.  See
CCDPACK:MAKECAL and the like.  You must filter well to reject outliers,
say clipped mean to get a mode, or a median filter if the density of
sources isn't high.  My preference is to pass the superflat frames
through (S)EXTRACTOR first to identify the sources to a faint isophote
and then, using the created catalogue, mask the sources before combining
frames.  That might be trickier if you have strong fringes;
you'd make a first estimate of the fringe pattern without object
masking, apply the fringe correction, mask the objects and repeat.  If
the fringe signal is weak you could want to mask first.

The next step is to extract the fringe pattern from the superflat, or
put another way take out the sky background and large-scale variations.
Some people also like to apply a large-kernel smoothing filter
(KAPPA:BLOCK) to the superflat and subtract the unsmoothed superflat to
make the fringe map (KAPPA:SUB).  It's a form unsharp masking.  SURFIT
could work too if you choose the parameters wisely, i.e. not track the
fringes.  Like many problems you have to experiment and prototype with
actual data to discover what works best in practice.  There's a new task
in the new package CUPID, called FINDBACK that might do a good job too.

Since the amplitude of fringe pattern scales with the sky background you
could determine a representative sky level for a frame (perhaps
EXTRACTOR then KAPPA:HISTAT and PARGET to obtain the median value) and
likewise for the smoothed superflat.  Then you subtract the fringe
pattern times the ratio of these two representative sky levels
(KAPPA:MATHS).

If you were looking for a single routine for de-fringing in Starlink
unlike IRAF, I think you'll be disappointed.  Even CCDPACK does not have
one.  There are too many variables.  Thus in Starlink our approach was
towards elemental applications that could be strung together to achieve
complex reductions.  There was an interactive task in the original
Starlink Interim environment over two decades ago called FRINGE that let
you select a clear region of sky in which to scale the fringe pattern
rather than using a global frame value.  This approach is no good if you
want an automated pipeline.

> Also I want to ask if it is harmless (and of course if it is better) to
> subtract the sky(after fringe correction) using Kappa's SURFIT
> before any photometry mesurements take plase.

It does depend on what you're going to do with the final reduced frames
and the analysis software applied to it.  If you want to measure the
brightnesses, sizes, and shapes of the objects, then EXTRACTOR has a
SURFIT-like sky-estimation step so that it knows the local sky levels.
PHOTOM works in relatively small areas and it determines the sky from an
annulus about a source or from specified regions.  Now if your
photometry package divides by the sky, as one widely used package from
Oxford did, then removing the sky would not be a good idea.  I generally
don't use SURFIT in that way.

I hope that you can follow my English and the above helps.  I've not
gone into great detail about commands and parameters because I don't
have enough information about your particular data, requirements, and
analysis goals.

Malcolm Currie

Top of Message | Previous Page | Permalink

JiscMail Tools


RSS Feeds and Sharing


Advanced Options


Archives

December 2023
November 2023
August 2023
July 2023
May 2023
April 2023
March 2023
February 2023
January 2023
November 2022
October 2022
August 2022
July 2022
June 2022
April 2022
January 2022
December 2021
October 2021
May 2021
February 2021
November 2020
October 2020
August 2020
July 2020
June 2020
February 2020
November 2019
October 2019
September 2019
July 2019
June 2019
May 2019
April 2019
March 2019
December 2018
November 2018
October 2018
September 2018
July 2018
June 2018
April 2018
January 2018
December 2017
October 2017
August 2017
July 2017
April 2017
March 2017
February 2017
January 2017
December 2016
November 2016
September 2016
July 2016
June 2016
April 2016
March 2016
February 2016
December 2015
November 2015
October 2015
September 2015
May 2015
April 2015
March 2015
February 2015
October 2014
August 2014
July 2014
June 2014
May 2014
March 2014
February 2014
January 2014
December 2013
November 2013
October 2013
September 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
February 2013
January 2013
December 2012
November 2012
October 2012
September 2012
August 2012
July 2012
June 2012
May 2012
April 2012
March 2012
February 2012
January 2012
December 2011
November 2011
October 2011
September 2011
August 2011
July 2011
June 2011
May 2011
April 2011
March 2011
February 2011
January 2011
December 2010
November 2010
October 2010
September 2010
August 2010
July 2010
June 2010
May 2010
April 2010
March 2010
February 2010
January 2010
December 2009
November 2009
October 2009
September 2009
August 2009
July 2009
June 2009
May 2009
April 2009
March 2009
February 2009
January 2009
December 2008
November 2008
October 2008
September 2008
August 2008
July 2008
June 2008
May 2008
April 2008
March 2008
February 2008
January 2008
December 2007
November 2007
October 2007
September 2007
August 2007
July 2007
June 2007
May 2007
April 2007
March 2007
January 2007
November 2006
October 2006
September 2006
August 2006
July 2006
April 2006
March 2006
February 2006
December 2004
September 2004


JiscMail is a Jisc service.

View our service policies at https://www.jiscmail.ac.uk/policyandsecurity/ and Jisc's privacy policy at https://www.jisc.ac.uk/website/privacy-notice

For help and support help@jisc.ac.uk

Secured by F-Secure Anti-Virus CataList Email List Search Powered by the LISTSERV Email List Manager