[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Thoughts on Archives
Tom,
Believe it or not, I am working slowly on the "archive problem".
Last week I finally passed a milestone here by having my software
support a launch rehearsal, So now maybe I can program TASS stuff
in the evening instead of telemetry processing stuff. (By the way,
I was able to convince the bosses to let my build a system based
around PostgreSQL here.) It would be nice to do for TASS what we
do here: Process and analyze a torrent of data in real-time. We
have a government budget but I think we can come close.
I think it can go like this:
1) There may be multiple data reduction pipelines but we should
have only one "standard" (FITS based) data format for star lists.
This means the last stage in any pipe is to convert the data to
this format.
2) The above "standard" (FITS based) data format will be imported into
a large database that is accessible on-line. This database may be
centralized or distributed. "Centralized" being technically easier
will likely happen first. I also want to put "standard" catalog
data on-line in the same database so we can automate things like
cross identifications.
3) Analysis and display tools that interface to the database will
get written. Examples would be light curve plotters and automatic
search "robots". Web based query forms and I'm sure other stuff.
STATUS:
Working on software for #1. I'm writing it in an easy to modify
way so that it can be adapted to fit more then one input pipeline.
Have a design for #2 that has already been debated here on this list.
Progress (if you can call it that.) has been slow but I hope can
pick up
I have a computer system on-line that can host an example TASS
database (but lack resources to host the "real thing").
--- Tom Droege <tdroege2@earthlink.net> wrote:
> I am quoting here from "Light Curves of Variable Stars" by Sterken
> and
> Jaschek. I found time to read through this book several times on my
> vacation while Jennifer was participating in Rolls events and
> visiting with
> her relatives. Seems like the Malpass family delights in going to
> some
> remote place, and then seeing how many near by (or not so near by)
> friends
> and relatives can come by to visit. I thus found time to read while
> keeping out of the way of the melee.
>
> From the Introduction (sic):
>
> "We first intended to present all data (light and colour curves) in
> one single
> photometric system and to represent the data with a single graphical
> software
> package. However, as the light curve data were coming in, we
> realised that
> it was
> just impossible to combine all photometric data into one singe
> homogeneous
> data set. Moreover, we learned with dismay that for many light
> curves
> published
> less than a decade ago, the only remnant data are the graphs
> themselves, the
> original data having been lost forever - indeed a vivid demonstration
> that
> archiving of astronomical data is still in its infancy.
>
> Here are some of my thoughts on this:
>
> 1) A big data base in consistent format would allow Sterken and
> Jaschek to
> do what they wanted to do. Present curves in "one single photometric
>
> system and to represent the data with a single graphical software
> package". Note that when S and J set out to do this work (a
> graphical
> catalog of variable star types) they were surprised that no one
> seemed to
> have done it before.
>
> 2) Until there is some place else to put the data, i would propose
> that
> people like Michael K. put their data into technical notes *including
> the
> raw data*. The format is not important. No use doing work twice to
> put
> the data into some format of our own. Just write it up for the
> destination
> journal and make a tech note of it. Then append the raw data. Then
> someone that wants the information can come and get everything.
>
> Again, this is not publication. It is our "internal" archive. No
> matter
> that anyone can participate in tass and thus access the data.
>
> Tom Droege
>
>
>
>
=====
Chris Albertson
Home: 310-376-1029 chrisalbertson90278@yahoo.com
Cell: 310-990-7550
Office: 310-336-5189 Christopher.J.Albertson@aero.org
__________________________________________________
Do You Yahoo!?
Yahoo! Health - Feel better, live better
http://health.yahoo.com