Quote from: su27k on 11/07/2022 01:32 amShould Webb telescope’s data be open to all?Quote from: Science[...] But some astronomers question the practice, arguing that data from federally funded projects should be free for all to use. NASA, Webb’s primary backer, is facing an open data push from the White House and may soon end the restriction. Having so much Webb data locked away “doesn’t pass the smell test. It’s just not right,” says astronomer Garth Illingworth of the University of California, Santa Cruz, who from 2009 to 2017 chaired a committee advising STScI on Webb’s future science operations.No, this is a horrible idea that will hurt the quality of work done. The data also become fully and freely available after a year. However, these scientists put in HUGE amounts of work to design and create their proposals and observations, and everything involved. They should get first pick at the data. This isn't just spending 5 minutes picking what you're gonna point the telescope it. Its months to years of work,
Should Webb telescope’s data be open to all?Quote from: Science[...] But some astronomers question the practice, arguing that data from federally funded projects should be free for all to use. NASA, Webb’s primary backer, is facing an open data push from the White House and may soon end the restriction. Having so much Webb data locked away “doesn’t pass the smell test. It’s just not right,” says astronomer Garth Illingworth of the University of California, Santa Cruz, who from 2009 to 2017 chaired a committee advising STScI on Webb’s future science operations.
[...] But some astronomers question the practice, arguing that data from federally funded projects should be free for all to use. NASA, Webb’s primary backer, is facing an open data push from the White House and may soon end the restriction. Having so much Webb data locked away “doesn’t pass the smell test. It’s just not right,” says astronomer Garth Illingworth of the University of California, Santa Cruz, who from 2009 to 2017 chaired a committee advising STScI on Webb’s future science operations.
As it says in the article the period should be reduced to six months. A year is an excess amount of time to hold the data back for a publicly funded instrument.
It can be. In other cases, the suggestion is obvious and anyone in the field would have proposed it when asked "what should we do with this big IR bucket?" I think the mistake is having a one-size-fits-all embargo...
The idea of scrapping proprietary time is misguided. It does seem to be conflating results and data. It would benefit big teams and I suspect it would have a negative effect on the science. Look at the results of the ERS programs, GLASS and CEERS have generated a lot of papers but many of these were fired out as quickly as possible in order to be first. These collaborations did not take the time to (e.g.) properly set the flux calibration because they were under pressure to publish, and some results have changed substantially with newer calibrations. The methods being used were also not advanced, the tools were the same as from those from 10 years ago with HST and Spitzer, because it was fast. If every program was like this it would be chaos. Anyone trying to take the time to actually understand the data properly would be penalised.It's also very reactionary to base it all on Cycle 1/Cycle 2, which this will have no effect on. In 2 years when the archive is dominated by public data this will be totally different. The ERS programs were successful in getting a bit of data for people to learn the ropes, but that doesn't mean the field should be turned upside down.I think if you want to promote open science in a positive way they should focus on publications. I suspect the survey will get a very negative reaction, I haven't heard any astronomer defend this. It's also shortsighted to focus only on raw data, maybe you can reproduce someones analysis but it might take weeks or months. A better route would be to encourage teams to release high level data products (reduced images/spectra, catalogs) rather than just the archive publishing the bare minimum. A lot of papers analysed the three high redshift NIRSpec galaxies from the ERO data. There would have been far fewer papers if the commissioning team only released the raw data instead of their extracted spectra.Quote from: Star One on 11/07/2022 04:49 pmAs it says in the article the period should be reduced to six months. A year is an excess amount of time to hold the data back for a publicly funded instrument.And so you have your Cycle 1 program approved. You submitted the proposal 2 years ago. Half your data is taken in August, the other half is scheduled for August 2023. The first observations will be public 6 months before you have the complete data. So do you publish a half-baked analysis of half the data, just to avoid being scooped, or do you wait? Observers have no control over the schedule. Also bear in mind that some of the people currently getting data have been waiting for 3 decades.Quote from: Paul451 on 11/08/2022 06:18 amIt can be. In other cases, the suggestion is obvious and anyone in the field would have proposed it when asked "what should we do with this big IR bucket?" I think the mistake is having a one-size-fits-all embargo...Submitting a proposal for JWST is not just writing a justification like other facilities, the full observing program down to each dither and exposure is required. It is not something that can be done in 5 minutes, even for a small program it is a week of work if you are experienced with APT and already have a plan. I doubt one could even configure the exposure time calculator alone in 5 minutes. It's also not something that people should be encouraged to take lightly, small differences in observing strategy can lead to large differences in overheads and the total time needed. Carefully optmising the strategy is how you maximise the scientific return and efficiency. And minimum effort proposals are pretty likely to be rejected. The current system is not "one-size fits all". The proposers select whether they want 12, 6, 3 or zero months proprietary time. 12 months is simply the default for small and medium, zero for large and pure parallel programs.
If astronomers want exclusive use of the data, maybe they want to pay the prorated cost of their observation time? Otherwise the data should be public. Get a grip. Demanding an embargo on a freebie is gross.
All I will say in response is other NASA space telescopes have I believe a six month proprietary data period why should JWST be different.
Quote from: Star One on 11/08/2022 02:39 pmAll I will say in response is other NASA space telescopes have I believe a six month proprietary data period why should JWST be different.Yes it's quite different. JWST is a brand new telescope with dozens of modes, all of which are very poorly understood. The analysis pipeline is changing every week as new bugs are found, the calibrations are also changing day by day. There are instrumental artifacts in the data which the reduction software doesn't even deal with yet (e.g. 1/f noise, persistence). There are effects which were not accounted for in the instrument simulations (reflections, stray light, snowballs). It is quite different to HST were the instruments haven't changed for more than 12 years, with a stable pipeline. A Cycle 1 JWST program is much more work because you have to solve these problems yourself, and often there is no benchmark for you to compare to.
I'd also make a general point that JWST wasn't built to make data for it to just sit in an archive. JWST produces data, not scientific results. Astronomers do that. Take a real Cycle 1 example, the public program targeting TRAPPIST-1 with transit spectroscopy. Several epochs have been sitting in the archive for months available to anyone. Does the public benefit from this? No. Does this raw data accomplish any of JWST's science goals? No. But still people are excited to see these results, once the team actually publishes them.
Several epochs have been sitting in the archive for months available to anyone. Does the public benefit from this? No.
Quote from: Dizzy_RHESSI on 11/09/2022 10:38 am Quote from: Star One on 11/08/2022 02:39 pmAll I will say in response is other NASA space telescopes have I believe a six month proprietary data period why should JWST be different.Yes it's quite different. JWST is a brand new telescope with dozens of modes, all of which are very poorly understood. The analysis pipeline is changing every week as new bugs are found, the calibrations are also changing day by day. There are instrumental artifacts in the data which the reduction software doesn't even deal with yet (e.g. 1/f noise, persistence). There are effects which were not accounted for in the instrument simulations (reflections, stray light, snowballs). It is quite different to HST were the instruments haven't changed for more than 12 years, with a stable pipeline. A Cycle 1 JWST program is much more work because you have to solve these problems yourself, and often there is no benchmark for you to compare to. This is an reasonable point. However, some fraction of this time will not be astronomers themselves developing new calibration techniques, but simply waiting for the pipeline folks (who do not nearly get enough credit, in my opinion) to adjust their techniques and methods to the new machine. In the meantime, in my experience, the astronomers are developing what results they can from the less-accurately calibrated data. Others could do this as well.QuoteI'd also make a general point that JWST wasn't built to make data for it to just sit in an archive. JWST produces data, not scientific results. Astronomers do that. Take a real Cycle 1 example, the public program targeting TRAPPIST-1 with transit spectroscopy. Several epochs have been sitting in the archive for months available to anyone. Does the public benefit from this? No. Does this raw data accomplish any of JWST's science goals? No. But still people are excited to see these results, once the team actually publishes them.TRAPPIST-1 is actually an argument AGAINST proprietary periods. The raw data was publicly released right away, yet no one got scooped, no rushed and shoddy papers came out (to my knowledge), and people will still be excited to see the correctly processed and calibrated results when they come out. I think this will be the rule and not the exception, as scientists are quite capable of recognizing and being appropriately skeptical of preliminary work that took shortcuts. (The "highest Z" race was an exception, I think, as the target was the media and not the scientific community, so primacy was more important than accuracy. JWST will soon be past this point, if it's not already.)QuoteSeveral epochs have been sitting in the archive for months available to anyone. Does the public benefit from this? No.I don't agree with this. The public benefits from this even if no member of the public ever looks at it. It boosts confidence, not because a random member of the public has any ability to analyze it, but because it shows that other experts have had a chance to analyze it and declined. As an extreme example, suppose you are giving a public talk on TRAPPIST-1 and some guy (it's almost always a guy) asserts the spectral data demonstrates the existence of aliens. If you simply and correctly state "Our analysis shows no evidence of aliens", there will still be doubts, in him and others. (Are you doing the right analysis? Are you hiding something because it's non-orthodox? Etc.) But if you can add that "the data is publicly available" then the questioner knows that the minority of experts who are pro-alien (Avi Loeb, etc.) have had a chance to look at it. They would not be shy pointing out the obvious if it existed in the data.It's much like political candidates releasing their income tax returns. Are you going to read one of these yourself? Probably not. But you know that people who *are* experts in accounting will take at a look, and let you know if anything interesting pops out.
If everything was free, you wouldn't have anything. How would a company get the money to design a car and build it if everything was free?
If the team that puts hundreds and hundreds of hours (unpaid) into getting an observation has no rights to the data, no one is going to plan the complicated important observations. Which means that they DON'T HAPPEN. JWST wouldn't produce amazing science cause no team is going to put thousands of hours into the work only to be scooped by some random person who gets much of the data wrong, but steals the credit anyways.
(The "highest Z" race was an exception, I think, as the target was the media and not the scientific community, so primacy was more important than accuracy. JWST will soon be past this point, if it's not already.)
Quote from: deadman1204 on 11/09/2022 02:02 pmIf everything was free, you wouldn't have anything. How would a company get the money to design a car and build it if everything was free?JWST is not a car, and nobody is making the strawman argument of "everything everywhere should be free!". QuoteIf the team that puts hundreds and hundreds of hours (unpaid) into getting an observation has no rights to the data, no one is going to plan the complicated important observations. Which means that they DON'T HAPPEN. JWST wouldn't produce amazing science cause no team is going to put thousands of hours into the work only to be scooped by some random person who gets much of the data wrong, but steals the credit anyways.And yet for telescopes and other instruments without embargo periods, observations continue and instrument time continues to be oversubscribed. 'Data available immediately means nobody will take the effort to apply for observation time' does not seem to have ever been the case anywhere. I suspect you'd also be hard-pressed to find a scientist who, faced with the opportunity to be the first to make a discovery using an instrument with a brand new capability, would not choose to take up the challenge of doing so faster than others but instead actively choose to remain in ignorance due the risk of being second to know.
Please list the observatories that are as complicated to use and analyze the data from as JWST is without an embargo period on any data.I'll help you out - any observatory thats been running for several years WON'T be as complicated to use and analyze as JWST, because they will be well understood.
TRAPPIST-1 is actually an argument AGAINST proprietary periods. The raw data was publicly released right away, yet no one got scooped, no rushed and shoddy papers came out (to my knowledge), and people will still be excited to see the correctly processed and calibrated results when they come out. I think this will be the rule and not the exception, as scientists are quite capable of recognizing and being appropriately skeptical of preliminary work that took shortcuts. (The "highest Z" race was an exception, I think, as the target was the media and not the scientific community, so primacy was more important than accuracy. JWST will soon be past this point, if it's not already.)