Transcript Document
EOSDIS Status 10/16/2008 Dan Marinelli, Science Systems Development Office EOSDIS Context Distributed Active Archive Centers (DAACs) REASoN ACCESS Instrument Science Team Facilities (SCFs and SIPSs) Data Assimilation Model Adapted from EOSDIS Mission Profile 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 ERBS (SAGE II) 10/1984 - 2 years planned mission life ERS-1 10/1978 - 10 yrs m life NIMBUS-7 (TOMS I) Meteor 3 TOMS (TOMS II) UARS TOPEX/Poseidon JERS-1 OrbView-2 (SeaStar) ERS-2 Earth Probe TOMS (TOMS III) RadarSat 1 Heritage Missions 3 yrs ADEOS I (Midori) TRMM CERES data only Landsat 7 EOS Missions QuikSCAT KEY Planned Mission Life EOS Terra ADEOS II (Midori II) 3 yrs Jason-1 Extended Mission Life 4 yr Data Access Period (includes 3 yr reprocessing) 3 yr Reprocessing Pd No Planned EOL ACRIMSAT Meteor 3M EOS Aqua ICESat EOS Aura SORCE 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 file name: EOS missions vs time7.xls Earth Science Data and Information System (ESDIS) Project - GSFC Code 423 • Objective - Develop and Operate Earth Observing System Data and Information System (EOSDIS) – – – • Organizations: ESDIS Project meets its requirements by funding and managing several organizations including – – – • SDPS - System for ingesting, processing, archiving and distributing data Data Centers - Science System Operations EOSDIS Networks - Transportation of mission & science data SIPS - Systems developed and operated by PIs or Team Leaders for generation of standard data products for delivery to Data Centers Status – – – – – • “Large” industrial: Raytheon (EMD) Distributed Data Centers - NASA Centers (GSFC, JPL, LaRC), other government agencies (EDC, ORNL), Universities (ASF, NSIDC, SEDAC) Science Investigator-led Processing Systems (SIPSs) - NASA Centers (GSFC, JPL, LaRC, MSFC), NCAR Project Components: – – – – • A production capability for standard science data products from EOS instruments An “active archive” of Earth science data from EOS and other past and present Earth science missions A distributed information framework (data centers, system elements, interfaces and data model) supporting EOS investigators and other users in science, government, industry, education, and policy EOSDIS has been successfully supporting EOS missions since 1999 Volume of data available from EOS missions continues to grow. Current volume at 4.9 petabytes. EOSDIS archive contains current as well as legacy Earth science data - more than 2700 datasets In FY 2007, over 100 million products were distributed to just over 165,000 unique users; approximately 3.0 million distinct users accessed the EOSDIS data centers. ESDIS Project is working closely with the user community to enhance systems that support and provide access to data Web Site: http://eos.nasa.gov/eosdis Monthly Distribution by Products (Sep 2007 - Aug 2008) ASF EDC GSFC JPL LaRC Latis NSIDC ORNL MODAPS GHRC SEDAC Jun-08 Jul-08 20,000 18,000 Product Counts (in 1000's) 16,000 14,000 12,000 10,000 8,000 6,000 4,000 2,000 0 Sep-07 Oct-07 Nov-07 Dec-07 Jan-08 Feb-08 Mar-08 Month Apr-08 May-08 Aug-08 Month Aug-08 Jul-08 Jun-08 GHRC May-08 Apr-08 MODAPS Mar-08 Feb-08 ORNL Jan-08 Dec-07 NSIDC Nov-07 Oct-07 Latis Sep-07 Aug-07 LaRC Jul-07 Jun-07 JPL May-07 Apr-07 GSFC Mar-07 Feb-07 EDC Jan-07 ASF Dec-06 Nov-06 Oct-06 Sep-06 Product Counts (in 1000's) Monthly Distribution by Products (Sep 2006 - Aug 2008) SEDAC 20,000 18,000 16,000 14,000 12,000 10,000 8,000 6,000 4,000 2,000 0 0 Month Aug-08 Jul-08 Jun-08 May-08 GHRC Apr-08 MODAPS Mar-08 Feb-08 Jan-08 ORNL Dec-07 NSIDC Nov-07 Oct-07 Latis Sep-07 Aug-07 LaRC Jul-07 Jun-07 JPL May-07 GSFC Apr-07 Mar-07 EDC Feb-07 ASF Jan-07 Dec-06 Nov-06 Oct-06 Sep-06 Volume (TB) Monthly Distribution Volume (Sep 2006 - Aug 2008) SEDAC 250 200 150 100 50 Recent Progress – Transition from EOS Data Gateway (EDG) to ECHO/WIST Underway. NSIDC, Oak Ridge, and Alaska DAACs have completed transition. Over 1600 new users currently accessing EOS data via ECHO/WIST. – Will complete once ECS 7.21 is operational at all sites • 7.21 was deployed and includes ingest of all data via Data Pool, conversion to an XML archive for metadata, distribution enhancements Plans for the next year – ECS Release 7.22: work underway for final delivery planned under EMD Contract - will include: • Custom code changes to support transition to disk-based archive • Improvements to Bulk Metadata Generation Tool to automate response to error conditions in interface to ECHO • Enhanced Checksumming, including validation of integrity of files in the datapool and archive • Operating System and Compiler Upgrades (including custom code changes) • Code simplification - complete removal of all remnants of Science Data Server and heritage Storage Management components (replaced in Release 7.21) EOSDIS Futures • Future spending profile reflects reductions being achieved with evolution – GES DISC off of ECS; MODAPS performs MODIS processing and L1/atmospheres archive and distribution – ASDC DAAC now supports CERES with their ANGe system; ECS to remain in place through at least 7.22 for other EOS instruments – ECS evolution development to be complete by March 2009 – has resulted in greatly reduced physical, SLOC footprint, and thus cost to maintain • ECS contract expires May 2009; ESDIS is putting together RFP for the follow-on ECS Evolution and Development Contract • THG grant renewed 7/2008 for 3 years • New NASA guideline implies we may not be able to host this workshop in the future – we’ll keep you posted