From STORET to WQX

New Jersey’s Solution for Integrating Ambient Water Quality, Facility and GIS Information from Federal, State, County & Volunteer Organizations Harry Chen New Jersey Department of Environmental Protection November 28, 2007 Austin, TX

Project Purpose

• • • Integrate water quality data Streamline and simplify data transfer Provide better, more timely access to water quality data – Aid decision-making – Improve resource efficiency

• • • •

Goals

Develop an up to date, searchable inventory of ambient water quality monitoring in New Jersey Integrate ambient water quality monitoring data into NJDEP’s enterprise environmental data management system to enable more integrated environmental decisions Make NJ ambient water quality monitoring data available to the public Report ambient water quality monitoring data to USEPA

• • • • • •

Project Partners

NJDEP – Bureau of Freshwater and Biological Monitoring – Bureau of Marine Water Monitoring – Bureau of Water Quality Standards and Assessment – Division of Watershed Management – Division of Science, Research, and Technology USGS Department of Health and Senior Services (DHSS) County Governments Volunteer Monitoring Organizations NJ Water Monitoring Coordinating Council (Inventory)

Existing Ambient Water Quality Data Producers

Field For m

Keypunch

Field Msr Habitat Sample Info

AMNET

Field/Hab dB MS Access Link Reformat Field/Habitat dB Text file Bench Sheet

Keypunch

Taxa counts

AMNET

Taxa dB Text file Field For m DHSS Chem Results QC Labs Chem Results

Keypunch

Field Msr Habitat Taxa counts Sample Info

Import e-file

Chem Results

Import e-file

Chem Results Field Form

Keypunch

Field Msr Habitat Sample Info

FIBI dB

Text file

Lakes dB

Field Staff Text file Reformat Taxa dB Extensive Manual Reformat Of Text File Reformat Lakes dB Data Staff Text file Text file

Corrections Text file

DHSS Chem Results QC Labs Chem Results Field Form

Keypunch

Chem Results

Keypunch

Chem Results

Keypunch

Field Msr Sample Info

Corrections

Manual Proofreading

Others Projects dBs

Text file Proofreading Reports Existing NJDEP Data Entry Mechanisms Note: Proofreading and correction steps occur for all data, but are not shown due to space limitations.

Make Final dB

ODBC Connect Change Result Status To Final Migrate Delete Migration NJ STORET FTP Oracle Export

EPA

ODBC Connect

Proofreading

dB

Sample Tracking

dB

Water Quality Data Management Model

Data Access

Data Submission

N JD E P Data Storage In te rn al D ata Fl ow

Transmission To CDX

Data Analysis

Core project components

• • WQX data flow, consisting of the following – Data-in: E2 WQX module with data validation – Data transmission to and from COMPASS – Data-out: NJ Water Monitoring Inventory / Data Portal Outbound data transmission to EPA CDX

High-Level Data Flow

EPA CDX E2 COMPASS ENDS

E2 COMPASS EPA CDX ENDS

Data System Integration

• • • E2 COMPASS ENDS

Data will be transmitted through each component using NJ’s Exchange Network NODE.

Future Ambient Water Quality Data Producers

4

EPA & USGS Web Services

Data Submission Options

GIS Integration

Monitoring Inventory Data Reports Link Web-based Maps Link Link

GIS Proposals:

• • EN Browser hosted by ECOS, a national solution NJ-GeoWeb, a NJ solution

EN Browser

Web services data discovery tool – Allows users to discover and execute Data Requests on Exchange Network Nodes – Offers users the ability to remove (filter) unwanted sections of the XML data set returned from a Data Service – Users have the option of choosing the format that they would like to retrieve the data in – Can integrate with enterprise data reporting tools

NJ-GeoWeb

A New Vision for Seeking Spatial Intelligence. Integrating customized GIS and analysis tools with enterprise databases for improved decision-making on the Internet.

“NJ-GeoWeb”

Permitting Compliance Enforcement Surveillance Inspections ePermits Clean & Plentiful Water Water/Sewer Infrastructure Water Allocation Storm Water Runoff Monitoring What’s in My Backyard Regulated Sites Incident Mgmt Flood Mapping Endangered Species Sustainable Growth Align Economic and Env. Goals Env. Sensitive Areas Green Technologies SDE Data Server Data Taking care of Business Economic Incentives Employment Info Revitalize and Redevelop Live Feeds from State Government

L.awrence Thornton, NJDEP

WQDE Project Challenges

• • • • Pulling data from USGS (web services in development) Pulling data from EPA (web services in development) Coordinating with a large number of project partners – Requires compromise Re-engineering current reporting procedures, while designing new WQX reporting procedures – How to teach an old dog new tricks?

Project Phases and Tasks:

• • • • • Business Process Analysis Functional Requirements Specification and System Design System Development, Data Preparation and Implementation Acceptance Testing User Training, Documentation and Outreach

Next Steps

• • • • • • • Complete System Design Programming and Development User Acceptance Testing Documentation and Training Production Deployment Send data to EPA Target Date:

October 2008

Thanks!

Contact Info: NJDEP- Office of Info Resources Management Name: Harry Chen Phone: (609)-633-1261 E-mail: [email protected]