Data Integration and Averaging (DIA) Application

An important function of any good Environmental Management Information System (EMIS) is the collection of facility process data. This data is critical to calculating emissions and demonstrating compliance with operating limits or permit conditions, the core functionality of an EMIS.

Typically EMIS solutions do not directly interface with process data historians due to their configuration and the sheer volume of data that resides in them; therefore, it is necessary to develop a separate, seamless application to integrate data and the EMIS. T3® developed a Data Integration and Averaging (DIA) application to seamlessly pull data from industry-leading process historians and transmit the results to a third-party EMIS.

Data Collection

Monitored data at facilities are typically stored in non-relational process data historians. This data can be used to automate emission calculations, generate continuous emissions monitoring (CEMS) reports, or track progress against permit limits or regulatory standards in an EMIS solution. T3’s DIA application can pull data from the following data historians: Honeywell’s Uniformance® PHD, OSIsoft’s PI System®, any ODBC supported system, and Microsoft® Excel®. Process data can be collected on any polling frequency (every minute, every 15 minutes, hourly, daily, etc.) and the data are collected and aggregated in user-specified format (raw, snapshot, minimum, maximum, or average).

Processing Data

The DIA application can calculate averages from raw data or use data historian averages, cleanse data before averaging based on other single or multiple “fault” tag values or quality code, and track calibration times based on a calibration tag. Data processing is also extremely fast, cleansing and converting up to 50,000 raw values to 1,300 averages in less than 7 minutes.

Aggregation and Validation

A complementary benefit of the DIA application is the ability to perform processor-intensive data aggregation and validation based on business rules established by the user and performed prior to transmitting the results to the EMIS. Specifically, the DIA application uses a set of fault tags to validate or invalidate raw and minute data to create “valid” averages; and from these valid averages, to create valid block averages. Averages and snapshots of data can also be pulled from data historians without validation. Processed data is then stored in the Environmental Data Mart (EDM) database.

Easy to Use Functionality

The DIA application supports both scheduled and manual requests. Scheduled requests are those automatically generated by the application each time it runs. Manual requests and other data entry to the DIA application are entered via the EMIS solution or Web interface. The Web interface is designed to assist users with managing lists of environmental tags, establishing averaging and validation rules, and scheduling data collection requests. The DIA application also sends emails of tag errors and miscellaneous errors at runtime or daily. Users can set up custom email notifications using standard database queries.

Technical Elements
  • Supports Microsoft SQL Server or Oracle® databases
  • Requires Microsoft .NET Framework 1.1 and Windows® Task Scheduler
  • Supports Windows Network Authentication or Web page security login
  • Designed in Microsoft Visual Studio® .NET
DIA Application Methodology Chart
Application Successes

Project Snapshot: DIA Horsepower
A large Gulf Coast refinery must frequently record data to document compliance regarding emissions of nitrogen oxides (NOx) and highly reactive volatile organic compounds (HRVOCs). Data must be collected on a block 15-minute and hourly basis. This large refinery needed an application that monitors, validates, and averages data in a near real-time environment before integrating it into an EMIS solution. T3 implemented its DIA application to process the large volume of data required to document compliance. The challenge was collecting, validating, and storing potentially tens of thousands of monitoring results every 15 minutes. The timing requirements were a major concern during development. If the data retrieval time was longer than 15 minutes, the application would not be able to keep up with the averaging pace. Fortunately, the application can process relatively large manual requests while finishing well under the 15 minute mark. As a result, the refinery’s EMIS solution is able to calculate emissions faster and more accurately due to the DIA data cleansing procedures.

Why Choose T3?

T3 was launched in 1995 when Trinity Consultants, a nationwide leader in environmental consulting, responded to client needs by focusing on the specialized area of EH&S information management solutions. Today, T3 is an industry leader with a rare mix of EH&S professionals and Information Technology (IT) experts. This powerful combination gives T3 unmatched capability in applying technology to solve industry’s EH&S information management challenges. We have developed the broadest range of solutions, all designed to save you time and money.

In every way, T3 is committed to helping you achieve the highest standards – of business performance, and environmental responsibility.  For additional information, please contact Thomas Grosch at (972) 661-8100 or tgrosch@trinityconsultants.com.