| Abstract Title: | Real-time data acquisition and Management |
| Session Choice: | Real-time data acquisition and use for compliance check |
| Presenter Name: | Mr Abhinav Kumar |
| Co-authors: | Mr Sandeep Kumar |
| Company/Organisation: | LogicLadder Technologies Private limited |
| Country: | India |
Abstract Information :
Real-time data acquisition for Continuous Emission Monitoring (CEM) Systems and management of substantial volumes and frequency of emissions data pose a significant challenge in monitoring environmental impact. LogicLadder Technologies operates a seamlessly integrated network of analyzers proficient in capturing, transmitting, and processing real-time data. At the outset, analyzers swiftly collect and transmit real-time data to servers using IoT loggers. The logger or Field Remote Terminal Unit (FRTU) seamlessly integrates various analyzers in diverse networks, ensuring adaptability irrespective of the protocols in use. It can store time-stamped data in local memory during network downtime, preventing the data loss. The implementation of the MQTT protocol, coupled with the prioritization of the secure HTTPS protocol following ISO standards, strengthens data security. Additionally, the reliability of data transfer processes is controlled by the connected device platform(CDP) that streamlines the configuration and control of FRTUs. The system leverages Apache Kafka to ensure efficient data processing and analysis of diverse data streams. A specialized data storage framework handles extensive volumes or frequency of time-stamped. The data storage framework is consist of Time Series Databases (TSDBs) that run on Apache's HBase and Hadoop ecosystem, surpassing the efficiency of traditional relational databases. The real-time monitoring and predictive maintenance are achieved through the analysis of a time-series database. Also, the data storage framework optimizes storage, compression, and swift data ingestion. This system is efficiently processing 50 lakh samples daily with a total data volume of 10 TBs collected so far with minimal infrastructure availability. In addition, the system can effortlessly comply with all regulatory bodies. In essence, LogicLadder's CEMS enables industries to seamlessly acquire and manage real-time data through integrated data flow, reinforced by network switching, scalability, and versatility.
