Our streaming cloud analytic solution quickly processes high velocity data for real-time queries in the cloud. This demonstration ingests complex XML files, each containing 5000-7000 ship reports, and displays the latest ship positions in real-time. In addition, users can select individual ships to retrieve historical location data, including the most recent position. There system process over 1000 XML files, ingesting one file every five seconds.
To handle this workload, we've built a system implementing our iNovex Lambda architecture. This architecture combines stream processing and cloud storage to quickly publish data for end-user consumption. The stream processing and cloud storage systems scale horizontally to cope with big data requirements.