A real-time telematics platform
Summary
Modernising a large vehicle-data service.
The service needed to ingest continuous device data, produce operational events and support web and mobile applications.
A distributed data platform for sensor ingestion, event processing, alerts and reports covering vehicle location, speed, geofences, fuel and temperature.
Tech Stack
- Akka
- Apache Spark
- Cassandra
- GlusterFS
- Kafka
- PostgreSQL
- Scala
Project workstreams
- 01
2 Weeks
Solution Architecture Design
Solution Architect - 02
8 Weeks
Data Warehouse Configuration
Data Engineer - 03
10 Weeks
Realtime Streaming Pipeline Development
Data Engineer - 04
12 Weeks
Training & Tuning Cycle pt.1
Data Engineer - 05
15 Weeks
Web / App Platform Development
App Developer,Backend Developer,Frontend Developer - 06
6 Weeks
Training & Tuning Cycle pt.2
Data Engineer - 07
4 Weeks
Integration & Testing & Deployment
Backend Developer,Data Engineer,Deep Learning Researcher,Dev Ops
Tech Challenge
- Tracking a large vehicle fleet requires integration of large amounts of sensor data into a single pipeline.
- Making tracked data available to compliance units within seamless interface, at a lower cost.
- Data has to be processed and accessible in near real-time fashion.
Solution
- All the data is stored in the scalable cluster in a fault-tolerant manner (Cassandra).
- The mobile app has a real-time access to the information from each connected monitoring device.
- System automatically produces reports for each fleet vehicle, via collecting data from analytical indicators built by our team.
- Huge amounts of data are processed fast due to Apache Spark cluster; micro-services were built as an isolated Docker containers.
- Metrics gathered in real-time are numerous and detailed (i.e. number of stops, start and end time of the journey, mileage, speed, idle time, route history, geofences, fuel consumption, engine temperature, etc.) They are used to create automatic alerts about accidents, critical situations, theft and other situations.
Impact
A platform architecture supporting the telematics service’s operational data and customer-facing applications.
Published
