A real-time telematics platform

Summary

Modernising a large vehicle-data service.

The service needed to ingest continuous device data, produce operational events and support web and mobile applications.

A distributed data platform for sensor ingestion, event processing, alerts and reports covering vehicle location, speed, geofences, fuel and temperature.

Tech Stack

  • Akka
  • Apache Spark
  • Cassandra
  • GlusterFS
  • Kafka
  • PostgreSQL
  • Scala

Project workstreams

  1. 01

    2 Weeks

    Solution Architecture Design

    Solution Architect
  2. 02

    8 Weeks

    Data Warehouse Configuration

    Data Engineer
  3. 03

    10 Weeks

    Realtime Streaming Pipeline Development

    Data Engineer
  4. 04

    12 Weeks

    Training & Tuning Cycle pt.1

    Data Engineer
  5. 05

    15 Weeks

    Web / App Platform Development

    App Developer,Backend Developer,Frontend Developer
  6. 06

    6 Weeks

    Training & Tuning Cycle pt.2

    Data Engineer
  7. 07

    4 Weeks

    Integration & Testing & Deployment

    Backend Developer,Data Engineer,Deep Learning Researcher,Dev Ops

Tech Challenge

  • Tracking a large vehicle fleet requires integration of large amounts of sensor data into a single pipeline.
  • Making tracked data available to compliance units within seamless interface, at a lower cost.
  • Data has to be processed and accessible in near real-time fashion.

Solution

  • All the data is stored in the scalable cluster in a fault-tolerant manner (Cassandra).
  • The mobile app has a real-time access to the information from each connected monitoring device.
  • System automatically produces reports for each fleet vehicle, via collecting data from analytical indicators built by our team.
  • Huge amounts of data are processed fast due to Apache Spark cluster; micro-services were built as an isolated Docker containers.
  • Metrics gathered in real-time are numerous and detailed (i.e. number of stops, start and end time of the journey, mileage, speed, idle time, route history, geofences, fuel consumption, engine temperature, etc.) They are used to create automatic alerts about accidents, critical situations, theft and other situations.

Impact

A platform architecture supporting the telematics service’s operational data and customer-facing applications.

Published

DRL Team · Ivan Didur