Beyond Telemetry

Data Fusion for a new era of Telemetry

Client

artea.com developed a ML project for a major supplier of high-tech products and systems in the automotive industry, particularly for racing cars.

Problem

The different devices and systems on a Formula 1 car generate heterogeneous datasets. Mechanical stress and extreme conditions of use during races can deteriorate data. Additionally, certain types of signals (such as audio and video) require specific processing.

Solution

Computational visualization algorithms can process heterogeneous data sources and create predictive models. The design of our platform supports race officials with an all-in-one application that allows them to monitor a plethora of variables and events.

  1. On-board Camera Tagging
  2. Use Deep Learning-based Classifier to recognize relevant events based on data from rear/front cameras only.
  3. External Camera Tagging
  4. Use Deep Learning-based Classifier to recognize relevant events using data from external cameras only.
  5. Telemetry-based frame tagging
  6. Leverage telemetry data to label frames in a more accurate model.
  7. Real-Time Frame-based
  8. Rank tagged frames to expose the most relevant based on camera data only.
  9. Predictive Frame based
  10. Rank tagged frames to expose useful information based on predictive models.
  11. Real-Time Telemetry-based
  12. Enrich real-time classification algorithms using capabilities from telemetry data.
  13. Predictive anomaly detector module
  14. Enrich predictive classification algorithms using capabilities from telemetry data.
  15. 3D car models
  16. Create a 3D model based on camera views from different standpoints (drone-like camera).
  17. Trajectories projections
  18. Display car trajectory on video as an arrow pointing to the current direction.
  19. Real-time social fresh trends
  20. Write a ranked shortlist of trendy tweets, Facebook Posts and topics.
  21. RT widgets
  22. Create multiple visual widgets that leverage new information (e.g., display the speed of the wheel in a 3D model).