The events are created by a tracker application for events such as click, page load, performance, …
- Tracker - fire events
- Collectors receive events from trackers.
- Apache Kafka
- Amazon Kinesis
- Apache Flume
- Facebook’s Scribe
- Web Service Endpoint with a web Server (Akka Http for Scala (play framework is built on int)),…)
- Batch: Hadoop Spark
- Stream: Kinesis/Kafka
- Flat file structure on HDFS (S3,…)
- Database (Redshift, Postgres,…)
CDP (Customer data pipeline)
Customer data pipeline platform collects, routes, and processes data from source to destination (website, apps, data warehouse, and cloud apps).