← Back
University courseworkData ArchitectureGroup project

Confluent events → bronze layer ingestion (setup)

Kafka (Confluent Cloud) and Azure Data Lake setup for a medallion architecture

Problem

Ingest electric-vehicle GPS and status events into the bronze layer.

Data

Topics acme-ev-gps-events and acme-ev-status-events.

Methods

  • abfss paths for bronze and checkpoints

Tools

DatabricksConfluent Cloud (Kafka)Azure Data Lake Storage Gen2

University work; no claim of sole individual authorship.