Kafka Developer
Onsite ~ Minneapolis, MN location
Required Skills & Qualifications
Experience: 5+ years in software/data engineering, with strong hands-on experience in Java-based Kafka Streams development and Databricks application development.
Knowledge of AWS cloud services and cloud-based data engineering architectures preferred.
Experience with Git, Gradle, CI/CD pipelines, application monitoring, and performance optimization.
Proficiency in Java, Python, PySpark, and SQL.
Knowledge of Apache Iceberg, Unity Catalog, and Lakehouse architecture.
Experience building scalable ETL/ELT pipelines using Databricks and Delta Lake.
Strong understanding of Kafka offset management, checkpointing, fault tolerance, and error handling.
Experience developing Kafka consumers in Databricks to ingest and process real-time data from Confluent Kafka topics.
Hands-on experience developing Databricks applications using Python, PySpark, and Spark Structured Streaming.
Experience with Confluent Kafka, including topics, partitions, consumer groups, and Schema Registry.
Strong understanding of Kafka Streams concepts, including KStream, KTable, GlobalKTable, joins, aggregations, windowing, and state stores.
Experience developing and maintaining Java-based Kafka Streams applications using Gradle for build and dependency management.
Strong hands-on experience in Apache Kafka and Kafka Streams application development using Java.
#LI-AJ1