Job Description
Responsibilities
- Set up and administer Kafka clusters, including installation, licensing, and configuration for UAT and PROD environments
- Monitor cluster health using Confluent Control Center, Cloudera Manager, Prometheus, Grafana, and Splunk
- Deploy and manage monitoring tools and troubleshoot stream‑based application issues
- Orchestrate services with Kubernetes and containerise workloads using Docker
- Implement infrastructure as code with Terraform, Concourse, and Veracode for security scanning
- Maintain cluster across all environments: add/remove nodes, rebalance, and perform regular failover drills
- Set up DevOps pipelines with CI/CD for Kafka deployments using Ansible
- Integrate Azure Databricks, on‑premises Hadoop, Spark, and other data pipelines
- Prepare and execute load and performance tests to validate cluster stability and best practices
- Configure security and protocol set...