Cloudera Platform engineer (Azure)

Note: Please note that this is a platform engineering role, not a data role.

Key Responsibilities:

• Lead end-to-end Cloudera platform upgrades (CDH/CDP), including planning, execution, validation, and rollback across DEV/UAT/PROD environments with minimal downtime.

• Administer and optimize Cloudera clusters (Hadoop, Spark, Hive, HDFS, YARN, Kafka), ensuring high availability, performance tuning, and capacity management.

• Manage cloud-based deployments on Microsoft Azure, including provisioning, scaling, and integration with services such as ADLS Gen2, Azure VMs, and networking.

• Implement DevOps and automation practices using scripting (Shell/Python), CI/CD pipelines, and Infrastructure-as-Code (e.g., Terraform/ARM templates).

• Ensure platform reliability, security, and compliance, including monitoring (Cloudera Manager/Azure Monitor), patching, backup/recovery, and access control (Kerberos/Ranger).

Core Skills Required:

• Strong hands-on experience in Cloudera (CDH/CDP) platform administration and upgrades.

• Solid understanding of Hadoop ecosystem components (HDFS, Spark, Hive, YARN, Kafka).

• Proven experience in Azure cloud (ADLS Gen2, VMs, networking, monitoring).

• Experience with Linux administration, scripting (Shell/Python), and DevOps tooling.

• Familiarity with security frameworks (Kerberos, Ranger, encryption).