Cloudera Administrator

- I need you to design and automate the deployment of Cloudera CDP components (Data Lake, Data Hubs, Data Services) using Terraform. - You should build and maintain CI/CD pipelines using GitHub Actions for infrastructure and data pipeline automation. - Collaboration with data engineering teams is essential to integrate CDP with existing Big Data workflows. - I expect you to write and maintain automation scripts using Shell and Python. - You will manage infrastructure and configuration using YAML and JSON. - You should configure and tune Cloudera services for performance and security. - Ensuring secure, scalable, and cost-effective deployments on cloud platforms (AWS, Azure, or GCP) is a must. - A solid understanding of all the Hadoop daemons and their roles in the cluster is required. - You should be able to troubleshoot issues in Cloudera services and resolve them effectively. - Experience with adding and removing nodes in the cluster, as well as rebalancing nodes, is necessary. - Employing security measures with an authentication and authorization system such as Kerberos is important. - Knowledge about the changes required for migrating to the Cloudera cloud version CDP is essential. - Understanding Cloudera data services (CDW, CDE, CDF, CAI) is required. - You must design native cloud application architectures and optimize applications for AWS. - Familiarity with network connectivity, including Direct Connect, VPN, VPC, security groups, NACL, and Route 53, is needed. - In-depth AWS development experience is required, including containerization with Glue, Docker, Amazon EKS, Lambda, EC2, S3, Amazon DocumentDB, and PostgreSQL. - A strong knowledge of DevOps and CI/CD pipelines (GitHub, Jenkins) is essential. - You should possess scripting capabilities to develop AWS environments as code. - Hands-on AWS experience with at least one implementation in an enterprise-scale environment is preferred. - Experience with core AWS platform architecture, including organizations, account design, VPC, subnet, and segmentation strategies, is necessary. - You will handle environment and application automation. - Familiarity with CloudFormation and third-party automation strategies is required. - I expect you to be knowledgeable in AWS Cost Management and Optimization.