Engineer- System Management

Job Description

System Administrator

Must Have Technical/Functional Skills

• Big Data Admin for AWS EMR (Elastic MapReduce) Big Data and Hadoop ecosystem.
• Experience with Terraform, CloudFormation, and other DevOps tools.
• Strong Linux administration and scripting (Bash, Python).
• Familiarity with AWS services like S3, EC2, IAM, CloudWatch.

Roles & Responsibilities

AWS EMR (Elastic MapReduce) Big Data Administrator is responsible for designing, deploying, configuring, and maintaining big data environments on AWS using EMR, Hadoop, Spark, Hive, and related technologies.

Key Responsibilities

• EMR Cluster Administration:
  • Provision, configure, and manage Amazon EMR clusters.
  • Optimize sizing, auto-scaling, and performance.
  • Manage Hadoop components including HDFS, YARN, Hive, and Spark.
• Big Data Platform Operations:
  • Install, configure, and upgrade big data tools.
  • Monitor cluster health and troubleshoot failures.
  • Manage data ingestion pipelines including Kafka, Kinesis, and AWS Glue.
• Security, Compliance & IAM:
  • Implement EMR security with IAM, Kerberos, KMS, and VPC configurations.
  • Ensure compliance with organizational standards.
• Automation & DevOps:
  • Automate EMR provisioning using CloudFormation, CDK, or Terraform.
  • Build CI/CD pipelines using AWS tools or Jenkins.
  • Implement cost optimization strategies.
• Monitoring & Troubleshooting:
  • Use CloudWatch, CloudTrail, and EMR Console for diagnostics.
  • Tune Spark and Hive jobs for performance.
• Collaboration & Support:
  • Work closely with data engineers and cloud teams.
  • On-call assistance.

Education

Bachelor’s Degree

Salary Range: $100,000 - $120,000 a year