Hadoop Admin - W2 (H1B/OPT) Accepted
Posted 1 week ago by 1764661121
Negotiable
Outside
Remote
USA
Summary: The role of Hadoop Admin involves managing and maintaining Hadoop clusters while ensuring the reliability, performance, and security of the big data infrastructure. The position requires collaboration with data engineers, developers, and product managers. Candidates should have extensive experience in Hadoop administration and related technologies. This is a long-term remote position based in Austin, TX.
Key Responsibilities:
- Install, configure, and maintain Hadoop clusters and related technologies (e.g., HDFS, YARN, MapReduce).
- Monitor cluster performance and troubleshoot issues to ensure optimal performance.
- Perform regular backups, restores, and data recovery procedures.
- Implement and manage security measures to protect data integrity and privacy.
- Work closely with data engineers and developers to support Hadoop operations and application requirements.
- Conduct capacity planning and scaling to meet business needs.
- Write and maintain documentation, including data standards, procedures, and definitions.
- Stay up-to-date on the latest advancements in Hadoop technologies and best practices.
Key Skills:
- 5+ years of experience as a Hadoop Admin.
- In-depth knowledge of Hadoop architecture, administration, and performance tuning.
- Experience with Hadoop ecosystem tools (e.g., Hive, Pig, HBase, Spark).
- Proficiency in Linux/Unix system administration.
- Familiarity with scripting languages (e.g., Python, Bash) for automation.
- Proficiency in version control systems (e.g., Git) and familiarity with CI/CD pipelines.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
- Experience with cloud platforms (e.g., AWS, Azure) and their big data services is a plus.
- Relevant certifications (e.g., Cloudera Certified Administrator for Apache Hadoop) are a plus.
Salary (Rate): undetermined
City: Austin
Country: USA
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
Job Title: Hadoop Admin Full-time
Location: Austin, TX (Remote)
Duration: Long Term
Experience: 5-8 Years
We're searching for a skilled Hadoop Admin to manage and maintain our Hadoop clusters. You'll collaborate with data engineers, developers, and product managers to ensure the reliability, performance, and security of our big data infrastructure.
Responsibilities:
- Install, configure, and maintain Hadoop clusters and related technologies (e.g., HDFS, YARN, MapReduce).
- Monitor cluster performance and troubleshoot issues to ensure optimal performance.
- Perform regular backups, restores, and data recovery procedures.
- Implement and manage security measures to protect data integrity and privacy.
- Work closely with data engineers and developers to support Hadoop operations and application requirements.
- Conduct capacity planning and scaling to meet business needs.
- Write and maintain documentation, including data standards, procedures, and definitions.
- Stay up-to-date on the latest advancements in Hadoop technologies and best practices.
Qualifications:
- 5+ years of experience as a Hadoop Admin.
- In-depth knowledge of Hadoop architecture, administration, and performance tuning.
- Experience with Hadoop ecosystem tools (e.g., Hive, Pig, HBase, Spark).
- Proficiency in Linux/Unix system administration.
- Familiarity with scripting languages (e.g., Python, Bash) for automation.
- Proficiency in version control systems (e.g., Git) and familiarity with CI/CD pipelines.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
- Experience with cloud platforms (e.g., AWS, Azure) and their big data services is a plus.
- Relevant certifications (e.g., Cloudera Certified Administrator for Apache Hadoop) are a plus.
We look forward to meeting you!