Go to our website »

Jobs at MetaOption, LLC


Location: San Francisco, CA

Type: Full Time

Min. Experience: Experienced

Position: Senior Hadoop Administrator

Location: San Francisco CA

Duration: FTE


Job Description:




Client’s Technical Operations team is looking for a Senior Hadoop Administrator who will be responsible for assisting with the design, implementation, and ongoing support of the Big Data platforms.

Major Duties and Responsibilities

• Manage large scale Hadoop cluster environments, handling all Hadoop environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring.

• Evaluate and recommend systems software and hardware for the enterprise system including capacity modeling.

• Contribute to the evolving architecture of our storage service to meet changing requirements for scaling, reliability, performance, manageability, and price.

• Work with core production support personnel in IT and Engineering to automate deployment and operation of the infrastructure. Manage, deploy and configure infrastructure with Puppet or other automation toolsets.

• Ability to work with and as a member of the IT Operations group as required to refine our Production capabilities: testing, kernel issues, compatibility and deployment of new versions of custom software.

• Identify hardware and software technical problems, storage and/or related system malfunctions.

• Creation of metrics and measures of utilization and performance.

• Capacity planning and implementation of new/upgraded hardware and software releases as well as for storage infrastructure.

• Responsible for monitoring the Linux community and report on important changes/enhancements to the team.

• Ability to work well with a global team of highly motivated and skilled personnel - interaction and dialog are requisites in this dynamic environment.

• Research and recommend innovative, and where possible, automated approaches for system administration tasks. Identify approaches that leverage our resources, provide economies of scale, and simplify remote/global support issues.

• Perform other work related duties as assigned.

Minimum Qualifications

7 years of professional experience supporting production medium to large scale Linux environments.

5 years of professional experience working with Hadoop (HDFS & MapReduce) and related technology stack.

A deep understanding of Hadoop design principals, cluster connectivity, security and the factors that affect distributed system performance.

MapR experience a plus.

Solid understanding of automation tools (puppet, chef, ansible).

• Expert experience with at least one if not most of the following languages; python, perl, ruby, or bash.

• Prior experience with remote monitoring and event handling using Nagios, ELK.

Solid ability to create automation with Chef, Puppet, Ansible or a shell.

• Good collaboration & communication skills, the ability to participate in an interdisciplinary team.

• Strong written communications and documentation experience

• Knowledge of best practices related to security, performance, and disaster recovery.

Preferred Qualifications

• Experience with complex networking infrastructure including firewalls, VLANs, and load balancers.

• AWS and Google Compute experience a plus.

• Prior experience with performance tuning, capacity planning, and workload mapping a plus.

• Google Apps experience preferred.


This is an on-site, full-time salaried position located in San Francisco office. Compensation depends on prior experience. Client pays market-leading compensation and provides Equity participation, best in class comprehensive health plans including medical, vision and dental, in addition to generous PTO Client reimburses 50% of monthly commuting costs for parking and/or mass transit up to the IRS limitations.This is a great opportunity to really make a big impact on a business, which is highly ambitious and going through a highly exciting stage of Client growth!

Forward this Position
Recipient email address (one)
Your name
Your email address
Enter a message (optional)
Human Check*
Apply for this Position
* Required fields
First name*
Last name*
Email address*
Phone number*

Attach resume as .pdf, .doc, or .docx (limit 2MB) or paste resume

Paste your resume here or attach resume file

Cover Letter*
In 150 characters or fewer, tell us what makes you unique. Try to be creative and say something that will catch our eye!*