girl looking into her desktop
Back to search results

Hadoop Client Services Analyst - Core Technology Infrastructure

Pennington, New Jersey;

Job Description:

Data Store and Compute Platform Client Services(DCS) team is seeking a Hadoop Developer/ SME who will be responsible for providing technical and administrative support for Linux, Cloud, and Hadoop platforms in a fast-paced operations environment supporting  business critical applications using HDFS, Sentry, Impala, Spark, and Hive. WebUI development skills is plus.

Client Services Analyst will provide onboarding, lower lane support and capacity management for Hadoop platform. Analyst should be able to perform troubleshooting of any Hadoop ecosystem services issues, performance analysis, ensuring security, developing and testing Unix Shell scripts, scripting in Perl, Java and coding required for Hadoop administration and associated core Hadoop ecosystem. Candidate will also be involved with the setup and transitioning of Hadoop application tenants from Hadoop bare metal clusters to virtual machines.

Responsibilities Include:

  • Proven understanding with Cloudera Hadoop, IMPALA, Hive, HBase, Sqoop, Apache Spark, Nifi, security Sentry/Ranger, Metadata Navigator/Atlas etc
  • Administer, troubleshoot, perform problem isolation and correct problems discovered in clusters
  • Performance tuning of Hadoop clusters and ecosystem components and jobs. This includes the management and review of Hadoop log files.
  • Provide code deployment support for Test and Production environments
  • Diagnose and address database performance issues using performance monitors and various tuning techniques including Cloudera Manager
  • Interact with Storage and Systems administrators on Linux/Unix/VM operating systems and Hadoop Ecosystems
  • Troubleshoot platform problems and connectivity issues
  • Document programming problems and resolutions for future reference
  • Participate in Agile Scrum routines and provide accurate status of Hadoop Platform service requests.

Required Skills

  • Ability to work well as a team and as an individual with minimal supervision
  • At least 3 years of Hadoop Platform support experience
  • Scripting/programming/development experience - Shell/Python/Java
  • Excellent communication and project management skills
  • Bachelor’s Degree in Information Technology, Engineering, Computer Science, related field or equivalent work experience
  • At least 3 years of experience in Big Data technologies and concepts with a solid understanding of Big Data technology
  • At least 3 years of experience in a large Data Warehouse environment.
  • At least 3 years of experience in Linux/Unix.
  • At least 2 years of experience with scheduling tools such as Autosys.
  • Experience with developer tools for code management, ticket management, performance monitoring, automated testing
  • Strong understanding of Data Warehousing concepts
  • Solid understanding and experience with Agile process and vernacular
  • Solid understanding and experience with CI/CD concepts
  • Deep knowledge of industry-standard, enterprise-class best practices for a large DFS environment
  • Solid understand of DevOps model
  • Good understanding of Linux/VM platform and Information Security

Desired Skills

  • Experience in CDH6, CDP
  • Exposure to Cloudera Manager
  • UI Development Experience
  • Automation/Building tools or utilities experience

Enterprise Role Overview:

Participates in design, development and implementation of architectural deliverables, to include components of the assessment and optimization of system design and review of user requirements. Contributes to the determination of technical and operational feasibility of solutions. Develops prototypes of the system design and works with database, operations, technical support and other IT areas as appropriate throughout development and implementation processes. May lead multiple projects with competing deadlines. Serves as a fully seasoned/proficient technical resource; provides tech knowledge and capabilities as team member and individual contributor. Will not have direct reports but will influence and direct activities of a team related to special initiatives or operations, as well as mentor junior band 5 Architect 1's. Provides input on staffing, budget and personnel. Typically 7 or more years of architecture experience.

Job Band:

H5

Shift: 

1st shift (United States of America)

Hours Per Week:

40

Weekly Schedule:

Referral Bonus Amount:

0

Job Description:

Data Store and Compute Platform Client Services(DCS) team is seeking a Hadoop Developer/ SME who will be responsible for providing technical and administrative support for Linux, Cloud, and Hadoop platforms in a fast-paced operations environment supporting  business critical applications using HDFS, Sentry, Impala, Spark, and Hive. WebUI development skills is plus.

Client Services Analyst will provide onboarding, lower lane support and capacity management for Hadoop platform. Analyst should be able to perform troubleshooting of any Hadoop ecosystem services issues, performance analysis, ensuring security, developing and testing Unix Shell scripts, scripting in Perl, Java and coding required for Hadoop administration and associated core Hadoop ecosystem. Candidate will also be involved with the setup and transitioning of Hadoop application tenants from Hadoop bare metal clusters to virtual machines.

Responsibilities Include:

  • Proven understanding with Cloudera Hadoop, IMPALA, Hive, HBase, Sqoop, Apache Spark, Nifi, security Sentry/Ranger, Metadata Navigator/Atlas etc
  • Administer, troubleshoot, perform problem isolation and correct problems discovered in clusters
  • Performance tuning of Hadoop clusters and ecosystem components and jobs. This includes the management and review of Hadoop log files.
  • Provide code deployment support for Test and Production environments
  • Diagnose and address database performance issues using performance monitors and various tuning techniques including Cloudera Manager
  • Interact with Storage and Systems administrators on Linux/Unix/VM operating systems and Hadoop Ecosystems
  • Troubleshoot platform problems and connectivity issues
  • Document programming problems and resolutions for future reference
  • Participate in Agile Scrum routines and provide accurate status of Hadoop Platform service requests.

Required Skills

  • Ability to work well as a team and as an individual with minimal supervision
  • At least 3 years of Hadoop Platform support experience
  • Scripting/programming/development experience - Shell/Python/Java
  • Excellent communication and project management skills
  • Bachelor’s Degree in Information Technology, Engineering, Computer Science, related field or equivalent work experience
  • At least 3 years of experience in Big Data technologies and concepts with a solid understanding of Big Data technology
  • At least 3 years of experience in a large Data Warehouse environment.
  • At least 3 years of experience in Linux/Unix.
  • At least 2 years of experience with scheduling tools such as Autosys.
  • Experience with developer tools for code management, ticket management, performance monitoring, automated testing
  • Strong understanding of Data Warehousing concepts
  • Solid understanding and experience with Agile process and vernacular
  • Solid understanding and experience with CI/CD concepts
  • Deep knowledge of industry-standard, enterprise-class best practices for a large DFS environment
  • Solid understand of DevOps model
  • Good understanding of Linux/VM platform and Information Security

Desired Skills

  • Experience in CDH6, CDP
  • Exposure to Cloudera Manager
  • UI Development Experience
  • Automation/Building tools or utilities experience

Enterprise Role Overview:

Participates in design, development and implementation of architectural deliverables, to include components of the assessment and optimization of system design and review of user requirements. Contributes to the determination of technical and operational feasibility of solutions. Develops prototypes of the system design and works with database, operations, technical support and other IT areas as appropriate throughout development and implementation processes. May lead multiple projects with competing deadlines. Serves as a fully seasoned/proficient technical resource; provides tech knowledge and capabilities as team member and individual contributor. Will not have direct reports but will influence and direct activities of a team related to special initiatives or operations, as well as mentor junior band 5 Architect 1's. Provides input on staffing, budget and personnel. Typically 7 or more years of architecture experience.

Shift:

1st shift (United States of America)

Hours Per Week: 

40

Learn more about this role

Full time

JR-21049770

Band: H5

Manages People: No

Travel: Yes, 5% of the time

Manager:

Talent Acquisition Contact:

Kathleen Jones-Griffith

Referral Bonus:

0