girl looking into her desktop
Back to search results

Hadoop Developer

Addison, Texas;

Job Description:

Come join an exciting team within Global Information Security (GIS). Cyber Security Technology (CST) is a globally distributed team responsible for cyber security innovation and architecture, engineering, solutions and capabilities development, cyber resiliency, access management engineering, data strategy, deployment maintenance, technical project management and information technology security control support.

This role is responsible for leading efforts to develop and deliver complex data solutions to accomplish technology and business goals. Key responsibilities include code design and delivery tasks associated with the integration, cleaning, transformation and control of data in operational and analytics data systems. They work with stakeholders, Product Owners and Software Engineers to aid in the implementation of data requirements, analyze performance, conduct research and troubleshoot any issues.  These individuals are proficient in data engineering practices, and have extensive experience of using design and architectural patterns. 

Primary Level of Engagement: Works as a team member under supervision from a more senior domain expert. 

Primary Interactions:

  • Product Owner

  • Scrum Master

  • Development Team

  • Feature Lead

  • Architect

  • Domain Community of Practice

  • Data Scientists

Key Responsibilities:

  • Design and implement data products for cyber security metrics in Big Data environment.

  • Contribute to story refinement/defining requirements

  • Participate in estimating work necessary to realize a story/requirement through the delivery lifecycle.

  • Utilize multiple architectural components in design and development of client requirements.

  • Code complex solutions to integrate, clean, transform and control data in operational and/or analytics data systems per the defined acceptance criteria.

  • Assist team with resolving technical complexities involved in realizing story work.

  • Collaborate with development teams to understand data requirements and ensure the data architecture is feasible to implement and subsequently implemented accurately.

  • Assemble large, complex data sets that meet functional / non-functional requirements.

  • Build processes supporting data transformation, data structures, metadata, data quality controls, dependency and workload management.

  • Define and build data pipelines that enable faster, better, data-informed decision-making within the business.

  • Contribute to existing test suites (integration, regression, and performance), analyze test reports, identify any test issues/errors, and triage the underlying cause.

  • Document and communicate required information for deployment, maintenance, support, and business functionality.

  • Adhere to team delivery/release process and cadence pertaining to code deployment and release

  • Identify gaps in data management standards adherence, and work with appropriate partners to develop plans to close gaps.

  • Lead concept and experimentation testing and synthesize the results to validate and improve analytical solution.

  • Monitor key performance indicators and internal controls.

  • Mentor more junior Data Engineers and coach the team on CI-CD practices and automating tool stack.

Required Skills:

  • Strong Hadoop/Spark Scala Developer

  • Strong Data analysis expertise

  • Strong Experience with HIVE/ SQL

  • Strong knowledge of the Hadoop ecosystem on tools like HIVE/Impala/Spark/Hbase etc

  • Strong troubleshooting  skills for code bugs and data mapping issues

  • Experience using Source Code and Version Control Systems like Bitbucket, Git or SVN

  • Ability to work independently

  • Ability to communicate technical/design solutions with stakeholders

  • Ability to mentor other team members on technical solution building

  • Experience working in an agile environment

  • Strong attention to detail, confident enough to raise questions and identify issues

Enterprise position overview: regression, performance), analyzes test reports, identifies any test issues/errors, and triages the underlying cause. Documents and communicates required information for deployment, maintenance, support, and business functionality. Adheres to team delivery/release process and cadence pertaining to code deployment and release. Identifies gaps in data management standards adherence and works with appropriate partners to develop plans to close gaps. Leads concept and experimentation testing and synthesizes the results to validate and improve analytical solution. Monitors key performance indicators and internal controls. Mentors more junior Data Engineers and coaches team on CI-CD practices and automating tool stack. Individual contributor

Job Band:

H5

Shift: 

1st shift (United States of America)

Hours Per Week:

40

Weekly Schedule:

Referral Bonus Amount:

0

Job Description:

Come join an exciting team within Global Information Security (GIS). Cyber Security Technology (CST) is a globally distributed team responsible for cyber security innovation and architecture, engineering, solutions and capabilities development, cyber resiliency, access management engineering, data strategy, deployment maintenance, technical project management and information technology security control support.

This role is responsible for leading efforts to develop and deliver complex data solutions to accomplish technology and business goals. Key responsibilities include code design and delivery tasks associated with the integration, cleaning, transformation and control of data in operational and analytics data systems. They work with stakeholders, Product Owners and Software Engineers to aid in the implementation of data requirements, analyze performance, conduct research and troubleshoot any issues.  These individuals are proficient in data engineering practices, and have extensive experience of using design and architectural patterns. 

Primary Level of Engagement: Works as a team member under supervision from a more senior domain expert. 

Primary Interactions:

  • Product Owner

  • Scrum Master

  • Development Team

  • Feature Lead

  • Architect

  • Domain Community of Practice

  • Data Scientists

Key Responsibilities:

  • Design and implement data products for cyber security metrics in Big Data environment.

  • Contribute to story refinement/defining requirements

  • Participate in estimating work necessary to realize a story/requirement through the delivery lifecycle.

  • Utilize multiple architectural components in design and development of client requirements.

  • Code complex solutions to integrate, clean, transform and control data in operational and/or analytics data systems per the defined acceptance criteria.

  • Assist team with resolving technical complexities involved in realizing story work.

  • Collaborate with development teams to understand data requirements and ensure the data architecture is feasible to implement and subsequently implemented accurately.

  • Assemble large, complex data sets that meet functional / non-functional requirements.

  • Build processes supporting data transformation, data structures, metadata, data quality controls, dependency and workload management.

  • Define and build data pipelines that enable faster, better, data-informed decision-making within the business.

  • Contribute to existing test suites (integration, regression, and performance), analyze test reports, identify any test issues/errors, and triage the underlying cause.

  • Document and communicate required information for deployment, maintenance, support, and business functionality.

  • Adhere to team delivery/release process and cadence pertaining to code deployment and release

  • Identify gaps in data management standards adherence, and work with appropriate partners to develop plans to close gaps.

  • Lead concept and experimentation testing and synthesize the results to validate and improve analytical solution.

  • Monitor key performance indicators and internal controls.

  • Mentor more junior Data Engineers and coach the team on CI-CD practices and automating tool stack.

Required Skills:

  • Strong Hadoop/Spark Scala Developer

  • Strong Data analysis expertise

  • Strong Experience with HIVE/ SQL

  • Strong knowledge of the Hadoop ecosystem on tools like HIVE/Impala/Spark/Hbase etc

  • Strong troubleshooting  skills for code bugs and data mapping issues

  • Experience using Source Code and Version Control Systems like Bitbucket, Git or SVN

  • Ability to work independently

  • Ability to communicate technical/design solutions with stakeholders

  • Ability to mentor other team members on technical solution building

  • Experience working in an agile environment

  • Strong attention to detail, confident enough to raise questions and identify issues

Enterprise position overview: regression, performance), analyzes test reports, identifies any test issues/errors, and triages the underlying cause. Documents and communicates required information for deployment, maintenance, support, and business functionality. Adheres to team delivery/release process and cadence pertaining to code deployment and release. Identifies gaps in data management standards adherence and works with appropriate partners to develop plans to close gaps. Leads concept and experimentation testing and synthesizes the results to validate and improve analytical solution. Monitors key performance indicators and internal controls. Mentors more junior Data Engineers and coaches team on CI-CD practices and automating tool stack. Individual contributor

Shift:

1st shift (United States of America)

Hours Per Week: 

40

Learn more about this role

Full time

JR-21054624

Band: H5

Manages People: No

Travel: Yes, 5% of the time

Manager:

Talent Acquisition Contact:

Nicolas Skaric

Referral Bonus:

0