Back to search results

Big Data/Hadoop Software Engineer III

Jersey City, New Jersey

Job Description:

Description:  Looking for a big data developer to join our Front To Back Pre-Trade Data team, which focuses on delivering trade data to compliance partners for critical trade surveillances and other regulatory requirements. Data will also be used for analytics purpose.

 

Responsibilities:  Design, build and maintain Big Data workflows/pipelines to process millions of records into and out of our data lake.  Engage in application design and data modeling discussions. Build, maintain and execute unit test cases with high code coverage.

 

Responsible for designing and developing complex requirements to accomplish business goals. Ensures that software is developed to meet functional, non-functional, and compliance requirements. Ensures solutions are well designed with maintainability/ease of integration and testing built-in from the outset. Possess strong proficiency in development and testing practices common to the industry, and have extensive experience of using design and architectural patterns. At this level, specializations start to form in either Architecture, Test Engineering or DevOp. Contributes to story refinement/defining requirements. Participates and guides team in estimating work necessary to realize a story/requirement through the delivery lifecycle. Performs spike/proof of concept as necessary to mitigate risk or implement new ideas. Codes solutions and unit tests to deliver a requirement/story per the defined acceptance criteria and compliance requirements. Utilizes multiple architectural components (across data, application, business) in design and development of client requirements. Assists team with resolving technical complexities involved in realizing story work. Designs/develops/modifies architecture components, application interfaces, and solution enablers while ensuring principal architecture integrity is maintained. Designs/develops/maintains automated test suites (integration, regression, performance). Sets up and develops a continuous integration/continuous delivery pipeline. Automates manual release activities. Mentors other Software Engineers and coaches team on CI-CD practices and automating tool stack. Individual contributor.

Required Skills:

  • Minimum 3 years development experience with Big Data/Hadoop Ecosystem

  • Hands-on Expertise with Impala, Spark and Kafka programming

  • Exposure to NoSQL data store solutions (Elastic Search, Solr)

  • Understanding of application security standards and best practices

  • Knowledge of performance tuning and process multithreading

  • Data Architecture, DevOps Environment Experience

  • Excellent communication and problem solving skills

Desired Skills:

  • Experience in Machine Learning techniques would be an added advantage
  • BS/BA in Computer Science or related experience


Bank of America's Global Banking and Markets Technology Organization....

•Believes diversity makes us stronger so we can reflect, connect and meet the diverse needs of our clients and employees around the world.
•Is committed to building a workplace where every employee is welcomed and given the support and resources to perform their jobs successfully.
•Wants to be a great place for people to work and strives to create an environment where all employees have the opportunity to achieve their goals.
•Provides continuous training and development opportunities to help employees achieve their career goals, whatever their background or experience.
•Is committed to advancing our tools, technology, and ways of working to better serve our clients and their evolving business needs.
•Believes in responsible growth and is dedicated to supporting our communities by connecting them to the lending, investing and giving them what they need to remain vibrant and vital.

Job Band:

H5

Shift: 

1st shift (United States of America)

Hours Per Week:

40

Weekly Schedule:

Referral Bonus Amount:

0

Job Description:

Description:  Looking for a big data developer to join our Front To Back Pre-Trade Data team, which focuses on delivering trade data to compliance partners for critical trade surveillances and other regulatory requirements. Data will also be used for analytics purpose.

 

Responsibilities:  Design, build and maintain Big Data workflows/pipelines to process millions of records into and out of our data lake.  Engage in application design and data modeling discussions. Build, maintain and execute unit test cases with high code coverage.

 

Responsible for designing and developing complex requirements to accomplish business goals. Ensures that software is developed to meet functional, non-functional, and compliance requirements. Ensures solutions are well designed with maintainability/ease of integration and testing built-in from the outset. Possess strong proficiency in development and testing practices common to the industry, and have extensive experience of using design and architectural patterns. At this level, specializations start to form in either Architecture, Test Engineering or DevOp. Contributes to story refinement/defining requirements. Participates and guides team in estimating work necessary to realize a story/requirement through the delivery lifecycle. Performs spike/proof of concept as necessary to mitigate risk or implement new ideas. Codes solutions and unit tests to deliver a requirement/story per the defined acceptance criteria and compliance requirements. Utilizes multiple architectural components (across data, application, business) in design and development of client requirements. Assists team with resolving technical complexities involved in realizing story work. Designs/develops/modifies architecture components, application interfaces, and solution enablers while ensuring principal architecture integrity is maintained. Designs/develops/maintains automated test suites (integration, regression, performance). Sets up and develops a continuous integration/continuous delivery pipeline. Automates manual release activities. Mentors other Software Engineers and coaches team on CI-CD practices and automating tool stack. Individual contributor.

Required Skills:

  • Minimum 3 years development experience with Big Data/Hadoop Ecosystem

  • Hands-on Expertise with Impala, Spark and Kafka programming

  • Exposure to NoSQL data store solutions (Elastic Search, Solr)

  • Understanding of application security standards and best practices

  • Knowledge of performance tuning and process multithreading

  • Data Architecture, DevOps Environment Experience

  • Excellent communication and problem solving skills

Desired Skills:

  • Experience in Machine Learning techniques would be an added advantage
  • BS/BA in Computer Science or related experience


Bank of America's Global Banking and Markets Technology Organization....

•Believes diversity makes us stronger so we can reflect, connect and meet the diverse needs of our clients and employees around the world.
•Is committed to building a workplace where every employee is welcomed and given the support and resources to perform their jobs successfully.
•Wants to be a great place for people to work and strives to create an environment where all employees have the opportunity to achieve their goals.
•Provides continuous training and development opportunities to help employees achieve their career goals, whatever their background or experience.
•Is committed to advancing our tools, technology, and ways of working to better serve our clients and their evolving business needs.
•Believes in responsible growth and is dedicated to supporting our communities by connecting them to the lending, investing and giving them what they need to remain vibrant and vital.

Shift:

1st shift (United States of America)

Hours Per Week: 

40

Learn more about this role

Full time

JR-21063305

Band: H5

Manages People: No

Travel: No

Manager:

Talent Acquisition Contact:

Amie Reynoso

Referral Bonus:

0

Street Address

Primary Location:
101 HUDSON ST, NJ, Jersey City, 07302