girl looking into her desktop
Back to search results

Apache Spark Principal Engineer, Global Risk Analytics

Charlotte, North Carolina;

Job Description:

Responsible for defining and leading the engineering approach for solutions at the program or portfolio level to deliver significant business outcomes. Continuously improves the design, quality, and reuse of the solution and delivering technology enablers that improve development efficiencies for the solution. Is an expert in at least one area of engineering and acts as a go to reference across the organization. Plays a role in improving technical competency through recruitment and development activities. Accountable for the engineering approach for the entire program/portfolio solution. Works with Architecture, to develop/analyze/deliver the implementation of technical enablers. Leads the planning, definition, and design of the complex features which span multiple teams and explores solution alternatives. Creates ideas on designing complex technology and solution development approaches - e.g. boundary condition coverage for complex technology issues. Helps validate the economic impact of design decisions. Leads the technical oversight for teams in solution development including design reviews and code within own domain. Supports/mentors/coaches team(s) on design and best practices for high code performance - e.g. pairing, code reviews. Accountable for defining the technology tool stack for the solution within ranged of internally approved and supported technologies. Explores state-of-the-art technologies to improve development efficiencies, quality of test/QA coverage, and release management. Leads and is responsible for the end-to-end test strategy/creation/adherence, and the integration between teams for a program/portfolio solution. Enables a program/portfolio solution with CI/CD capabilities and release management; responsible for maximizing reusability, ensuring process optimization and efficient functioning of CI-CD pipeline. Individual contributor.

Global Risk Analytics (GRA) technology group within bank of America is looking for a talented Apache Spark programmer Guru to join our growing team. We are building the next generation platform for model development and execution for our business partners. The vision for this platform is to provide generic capabilities to author workflows that will run model execution and related processes at scale on our internal compute grid. The platform is meant to provide a high degree of abstraction where model developers will define the data they want to bring in, the processing of the data, and the results, all via generic constructs provided by the platform. The platform will be built from the ground up with distributed compute designed in as a core concept, such that all workloads will be distributed optimally with minimal input from model developers who will author workflows.

This is a hands on, individual contributor role which will be focused on building and optimizing the distributed compute strategy of the execution DAG. This role will require detailed knowledge of Apache Spark internals, beyond being an expert user of the Spark API. This role will also be heavily engaged in training/educating current team members on spark internals, participating in code reviews and establishing best practices on spark usage across the team. This is an exciting opportunity that will exercise the distributed programming mettle of the most skilled Apache Spark Guru.

    Required Skills:

    • 10+ years of relevant experience
    • Experience in implementing complex distributed compute systems with generic capabilities using Apache Spark
    • Deep knowledge on Apache Spark internals
    • Ability to come up with a strategy factory that can dynamically create an execution plan for optimal distributed compute on a Spark grid for varying workloads
    • Ability to establish architectural direction to align the evolution of the platform with most optimum spark usage
    • Ability to direct senior engineers on the team, actively participate in code reviews and provide feedback for effective solution implementation
    • Knowledge of Advanced Algorithms and Graph Theory
    • Deep Python expertise

    Desired Skills:

    • Advanced degree in computer science or mathematics
    • Apache Spark committer
    • Experience in building a software product/platform/framework from ground up
    • Strong Problem Solving and trouble shooting skills
    • Being able work under pressure and tight dead-lines
    • Being able to take pride in writing elegant code with industry standards
    • Experience in Test Driven Development

    Primary Skill:

    • Spark

    Secondary Skill:

    • Tertiary Skill

    Global Risk Analytics:

    • Believes diversity makes us stronger so we can reflect, connect and meet the diverse needs of our clients and employees around the world.
    • Is committed to building a workplace where every employee is welcomed and given the support and resources to perform their jobs successfully.
    • Wants to be a great place for people to work and strives to create an environment where all employees have the opportunity to achieve their goals.
    • Provides continuous training and development opportunities to help employees achieve their career goals, whatever their background or experience.
    • Is committed to advancing our tools, technology, and ways of working to better serve our clients and their evolving business needs.
    • Believes in responsible growth and is dedicated to supporting our communities by connecting them to the lending, investing and giving them what they need to remain vibrant and vital.

    Job Band:

    H4

    Shift: 

    1st shift (United States of America)

    Hours Per Week:

    40

    Weekly Schedule:

    Referral Bonus Amount:

    0

    Job Description:

    Responsible for defining and leading the engineering approach for solutions at the program or portfolio level to deliver significant business outcomes. Continuously improves the design, quality, and reuse of the solution and delivering technology enablers that improve development efficiencies for the solution. Is an expert in at least one area of engineering and acts as a go to reference across the organization. Plays a role in improving technical competency through recruitment and development activities. Accountable for the engineering approach for the entire program/portfolio solution. Works with Architecture, to develop/analyze/deliver the implementation of technical enablers. Leads the planning, definition, and design of the complex features which span multiple teams and explores solution alternatives. Creates ideas on designing complex technology and solution development approaches - e.g. boundary condition coverage for complex technology issues. Helps validate the economic impact of design decisions. Leads the technical oversight for teams in solution development including design reviews and code within own domain. Supports/mentors/coaches team(s) on design and best practices for high code performance - e.g. pairing, code reviews. Accountable for defining the technology tool stack for the solution within ranged of internally approved and supported technologies. Explores state-of-the-art technologies to improve development efficiencies, quality of test/QA coverage, and release management. Leads and is responsible for the end-to-end test strategy/creation/adherence, and the integration between teams for a program/portfolio solution. Enables a program/portfolio solution with CI/CD capabilities and release management; responsible for maximizing reusability, ensuring process optimization and efficient functioning of CI-CD pipeline. Individual contributor.

    Global Risk Analytics (GRA) technology group within bank of America is looking for a talented Apache Spark programmer Guru to join our growing team. We are building the next generation platform for model development and execution for our business partners. The vision for this platform is to provide generic capabilities to author workflows that will run model execution and related processes at scale on our internal compute grid. The platform is meant to provide a high degree of abstraction where model developers will define the data they want to bring in, the processing of the data, and the results, all via generic constructs provided by the platform. The platform will be built from the ground up with distributed compute designed in as a core concept, such that all workloads will be distributed optimally with minimal input from model developers who will author workflows.

    This is a hands on, individual contributor role which will be focused on building and optimizing the distributed compute strategy of the execution DAG. This role will require detailed knowledge of Apache Spark internals, beyond being an expert user of the Spark API. This role will also be heavily engaged in training/educating current team members on spark internals, participating in code reviews and establishing best practices on spark usage across the team. This is an exciting opportunity that will exercise the distributed programming mettle of the most skilled Apache Spark Guru.

      Required Skills:

      • 10+ years of relevant experience
      • Experience in implementing complex distributed compute systems with generic capabilities using Apache Spark
      • Deep knowledge on Apache Spark internals
      • Ability to come up with a strategy factory that can dynamically create an execution plan for optimal distributed compute on a Spark grid for varying workloads
      • Ability to establish architectural direction to align the evolution of the platform with most optimum spark usage
      • Ability to direct senior engineers on the team, actively participate in code reviews and provide feedback for effective solution implementation
      • Knowledge of Advanced Algorithms and Graph Theory
      • Deep Python expertise

      Desired Skills:

      • Advanced degree in computer science or mathematics
      • Apache Spark committer
      • Experience in building a software product/platform/framework from ground up
      • Strong Problem Solving and trouble shooting skills
      • Being able work under pressure and tight dead-lines
      • Being able to take pride in writing elegant code with industry standards
      • Experience in Test Driven Development

      Primary Skill:

      • Spark

      Secondary Skill:

      • Tertiary Skill

      Global Risk Analytics:

      • Believes diversity makes us stronger so we can reflect, connect and meet the diverse needs of our clients and employees around the world.
      • Is committed to building a workplace where every employee is welcomed and given the support and resources to perform their jobs successfully.
      • Wants to be a great place for people to work and strives to create an environment where all employees have the opportunity to achieve their goals.
      • Provides continuous training and development opportunities to help employees achieve their career goals, whatever their background or experience.
      • Is committed to advancing our tools, technology, and ways of working to better serve our clients and their evolving business needs.
      • Believes in responsible growth and is dedicated to supporting our communities by connecting them to the lending, investing and giving them what they need to remain vibrant and vital.

      Shift:

      1st shift (United States of America)

      Hours Per Week: 

      40

      Learn more about this role

      Full time

      JR-21056203

      Band: H4

      Manages People: No

      Travel: No

      Manager:

      Talent Acquisition Contact:

      Mindy Savage

      Referral Bonus:

      0