girl looking into her desktop
Back to search results

Data Engineer III - Core Technology Infrastructure

Pennington, New Jersey;

Job Description:

Responsibilities:

• The developer is responsible for working with the Architecture, Governance, Service Design Team to design, document, build, secure, and maintain Elasticsearch, Logstash, Kibana (and X-Pack) and Beats modules.

• Work closely with architects, engineers, and integrators to assess customer requirements and to design and support an Instabase, Elasticsearch Stack solution to ensure compliance with dashboard data requirements.

• Follow life cycle processes to move solutions from DEV to UAT to Production.

• Develops middle tier components, API and Services in support of large initiatives and project.

• Leads the development of one or more features simultaneously in Agile Scrum methodology.

• Undertakes complex platform initiatives that may involve multiple LoBs.

• Enforcing code quality and governance processes for API development and Services.

• Be able to develop orchestration and transformations via Restful Services.

• Participate in group sessions as well as attend and share in agile sprint daily meetings in order to track progress to ensure development of solutions is in support of the CDM project and customer requirements.

• Serve as a trusted advisor, providing subject matter expertise, guidance, and best practice recommendations.

• Configuring and maintaining Linux based Operating system files in support of the Elasticsearch products (yum updates and product version upgrades)

• Installing and configuring an Elastic Cloud Enterprise solution in a lab and ensuring communication and integration among the Elasticsearch products and data sources

• Documenting the installation and configuration for deployment into production

• Securing the solution by being familiarity with TLS, certificates, SSO/PIV authentication, and encryption technologies

• Testing data flows, troubleshooting issues, and monitoring the health of the solution and servers to maximize performance and minimize downtime

• Working with a team and providing analysis of alternatives and progress status in daily sprint meetings

• Meet professional obligations through efficient work habits such as, meeting deadlines, honoring schedules, coordinating resources and meetings in an effective and timely manner

• Develop and manage effective working relationships with other departments, groups and personnel with whom work must be coordinated or interface

• Recommend enhancements and modifications to optimize business intelligence processes

Required Skills:

Python & Java

Linux, CentOS and/or Red Hat Enterprise Linux (RHEL) experience

Experience with data ingest, Extract, Transform, and Load (ETL) techniques preferable Logstash and Beats

Experience with multi-node clustering, architecture, development, implementation, and health monitoring of the indexes. Knowledge of hot/warm/cold data/index lifecycle management implementations

Desired Skills

Bachelor’s degree or equivalent experience

Knowledge of Elasticsearch Management

Knowledge of reindexing and data mappings

Knowledge of JSON and KQL searching syntax

Knowledge of Kibana dashboard options

Knowledge of Mulesoft anypoint studio

Experience with automated configuration management tool and playbooks (Ansible, Chef, Puppet, SaltStack) and (Docker) containers, and GitHub

Experience with NoSQL solutions: Lucene or SIEM (e.g. Splunk)

Experience working in DevOps structured and Agile organizations

Experience with Elasticsearch stack (Elasticsearch, Logstash, Beats, Kibana, and X-pack) is truly an added advantage

Job Band:

H5

Shift: 

1st shift (United States of America)

Hours Per Week:

40

Weekly Schedule:

Referral Bonus Amount:

0

Job Description:

Responsibilities:

• The developer is responsible for working with the Architecture, Governance, Service Design Team to design, document, build, secure, and maintain Elasticsearch, Logstash, Kibana (and X-Pack) and Beats modules.

• Work closely with architects, engineers, and integrators to assess customer requirements and to design and support an Instabase, Elasticsearch Stack solution to ensure compliance with dashboard data requirements.

• Follow life cycle processes to move solutions from DEV to UAT to Production.

• Develops middle tier components, API and Services in support of large initiatives and project.

• Leads the development of one or more features simultaneously in Agile Scrum methodology.

• Undertakes complex platform initiatives that may involve multiple LoBs.

• Enforcing code quality and governance processes for API development and Services.

• Be able to develop orchestration and transformations via Restful Services.

• Participate in group sessions as well as attend and share in agile sprint daily meetings in order to track progress to ensure development of solutions is in support of the CDM project and customer requirements.

• Serve as a trusted advisor, providing subject matter expertise, guidance, and best practice recommendations.

• Configuring and maintaining Linux based Operating system files in support of the Elasticsearch products (yum updates and product version upgrades)

• Installing and configuring an Elastic Cloud Enterprise solution in a lab and ensuring communication and integration among the Elasticsearch products and data sources

• Documenting the installation and configuration for deployment into production

• Securing the solution by being familiarity with TLS, certificates, SSO/PIV authentication, and encryption technologies

• Testing data flows, troubleshooting issues, and monitoring the health of the solution and servers to maximize performance and minimize downtime

• Working with a team and providing analysis of alternatives and progress status in daily sprint meetings

• Meet professional obligations through efficient work habits such as, meeting deadlines, honoring schedules, coordinating resources and meetings in an effective and timely manner

• Develop and manage effective working relationships with other departments, groups and personnel with whom work must be coordinated or interface

• Recommend enhancements and modifications to optimize business intelligence processes

Required Skills:

Python & Java

Linux, CentOS and/or Red Hat Enterprise Linux (RHEL) experience

Experience with data ingest, Extract, Transform, and Load (ETL) techniques preferable Logstash and Beats

Experience with multi-node clustering, architecture, development, implementation, and health monitoring of the indexes. Knowledge of hot/warm/cold data/index lifecycle management implementations

Desired Skills

Bachelor’s degree or equivalent experience

Knowledge of Elasticsearch Management

Knowledge of reindexing and data mappings

Knowledge of JSON and KQL searching syntax

Knowledge of Kibana dashboard options

Knowledge of Mulesoft anypoint studio

Experience with automated configuration management tool and playbooks (Ansible, Chef, Puppet, SaltStack) and (Docker) containers, and GitHub

Experience with NoSQL solutions: Lucene or SIEM (e.g. Splunk)

Experience working in DevOps structured and Agile organizations

Experience with Elasticsearch stack (Elasticsearch, Logstash, Beats, Kibana, and X-pack) is truly an added advantage

Shift:

1st shift (United States of America)

Hours Per Week: 

40

Learn more about this role

Full time

JR-21053638

Band: H5

Manages People: No

Travel: No

Manager:

Talent Acquisition Contact:

Kathleen Jones-Griffith

Referral Bonus:

0