Analyst, Senior Data Engineering

Enterprise Products

$100K — $130K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of programming experience in Python.
  • Expertise in developing and maintaining data pipelines.
  • Knowledge of software engineering best practices including CI/CD and version control.
  • Strong grasp of Object-Oriented and Functional Programming principles.
  • Familiarity with Python Data Engineering packages like Pandas, Numpy, and Scikit-Learn.
  • Experience with distributed computing systems.
  • Understanding of DevOps principles.

Responsibilities

  • Collaborate with subject matter experts to build high-quality software solutions.
  • Design frameworks to enhance the machine learning workflow.
  • Implement data transformation logic for diverse use cases.
  • Develop fault-tolerant microservices using best architecture practices.
  • Document coding and architectural decisions to improve maintainability.
  • Establish processes for coding standards and code quality assurance.
Full Job Description
We are currently seeking an experienced Python Software Engineer to join the Big Data and Advanced Analytics department. The Python Software Engineer will work closely with Data Engineers and Data Scientists to solve real-world oil and gas midstream problems using advanced analytics and machine learning.

  • Work directly with subject matter experts to develop high quality, reliable, scalable, software products.
  • Design and implement frameworks and tools to streamline the machine learning process.
  • Implement data manipulation and transformation logic to support various use cases.
  • Leverage software architecture and design patterns to develop fault tolerant microservices.
  • Document code and architectural decisions to support maintainability.
  • Implement processes to ensure coding standards, code quality, documentation, and test coverage.


Qualifications

The successful candidate will meet the following qualifications:

  • 5+ years of programming experience in Python.
  • Expertise in developing and maintaining data pipelines.
  • Experience in software engineering practices such as Design Principles and Patterns, Unit Testing, Refactoring, CI/CD, and version control.
  • Expertise in Object-Oriented Design Principals and Functional Programming Principals.
  • Experience with common Python Data Engineering packages including Pandas, Numpy, Pyarrow, Pytest, Scikit-Learn, and Boto3.
  • Experience in implementing distributed computing systems.
  • Knowledgeable of DevOps Principles.
  • Experience in designing modular, reusable software components.
  • Experience in developing API endpoints and microservices..

Similar Jobs

More Jobs at Enterprise Products

More Information Technology Jobs

Find similar Analyst, Senior Data Engineering jobs: