If you're ready to join a team of talented developers, you belong here. We are seeking Data Engineers to join our Software + Solutions Developer team and work with subject matter experts to develop, construct, and implement database and scaled processing systems and infrastructure. These solutions comprise hosted and on-prem systems that ingest batch and streaming data that will support STEM use cases like physical testing and validation, online processing data, ML/AI, and data analysis.
Job responsibilities:- Design, develop, and maintain scalable data architectures and ETL pipelines, integrating data from various sources to ensure seamless and secure data flow across on-premise and cloud platforms.
- Collaborate with cross-functional teams to build custom software solutions tailored to MDMi's clients, specializing in materials, chemical, and STEM data management, using technologies like Apache Spark and Delta Lake
- Apply data management best practices for optimized storage, retrieval, and governance, ensuring compliance with security standards and enhancing data quality across Databricks infrastructure.
- Partner with data scientists and software developers to enable the integration of machine learning models into data pipelines, supporting advanced analytics, reporting, and automated decision-making.
- Develop feature engineering pipelines and implement model-serving solutions using Python-native frameworks.
- Author and maintain well-documented Python scripts, libraries, and applications to address various engineering and data management needs, fostering code reusability and long-term maintainability.
- Engage directly with clients to understand their technical needs, define solution requirements, deploy applications, and provide on-site support as needed, building strong customer relationships.
- Utilize industry-standard tools for source control (e.g., Git) and issue tracking (e.g., Jira), participating in agile project planning, team code reviews, and proactive troubleshooting for optimal application performance and scalability.
This position will entail extensive in-person communication with other developers, consultants, and clients, so good soft-skills are a must-have. On the technical side, applicants for this position should have a good working knowledge of real-world Python programming, including experience with the following:
- Programming Languages and Frameworks: Proficiency in Apache Spark and Python 3, with experience in integrating machine learning models into production pipelines.
- Data Storage and Management: Expertise with Delta Lake and SQL, with practical experience in ETL processes and data warehousing for optimized storage and retrieval.
- Cloud Platforms: Familiarity with AWS and Azure, particularly for deploying scalable data architectures and managing cloud-based resources.
- Environment Management: Competency with package managers (PIP, Conda, etc.) for setting up and maintaining Python environments.
- Database Design and Data Structures: Knowledge of nested data structures, database schema design, and experience with JSON and XML.
- Version Control and Collaboration: Proficient with Git for version control and collaboration, following best practices for managing source code.
- Software Testing, Security, and Quality Assurance: Familiarity with testing, QA, and data-heavy application architecture to ensure reliability and performance.
- User Interface and Web Development: Experience in user interface design, along with HTML, JavaScript, and CSS for building front-end applications.
- Team Collaboration and Learning Orientation: Demonstrated ability to work effectively within cross-functional teams, actively seeking mentorship from experienced colleagues, and contributing to a collaborative environment by following project goals and coding standards.
- Professional Communication and Client Interaction: Experience in communicating technical concepts clearly and professionally, with a strong focus on understanding client needs and delivering solutions effectively through internship or academic project interactions.
While this job posting is seeking a developer with Python experience, MDMi has an extremely diverse portfolio of ongoing software projects. Thus, experience with other languages and programming paradigms beyond are a plus. Likewise, we are always interested in applicants with multidisciplinary expertise beyond programming (e.g. engineering, visualization, cloud technologies, data science, etc.) Strong candidates will have experience with many of the following:
- mIFlow
- Fivetran and other data ingestion and ETL tools
- PowerBi, Tableau
- Data security standards CMMC, GDPR, etc.
- Project management skills
Education minimum requirement: Computer science, computer engineering, information technology, or comparable degree from a 4-year school and 2+ years industry software development experience. We will also consider applicants with the equivalent combination of education, technical expertise, training, or work experience.
Other Requirements: In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and complete the required employment eligibility verification form (I-9) upon hire. Due to the nature of the work and in accordance with U.S. export control laws, applicants must be U.S. citizens or otherwise legally authorized to access export-controlled information.
Benefits:
- Competitive salary
- Health insurance
- Dental insurance
- Vision insurance
- Disability insurances
- Life insurance
- Paid time off
- 12 paid holidays
- 401(k) with company match
- Hybrid location (following onboarding)
- Business Appropriate/Casual Work Environment
- Diverse portfolio of industries and projects
- Collaborative and dynamic team environment
If you are passionate about technology and interested in becoming part of our team, please contact us using the online application. Only candidates who complete the online application will be considered. Thank you!
