PID: 26-15-09J-004
E-INFOSOL LLC is seeking a highly motivated
Data Engineer to join our innovative, customer-focused team in
Washington, DC.Job TypeSummaryWe are looking for a
Data Engineer to:
- Update and maintain the information residing on the Private Sector Portal (PSP) tool, using automation when appropriate.
- Assist in the relationship management team in identifying and documenting technical requirements around the PSP system
- Develop guidance around appropriate use of the PSP system and ensure consistent data standards across the enterprise.
- Provide expertise and customer service to HQ/field users
- Maintain the PSP system, to include auditing content for missing or inappropriate metadata, reporting technical user problems to the contractor.
- Ensure the scheduling, processing, and documentation of data delivery and implementation, using automation when appropriate.
- Design, implement, automate, and maintain Enterprise level of scalable Extract, Transform and Load (ETL) data pipelines and data analysis pipelines.
- Build and maintain robust data processing, enriching, and analysis pipelines that aggregate and normalize large datasets across diverse sources, including sources from web services. data from disparate sources.
- Automate and optimize database and data workflows for best performance and efficiency.
- Identify and propose emerging technologies, automation or alternative solutions to efficiently improve support for developers and application stakeholders.
- Develop and maintain documentation, inline comments, confluence and stand-alone documents, wherever necessary for the readability of the software design and code.
- Ability to focus on producing results efficiently.
- Ability to work independently and coordinate with team members.
Qualifications- Active Top Secret clearance
- Bachelor's degree in a quantitative field (i.e. Statistics or Operations Research) or technical field (i.e. Computer Science or Engineering).
- Four (4) years of Exceptional proficiency in writing and editing skills using MS Office.
- Minimum of 2-4 years of work experience in data analytics or data engineering role.
- Minimum 10 years of relevant experience.
Required Skills/Technologies- Experience with designing, implementing and maintaining big data processing, normalizing, and enriching pipelines in languages such as Python, PySpark, or Spark.
- Experience with architecting, designing and building modern medallion ETL processes for data lake, data warehouse or lakehouse.
- Experience with building and Knowledge of automating data pipeline and workflow on Apache Niagra Files (NiFi) or Databricks for ease of maintenance.
- Experience with implementing automated data Cl/CD pipelines with Continuous Integration/Continuous Delivery (CI/CD).
- Experience with data frame processing with filtering conditions.
- Experience with organizing data version history to optimize processing and retrieval performance.
- Experience with data indexing for robust searching and querying.
- Strong verbal and written communication skills to effectively collaborate and integrate with enterprise partners and customers.
- Excellent at troubleshooting, debugging and researching.
- Ability to focus and a desire to learn.
- Knowledge of PostgreSQL is preferred.
Full Time Benefits- Medical - 100% company paid for employees with dependent options
- Dental and Vision
- Retirement Savings (401k) up to 4% match
- Health Savings Account (HSA), FSA and DCFSA
- Company-paid Short/Long-term disability (w/ additional supplemental options)
- Company-paid Life and AD&D (w/ additional supplemental options)
- Generous Paid Time Off and ALL 11 Federal Holidays
- Legal and Identity Protection Services
- Bonuses for certifications and reimbursement
Employee Perks:- UberOne, Company Outings (Sporting events, Happy Hours, etc.), Discounts on services including Pet Insurance
Website: E-INFOSOL.com
