JOB PURPOSE:
The Data Engineer will play a pivotal role in designing, developing, and maintaining the data architecture for our organization. This individual will be responsible for T-SQL development, ETL processes, and Python scripting to ensure efficient data transfer, transformation, and integration. The primary focus will be on automating data workflows, supporting diverse file formats, and utilizing APIs for seamless data import and export. The Data Engineer will collaborate closely with cross-functional teams to enhance data-driven decision-making and contribute to the overall success of our data infrastructure.
JOB RESPONSIBILITIES:
- Utilize advanced T-SQL skills to design, optimize, and maintain database structures.
- Develop complex SQL queries for reporting and data transformation.
- Design, implement, and optimize ETL processes for efficient data extraction, transformation, and loading.
- Develop and maintain ETL scripts using Python for seamless integration with existing data workflows.
- Automate SFTP file transfer processes, ensuring secure and reliable data exchange.
- Import and export data and files in various formats, including flat file, XML, JSON, X12, Excel, and Parquet using Python.
- Utilize Python to integrate with APIs for importing and exporting data.
- Collaborate with team members and stakeholders to review and optimize code for efficiency and maintainability.
- Collaborate with analysts and business stakeholders to understand data visualization requirements.
- Work closely with cross-functional teams to understand data requirements and ensure data integrity.
- Document data engineering processes, standards, and best practices.
- Use Git and Github for version control of scripts and queries, ensuring a collaborative and organized development environment.
- Integrate Tableau for effective data representation and reporting.
Schedule: Monday - Friday |8:30AM 6:30PM
Weekly Hours: 40
Location: Flushing, Queens - Hybrid
QUALIFICATIONS:
Education: Bachelor's Degree in Computer Science, Information Technology, or a related field.
Experience:
- One to four (1-4) years of hands-on experience in T-SQL development and ETL processes.
- Proven experience in Python scripting for data manipulation and automation.
- Experience in data visualization using Tableau.
- Strong problem-solving skills and ability to troubleshoot data-related issues effectively.
- Identify and implement solutions to complex technical projects.
- Ability to work independently and in a team environment.
- Excellent communication and collaboration skills.
- Knowledge of health care delivery and operations a plus.
Additional Requirements:
Technical Skills:
- Strong expertise in database design, optimization, and maintenance using T-SQL.
- Proficient in developing and optimizing ETL processes.
- Experience with automating SFTP file transfers and handling diverse file formats.
- Knowledge of data formats such as XML, JSON, Excel.
- Proficient in version controlling scripts and queries using Git and Github.
Physical Requirements
Individuals must be able to sustain certain physical requirements essential to the job. This includes, but is not limited to:
- Standing 6uration of up to 6 hours a day.
- Sitting/Stationary positions 6edentary position in duration of up to 6-8 hours a day for consecutive hours/periods.
- Lifting/Push/Pull p to 50 pounds of equipment, baggage, supplies, and other items used in the scope of the job using OSHA guidelines, etc.
- Bending/Squatting ave to be able to safely bend or squat to perform the essential functions under the scope of the job.
- Stairs/Steps/Walking/Climbing ust be able to safely maneuver stairs, climb up/down, and walk to access work areas.
- Agility/Fine Motor Skills - Must demonstrate agility and fine motor skills to operate and activate equipment, devices, instruments, and tools to complete essential job functions (ie. typing, use of supplies, equipment, etc.)
- Sight/Visual Requirements ust be able to visually read documentation, papers, orders, signs, etc., and type/write documentation, etc. with accuracy.
- Audio Hearing and Motor Skills (language) Requirements ust be able to listen attentively and document information from patients, community members, co-workers, clients, providers, etc., and intake information through audio processing with accuracy. In addition, they must be able to speak comfortably and clearly with language motor skills for customers to understand the individual.
- Cognitive Ability ust be able to demonstrate good decision-making, reasonableness, cognitive ability, rational processing, and analysis to satisfy essential functions of the job.
Disclaimer:Responsibilities and tasks outlined in this job description are not exhaustive and may change as determined by the needs of the company.
Salary Range (Min-Max):$80,000.00 - $90,000.00
Every application is reviewed by our recruitment team. We do not use AI to make hiring decisions or automatically reject applicants. All employment decisions are based on job-related qualifications and applicable employment laws.