Job Summary:The Data Integration Engineer responsible for procuring, integrating, and maintaining external data sources that enhance our platform capabilities. This role focuses on researching and evaluating new data acquisition opportunities, building sustainable data pipelines, and ensuring data quality and accessibility. The Data Integration Engineer will work independently to identify data gaps, research potential solutions including third-party datasets and AI-powered tools, and present recommendations to leadership for strategic decision-making.
Primary Duties and Responsibilities:- Research and identify external data sources that align with business needs and platform enhancement goals.
- Evaluate third-party data providers, subscription services, and alternative data procurement methods including AI tools and web scraping technologies.
- Conduct comprehensive cost-benefit analyses of data acquisition options, documenting benefits, limitations, and integration requirements.
- Design and implement automated processes to maintain data currency and quality for newly acquired datasets.
- Build and maintain data pipelines to integrate data from multiple external sources into company databases.
- Develop and document data procurement workflows, integration processes, and maintenance schedules.
- Present findings and recommendations to leadership with clear analysis of costs, benefits, and implementation timelines.
- Collaborate with product and engineering teams to ensure seamless integration of new data sources into existing systems.
- Monitor data quality, identify anomalies, and implement validation checks to ensure accuracy and reliability.
Additional Responsibilities:- Additional Responsibilities as assigned
Critical Competencies:- Ownership & Execution - Demonstrates a sense of ownership to drive issues to closure, maximizes the use of existing processes while continuously pursuing ways to improve efficiencies, sets aggressive goals, monitors progress, and delivers results, seizes more opportunities than others
- Customer-Centric - Works to understand customer pain points to effectively align technical solutions with customer's business, anticipate customer needs, and sets high standards for customer service
- Manages Ambiguity & Change - Makes decisions with available information that align with strategy, embraces and manages change, challenges the status quo and champions new initiatives, comfortably handles risk and uncertainty
The Individual:- Demonstrated expertise in data procurement, acquisition, and integration methodologies.
- Strong research skills with ability to independently evaluate and compare data providers and technologies.
- Proven ability to work independently and drive multiple data initiatives simultaneously.
- Excellent analytical and problem-solving skills with keen attention to detail.
- Strong communication skills to effectively present technical findings and recommendations to both technical and non-technical stakeholders.
- Ability to translate business requirements into data acquisition strategies.
- Self-motivated with strong organizational skills and ability to manage competing priorities.
- Experience documenting technical processes and creating clear, maintainable data workflows.
- Comfortable evaluating emerging technologies including AI-powered data tools.
- Experience with data procurement or vendor evaluation processes
- Knowledge of data center industry and related data sources
- Agile/Scrum methodology experience
- Understanding of data privacy regulations (GDPR, CCPA)
Qualifications:- Ability to work in our Dallas, TX office full-time
- Bachelor's degree in Computer Science, Data Science, Information Systems, or related quantitative field
- 3-5 years of experience in a data analyst, data management or business intelligence role
- 3-5 years of hands-on experience with a combination of the following technologies:
- Programming Languages: SQL, Python (required)
- Data Technologies: ETL processes, data pipeline development, REST APIs, web scraping, MySQL/PostgreSQL
- Data Tools: Excel, data visualization tools (Tableau, Power BI - preferred), data integration platforms (Talend, Apache Airflow - preferred)
- Additional Skills: Data quality and governance principles, AI-powered data tools, cloud platforms (AWS, Azure, Google Cloud - preferred)
