Minimum of 3 years related experience in data engineering or social science research
Advanced degree in social science or relevant quantitative experience
Expert knowledge of R, basic/intermediate Python, and intermediate SQL
Proficient in managing large datasets and databases
Content expert in datasets with personally identifiable information (PII)
Experience deploying open-source language models for data processing
Familiarity with advanced statistical methods
Responsibilities
Create and maintain data ingestion pipelines for social science datasets
Develop scripts and packages for common researcher tasks
Generate data extracts for research purposes
Manage user access and privileges in Databricks
Guide onboarding sessions for research teams on Databricks
Troubleshoot user issues and write processing scripts as needed
Lead consultations for data-intensive research projects
Benefits
Eligible for benefits
Standard weekly hours of 36.25
Probationary period of 180 days
No physical capacity exam required
No valid driver's license required
Full Job Description
Overview
The Data Engineer (RDE) plays a central role in supporting social science research at DDSS. The RDE advises researchers on strategies for computationally intensive data processing and analysis, ETL pipelines, data access, and restricted data infrastructure, both cloud-based and on-premises. The RDE also builds project-specific and general-purpose tools as opportunities arise, and teaches relevant skills to the social science community through workshops and bootcamps. The RDE role pairs data engineering and advanced programming skills with substantive knowledge of social science methods, data, and research questions.
The RDE's experience with social science research pipelines, advanced knowledge of R, and expertise in big data structures will complement the existing skills and knowledge of DDSS's technical team of Research Software Engineers (RSEs) and Postdoctoral Research Associates. The DE is expected to perform responsibilities both independently and in collaboration with the team when necessary. The RDE will report directly to the DaIS Director of Research and Strategy.
The term of this appointment is for two years, with the possibility of renewal based upon satisfactory performance and funding.
This position is an onsite role.
Responsibilities
Data Management [30%]
Create and maintain data ingestion pipelines (AWS Databricks, on-premises) for DDSS-hosted social science datasets
Create and maintain scripts and packages for common researcher tasks (e.g., geocoding, information parsing)
Generate data extracts (e.g., survey samples, anonymized aggregations)
Manage and document user access and privileges in Databricks
Other general cloud administration (billing, usage tracking, compliance auditing, etc.)
Platform Support [20%]
Guide Databricks onboarding sessions for research teams
Troubleshoot user issues on Databricks, incl. writing processing scripts as needed
Advise researchers on strategies for efficient work with the University's compute resources (HPC, secure environments, and cloud)
Advise and assist projects with technical setup or migration between compute resources
Research Support [40%]
Lead consultations for data-intensive research projects across social science units
Provide advanced support to specific research projects (e.g., building custom modules for ML tasks, AI tool integration for the latest methods, etc.)
Other [10%]
Lead technical workshops on relevant topics (e.g., SQL, R, record linkage/entity resolution)
Qualifications
Essential:
A minimum of 3 years related experience
Advanced degree in social science (or relevant experience in quantitative social science)
Knowledge of R (expert), Python (basic/intermediate), SQL (intermediate)
Expertise with the entire social science research life-cycle
Experience working efficiently with databases/large datasets
Content expert in at least one dataset containing personally-identifiable information (PII) - e.g., voter registration files, consumer data, restricted Census or other administrative data
Experience deploying open-source language models for data processing tasks
Literacy in advanced statistical methods
Preferred:
Ph.D. strongly preferred
Experience creating or developing R packages or complex data pipelines in R
Experience with Apache Spark
Experience with OLAP database systems (e.g., DuckDB) and related storage formats (e.g., parquet)
Knowledge of record linkage/entity resolution strategies
Knowledge of survey research and data sampling from voter files and consumer data
Knowledge of geospatial data analysis techniques
Interest in privacy techniques, such as synthetic data or anonymization
Standard Weekly Hours
36.25
Eligible for Overtime
No
Benefits Eligible
Yes
Probationary Period
180 days
Essential Services Personnel (see policy for detail)