OverviewThe Data Engineer (RDE) plays a central role in supporting social science research at DDSS. The RDE advises researchers on strategies for computationally intensive data processing and analysis, ETL pipelines, data access, and restricted data infrastructure, both cloud-based and on-premises. The RDE also builds project-specific and general-purpose tools as opportunities arise, and teaches relevant skills to the social science community through workshops and bootcamps. The RDE role pairs data engineering and advanced programming skills with substantive knowledge of social science methods, data, and research questions.
The RDE's experience with social science research pipelines, advanced knowledge of R, and expertise in big data structures will complement the existing skills and knowledge of DDSS's technical team of Research Software Engineers (RSEs) and Postdoctoral Research Associates. The DE is expected to perform responsibilities both independently and in collaboration with the team when necessary. The RDE will report directly to the DaIS Director of Research and Strategy.
The term of this appointment is for two years, with the possibility of renewal based upon satisfactory performance and funding.
This position is an onsite role.
ResponsibilitiesData Management [30%]
- Create and maintain data ingestion pipelines (AWS Databricks, on-premises) for DDSS-hosted social science datasets
- Create and maintain scripts and packages for common researcher tasks (e.g., geocoding, information parsing)
- Generate data extracts (e.g., survey samples, anonymized aggregations)
- Manage and document user access and privileges in Databricks
- Other general cloud administration (billing, usage tracking, compliance auditing, etc.)
Platform Support [20%]
- Guide Databricks onboarding sessions for research teams
- Troubleshoot user issues on Databricks, incl. writing processing scripts as needed
- Advise researchers on strategies for efficient work with the University's compute resources (HPC, secure environments, and cloud)
- Advise and assist projects with technical setup or migration between compute resources
Research Support [40%]
- Lead consultations for data-intensive research projects across social science units
- Provide advanced support to specific research projects (e.g., building custom modules for ML tasks, AI tool integration for the latest methods, etc.)
Other [10%]
- Lead technical workshops on relevant topics (e.g., SQL, R, record linkage/entity resolution)
QualificationsEssential:
- A minimum of 3 years related experience
- Advanced degree in social science (or relevant experience in quantitative social science)
- Knowledge of R (expert), Python (basic/intermediate), SQL (intermediate)
- Expertise with the entire social science research life-cycle
- Experience working efficiently with databases/large datasets
- Content expert in at least one dataset containing personally-identifiable information (PII) - e.g., voter registration files, consumer data, restricted Census or other administrative data
- Experience deploying open-source language models for data processing tasks
- Literacy in advanced statistical methods
Preferred:
- Ph.D. strongly preferred
- Experience creating or developing R packages or complex data pipelines in R
- Experience with Apache Spark
- Experience with OLAP database systems (e.g., DuckDB) and related storage formats (e.g., parquet)
- Knowledge of record linkage/entity resolution strategies
- Knowledge of survey research and data sampling from voter files and consumer data
- Knowledge of geospatial data analysis techniques
- Interest in privacy techniques, such as synthetic data or anonymization
Standard Weekly Hours36.25
Eligible for OvertimeNo
Benefits EligibleYes
Probationary Period180 days
Essential Services Personnel (see policy for detail)No
Physical Capacity Exam RequiredNo
Valid Driver's License RequiredNo
Experience LevelMid-Senior Level
#LI-JJ1
Salary Range$120,000 to $135,000