University of Arkansas System

COSMOS - Data Engineer III

Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Master's degree in Computer Science, Information Science, or related discipline required.
  • 2+ years of experience as a data engineer, software developer, or similar role needed.
  • 1+ year of experience leading a team of data engineers essential.

Responsibilities

  • Lead a team of data engineers.
  • Collect and analyze raw data from social media platforms.
  • Organize and maintain datasets for effective use.
  • Design and manage data ETL pipelines for efficient data flow.
  • Create scalable microservices using Python and Golang for high performance.
  • Conduct complex data analysis to extract insights and trends.
  • Collaborate with COSMOS teams on various research projects.

Benefits

  • Opportunity to work at a well-respected research university.
  • Access to a collaborative and innovative research environment.
  • Participation in significant data-driven research initiatives.
Full Job Description
Closing Date:

Type of Position:
Professional Staff - Project/Program Administration

Workstudy Position:

No
Job Type:
Regular

Work Shift:

Sponsorship Available:

No
Institution Name:
University of Arkansas at Little Rock
The University of Arkansas at Little Rock is a metropolitan research university that provides an accessible, quality education through flexible learning and unparalleled internship opportunities. At UA Little Rock, we prepare our more than 8,900 students to be innovators and responsible leaders in their fields. Committed to its metropolitan research university mission, UA Little Rock is a driving force in Little Rock's thriving cultural community and a major component of the city and state's growing profile as a regional leader in research, technology transfer, economic development, and job creation.

Below you will find the details for the position including any supplementary documentation and questions you should review before applying for the opening. To apply for the position, please click the Apply link/button.

Department:
COSMOS

Department's Website:

https://cosmos.ualr.edu/
Summary of Job Duties:
The Project/Program Specialist (Data Engineer III) position is a full-time provisional with the COSMOS Research Center (cosmos.ualr.edu) at the University of Arkansas and is funded through a grant or contract. The position renewal is contingent upon continued grant funding and satisfactory job performance. The Project/Program Specialist (Data Engineer III) will collect, manage, and convert raw data into usable information for analytics and decision-making. This role requires comprehensive data analysis skills, developing and maintaining datasets, improving data quality and efficiency through leveraging data systems and pipelines, interpreting trends and patterns of data, creating complex data reports, and building algorithms and prototypes. In addition, the other responsibilities include leading the development of social media data collection pipelines, inference methods and infrastructure, classification methods and infrastructure, and visualization dashboards. The Project/Program Specialist (Data Engineer III) will collaborate with researchers, participate in research projects, and interact with other developers at the COSMOS research center and partner organizations to achieve the best possible performance metrics across various projects. Excellent communication and problem-solving skills are essential for this on-campus position, as the data engineer's role is to find opportunities to contribute to cutting-edge research in the exciting field of social computing. This position is governed by state and federal laws and agency/institution policy.

The position reports to Dr. Nitin Agarwal ([redacted]), Maulden-Entergy Endowed Chair, Distinguished Professor, and Director, COSMOS Research Center at UA-Little Rock.
Qualifications:

Required Education and/or Experience:
  • The candidate must have a master's degree in Computer Science, Information Science, or a related discipline;
  • The candidate must have 2+ years of experience as a data engineer, software developer, software engineer, database administrator, or other similar roles;
  • The candidate must have 1+ years of experience leading a team of data engineers.


Job Duties and Responsibilities:
  • Lead a team of data engineers;
  • Collecting and analyzing raw data from various sources, including social media platforms;
  • Organize and maintain datasets;
  • Improving data quality and process efficiency;
  • Design and manage data ETL pipelines that encompass the journey of data from source to destination systems, processing 10 million+ data points daily, utilizing Kafka for real-time data streaming and MongoDB for NoSQL storage across Kubernetes clusters;
  • Design and deploy scalable microservices in Python and Golang, leveraging FlaskAPI, GraphQL, and Docker, ensuring sub-second response times and efficient concurrency with goroutines.
  • Migrated large amounts of data from legacy databases to MongoDB to achieve sub-second access latencies and optimize storage for unstructured data through Elasticsearch integration;
  • Set up and manage the infrastructure required for ingestion, processing, and storage of data;
  • Evaluate the model needs and objectives, interpret trends and patterns of data;
  • Conduct complex data analysis and report on results;
  • Prepare data for analysis and reporting by transforming and cleansing it;
  • Combining raw information from different sources;
  • Explore ways to enhance data quality and reliability;
  • Identify opportunities for data acquisition;
  • Develop analytical tools and programs;
  • Collaborate with teams at COSMOS on several projects;
  • Managing services and operational infrastructure for system reliability and resiliency;
  • Creating continuous integration and continuous deployment (CI/CD) pipelines with Jenkins and GitLab CI for automating service/system deployment;
  • Integrate Prometheus for monitoring, Grafana for real-time dashboarding/visualization, and log analysis with Kibana sourced from Elasticsearch;
  • Front-end development (HTML/CSS, JavaScript, Node.js, etc.);
  • Training machine learning (ML) models on datasets;
  • Deploying machine learning (ML) models;
  • Enhance the system's fault tolerance by incorporating alert mechanisms;
  • Work on other tasks as asked.


Knowledge, Skills, and Abilities:
  • Advanced proficiency level in working with data models, data pipelines, ETL processes, data stores, data mining, and segmentation techniques;
  • Advanced proficiency level in working with programming/scripting languages (e.g., Java and Python);
  • Advanced proficiency level in working with data integration platforms and SQL database design;
  • Advanced proficiency level in working with numerical, analytical, and data security skills;
  • Advanced proficiency level in collecting raw data from various social media platforms;
  • Advanced proficiency level in creating CI/CD pipelines;
  • Advanced proficiency level with front-end development (HTML/CSS, JavaScript, Node.js, etc.);
  • Advanced proficiency level with training and deploying machine learning (ML) models on datasets;
  • Ability to lead a team of data engineers;
  • Advanced proficiency level with Kafka and MongoDB for NoSQL storage across Kubernetes clusters;
  • Advanced proficiency level with microservices, Python, Golang, FlaskAPI, GraphQL, and Docker;
  • Advanced proficiency level with Elasticsearch, Grafana, Prometheus, and Kibana.


Additional Information:

Salary Information:

$85,000 annually

Required Documents to Apply:

Resume

Optional Documents:

Special Instructions to Applicants:

Recruitment Contact Information:


Maulden-Energy Chair and Donaghey Distinguished Professor
Director, COSMOS Research Center

All application materials must be uploaded to the University of Arkansas System Career Site https://uasys.wd5.myworkdayjobs.com/UASYS

Please do not send to listed recruitment contact.

About University of Arkansas System

The University of Arkansas System is a state university system in the U.S. state of Arkansas. It comprises six campuses; a medical school; two law schools; a graduate school focused on public service; a historically black college, statewide research, service, and educational units for agriculture, criminal justice, and archeology; and several community colleges. Over 50,000 students are enrolled in over 188 undergraduate, graduate, and professional programs. Legally, the entire system carries the name University of Arkansas. Nonetheless, to avoid confusion with its flagship campus in Fayetteville, the system usually refers to itself as the University of Arkansas System and the Fayetteville campus usually refers to itself as the University of Arkansas.
Learn more about University of Arkansas System

Similar Jobs

More Jobs at University of Arkansas System

More Information Technology Jobs

Find similar COSMOS - Data Engineer III jobs: