Job Requisition ID: 59962
Opening Date: 11/13/2026
Closing Date: 12/01/2026
Agency: Department of Innovation and Technology
Class Title: INFORMATION SYSTEMS ANALYST III - 21167
Skill Option: System Services - Information Technology
Bilingual Option: None
Salary: Anticipated starting salary: $9,130 monthly; Full range: $ $9,130-$13,573
Job Type: Salaried
Category: Full Time
Number of Vacancies: 1
Bargaining Unit Code: RC063 Professional Employees, Educators,Juvenile Justice School Counselors and Special Education Resources Coordinators,and Physicians AFSCME
Merit Comp Code: N/A
Work Hours: 8:30 AM-5:00 PM Monday - Friday (hours may vary)
Anticipated Hybrid Work Schedule Availability: 1 to 5 Days per week in office, depending on operational needs
Headquarter Location: 555 W Monroe St, Chicago, Illinois, 60661
Work County: Cook
Agency Contact: This position is a union position; therefore, provisions of the relevant collective bargaining agreement/labor contract apply to the filling of this position. All applicants who want to be considered for this position MUST apply electronically through the illinois.jobs2web.com website. State of Illinois employees should click the link near the top left to apply through the SuccessFactors employee career portal. Applications submitted via email or any paper manner (mail, fax, hand delivery) will not be considered. Proof of educational coursework is required. Acceptable proof of coursework includes unofficial transcripts, copies of official transcripts, account records (including screenshots) of academic coursework, and any similar documents created by an academic institution. Position OverviewAre you looking for a rewarding career with an organization that values their staff? The Department of Innovation & Technology (DoIT) is seeking to hire qualified candidates with the opportunity to work in a dynamic, creative thinking, problem solving environment. This position serves as the Senior Data Engineer. The Senior Data Engineer leads the design, development, and optimization of complex, large-scale data pipelines and distributed processing systems that power enterprise analytics, operations, and regulatory reporting. The role architects and governs modern lakehouse and warehouse environments, ensuring high-performance data models, reliable ingestion frameworks, and scalable transformation workflows. This position drives DataOps and continuous integration and continuous deployment (CI/CD) automation, enforces data-quality and observability standards, and maintains secure, compliant data access across platforms. The Senior Data Engineer also serves as the technical leader for cross-functional teams, providing architectural guidance, code review, and mentorship to elevate engineering practices across the organization. If you possess these knowledges, skills, abilities and experience, we invite you to apply for this position to join the DoIT Team!
As a State of Illinois employee, you receive a comprehensive benefits package including:
• Competitive Group Insurance benefits including health, life, dental and vision plans.
• Flexible work schedules (when available and dependent upon position).
• 10-25 days of paid vacation time annually (10 days for first year of state employment).
• 12 days of paid sick time annually which carry over year to year.
• 3 paid personal business days per year.
• 13-14 paid holidays per year dependent on election years.
• 12 weeks of paid parental leave.
• Pension plan through the State Employees Retirement System.
• Deferred Compensation Program - voluntary supplemental retirement plan.
• Optional pre-tax programs -Medical Care Assistance Plan (MCAP) & Dependent Care Assistant Plan (DCAP).
• Tuition Reimbursement Program and Federal Public Service Loan Forgiveness Program eligibility.
For more information regarding State of Illinois Benefits follow this link: https://www2.illinois.gov/cms/benefits/Pages/default.aspx
Essential Functions- Under administrative direction, serves as the Senior Data Engineer for the Department of Innovation & Technology (DoIT), performing highly complex professional and advisory functions that include leading the design, development, and optimization of enterprise data pipelines, architecting scalable data platforms, maintaining data quality and governance, and providing expert guidance on data engineering best practices across the enterprise.
- Designs, builds, and optimizes enterprise ETL (Extract-Transform-Load) and ELT (Extract-Load-Transform) pipelines, distributed processing workloads, and semantic data models that support analytics, business intelligence, and operational reporting across agency data platforms.
- Leads the technical governance of enterprise data lake architecture, ensuring high availability, data quality, cost-efficient storage tiering, and end-to-end observability across the full enterprise data asset inventory.
- Designs, implements, and governs continuous integration and continuous deployment (CI/CD) automation frameworks for data engineering workloads, ensuring that code promotion, environment parity, and production deployment processes meet enterprise reliability and security standards.
- Implements, governs, and continuously improves the enterprise role-based access control framework for data platforms, verifying that data access policy is technically enforced, auditable, and aligned with DoIT security standards and applicable state and federal data governance regulations.
- Engineers and optimizes data workloads across relational, non relational, and emerging data platforms, including large scale RDBMS (such as Microsoft SQL Server, Azure SQL Database, or equivalent), document databases (e.g., MongoDB, Couchbase), key value stores (e.g., Redis, DynamoDB), and graph databases (e.g., Neo4j, Cosmos DB Gremlin API).
- Participates as a senior technical contributor and player/coach resource within cross-functional data delivery squads, representing enterprise data engineering standards in agency-aligned feature development and providing technical advisory to vendor partners and executive stakeholders.
- Keeps abreast of new developments in the information technology field by continuing education through online training platforms, meetings, training sessions, seminars, and conferences to increase familiarity with and remain current on products, vendors, techniques, and procedures.
- Performs other duties as required or assigned which are reasonably within the scope of the duties enumerated above.
Minimum Qualifications- Requires knowledge, skill and mental development equivalent to four (4) years of college with coursework in Computer Science, Computer Engineering, Information Systems, Data Engineering, Software Engineering, Management Information Science, or a closely related field.
- Requires five (5) years of professional experience in a related Information Technology field, including experience in data engineering, software engineering, database administration, business intelligence development, data architecture, systems integration, or a closely related technical discipline.
Specialized Skills- Requires five (5) years of professional experience designing, building, and optimizing enterprise-scale data pipelines, fault-tolerant ETL/ELT patterns, and distributed data processing systems in a high-volume near-time production environment, including hands-on SQL performance tuning, execution plan analysis, index strategy, and workload optimization across platforms such as Microsoft SQL Server, Azure SQL Database, DB2, or equivalent relational and cloud data systems.
- Requires five (5) years of professional experience with distributed data processing and Spark execution engine optimization, including advanced hands-on design and tuning of large-scale batch, micro-batch, and streaming workloads with demonstrated proficiency in execution plans, shuffle and partition strategy, memory management, and cluster autoscaling across platforms such as Databricks, Apache Spark, Azure Synapse, Teradata Vantage, Snowflake, Amazon EMR, Starburst, Cloudera, or equivalent.
- Requires five (5) years of professional experience with enterprise data platform and lakehouse architecture design, including implementation of high-performance multi-zone lake and lakehouse patterns, open table format optimization, schema evolution, and integration of storage, compute, and catalog layers across platforms such as Microsoft Fabric, Databricks Unity Catalog, Snowflake, or equivalent enterprise cloud data platforms.
- Requires four (4) years of professional experience engineering reusable data access layers and gateway patterns that abstract source system complexity, eliminate redundant data movement, and deliver consistent, governed interfaces for downstream consumers and applications, in support of enterprise interoperability and data-driven design standards leveraging expert logical data analysis, root causes of operational or procedural problems.
Preferred Qualifications- Five (5) years of professional experience designing, building, and optimizing enterprise-scale data pipelines, fault-tolerant ETL/ELT patterns, and distributed data processing systems in a high-volume near-time production environment, including hands-on SQL performance tuning, execution plan analysis, index strategy, and workload optimization across platforms such as Microsoft SQL Server, Azure SQL Database, DB2, or equivalent relational and cloud data systems.
- Five (5) years of professional experience with distributed data processing and Spark execution engine optimization, including advanced hands-on design and tuning of large-scale batch, micro-batch, and streaming workloads with demonstrated proficiency in execution plans, shuffle and partition strategy, memory management, and cluster autoscaling across platforms such as Databricks, Apache Spark, Azure Synapse, Teradata Vantage, Snowflake, Amazon EMR, Starburst, Cloudera, or equivalent.
- Five (5) years of professional experience with enterprise data platform and lakehouse architecture design, including implementation of high-performance multi-zone lake and lakehouse patterns, open table format optimization, schema evolution, and integration of storage, compute, and catalog layers across platforms such as Microsoft Fabric, Databricks Unity Catalog, Snowflake, or equivalent enterprise cloud data platforms.
- Four (4) years of professional experience engineering reusable data access layers and gateway patterns that abstract source system complexity, eliminate redundant data movement, and deliver consistent, governed interfaces for downstream consumers and applications, in support of enterprise interoperability and data-driven design standards leveraging expert logical data analysis, root causes of operational or procedural problems.
- Four (4) or more years of professional experience implementing role-based access control frameworks across enterprise data platforms, including Databricks Unity Catalog, Microsoft Purview, Snowflake, or equivalent, in alignment with formal enterprise data governance or security classification policy.
- Four (4) or more years of professional experience implementing enterprise data observability and data quality monitoring frameworks, including configuration of automated quality checks, schema drift detection, privacy monitoring incident leadership, data lineage tracking, anomaly detection, and pipeline alerting to maintain production data reliability and operational integrity at enterprise scale.
- Four (4) or more years of professional experience with DataOps, CI/CD pipeline engineering, and infrastructure-as-code for data workloads, including automated deployment of notebooks, Spark jobs, SQL deployments, and dbt models, and provisioning of cloud data infrastructure using tools such as Terraform, Azure Bicep, Databricks Asset Bundles, or GitHub Actions.
- Ability to provide expert peer code review and mentor junior and mid-level engineers to strengthen engineering practices and technical proficiency.
- Ability to analyze data to recommend and implement technical solutions that enhance enterprise data standards, support platform reusability, and improve data interoperability.
- Developed verbal and written communication skills with a proven ability to clearly articulate technical concepts to both technical and non-technical audiences through documentation, presentations, and cross-functional collaboration.
Conditions of EmploymentAll applicants must be able to meet the following Conditions of Employment with or without reasonable accommodation, to be considered for this position. The State of Illinois complies with federal and state disability laws and will make reasonable accommodations for applicants and employees with disabilities.
- Requires the ability to verify identity.
- Requires employment authorization to accept permanent full-time position with the State of Illinois.
- Requires the ability to pass a position specific, agency required background check and requires self-disclosure of criminal history.
- Requires the ability to travel in performance of duties, with occasional overnight stays.
- R