AdvanSix Inc.

Big Data Engineer

AdvanSix Inc.$104K — $156K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in data engineering with a focus on production pipelines at scale.
  • Proficiency in Azure data stack, including Databricks or Fabric/Synapse, and Azure SQL.
  • Strong skills in SQL and Python/PySpark, with performance tuning experience.
  • Knowledge of SAP S/4HANA structures and SAP DataSphere semantic modeling.
  • Experience integrating OT data using OPC UA/MQTT protocols and event/batch frames.
  • Familiarity with Power BI semantic models and APIs for AI/ML applications.

Responsibilities

  • Build and operate the Unified Data Layer for enterprise-wide data products.
  • Engineer ingestion pipelines for various data sources into curated and semantic layers.
  • Implement data contracts and optimize performance through tuning and partitioning.
  • Integrate operational technology (OT) data safely and effectively with IT systems.
  • Embed data quality checks, testing, and observability practices in data processes.
  • Automate CI/CD processes for efficient deployment and testing of data solutions.
  • Collaborate with teams to produce comprehensive documentation and support knowledge transfer.

Benefits

  • Eligibility for paid holidays and vacation.
  • Tuition reimbursement program available.
  • 401K plan with competitive company match.
  • Medical, dental, and vision insurance provided.
  • Flexible spending and health savings accounts available.
  • Employer-provided short-term disability benefits offered.
Full Job Description
Job Responsibilities:

AdvanSix is seeking a Big Data Engineer to build and operate our enterprise Unified Data Layer (UDL) - spanning IT and OT - to deliver trustworthy, performant data products that power Finance, Operations, Supply Chain & Logistics, HSE, Commercial, and corporate analytics. You'll engineer batch/CDC/streaming pipelines, model curated/semantic layers, and harden run-state with testing, CI/CD, security, and observability. You'll partner closely with the data team and larger IT organization.

Mission

Design and deliver scalable, secure data pipelines and data models that safely connect operational systems to analytics, ensure trusted and well-governed data, and enable repeatable delivery of BI, ML, AI, and automation solutions.

Data Engineering & Modeling
• Build ingestion pipelines (batch, CDC, streaming) from S/4HANA/DataSphere, PHD/historian, LIMS, TMS, HSE, and other sources into landing  curated  semantic layers.
• Implement data contracts, schema/versioning, SCD handling, partitioning, and performance tuning (file formats, clustering, caching).
• Develop dimensional/semantic models that back certified Power BI datasets and APIs for apps/agents.

OT/IT Integration & Safety
• Integrate OT data via OPC UA/MQTT, broker/DMZ patterns, read-only historian feeds, and event/batch frames-no control-net reads.
• Collaborate with plant controls on change control, signal quality, and downtime windows.

Quality, Security & Observability
• Embed data quality rules, unit/integration tests, and validation checks (freshness, completeness, drift/PSI).
• Instrument lineage and end-to-end monitoring; build alerting and on-call runbooks to minimize MTTR.
• Enforce RBAC, secrets management, PII/HSE classifications, and retention aligned to Governance/MDM policies.

CI/CD, Cost & Reliability
• Automate build/test/deploy with Git-based CI/CD (environments, approvals, blue/green).
• Track and optimize cost/performance (cluster sizing, autoscaling, cache strategy); contribute to FinOps reviews.

Collaboration & Documentation
• Partner with Reporting & BI on semantic model contracts, RLS, and performance SLAs; avoid direct system scraping.
• Produce "readme" docs, data dictionaries, runbooks, and post-incident reviews; support knowledge transfer with vendors.

Basic Qualifications:
• Minimum 5 years' in data engineering building production pipelines at scale (batch/CDC/streaming).
• Hands-on with Azure data stack: Databricks or Fabric/Synapse, ADF/Pipelines, ADLS/OneLake, Azure SQL/SQL MI, Key Vault.
• Strong SQL and Python/PySpark; comfort with Spark Structured Streaming and performance tuning.
• Experience implementing tests/observability (freshness, schema, expectations), and Git-based CI/CD.
• Familiarity with SAP S/4HANA structures and SAP DataSphere semantic modeling.
• OT concepts: historians (PHD/PI), OPC UA/MQTT, event/batch frames, ISA-95/99 basics.
• Understanding of Power BI consumption (semantic models, RLS) and APIs for downstream AI/ML apps/agents.

Preferred Qualifications:
• Time-series/data-quality tooling (e.g., Great Expectations or equivalent patterns), feature/metric stores.
• MDM concepts (keys, survivorship), lineage/catalog tooling.
• TMS/WMS, LIMS, Historian, HSE domain exposure; Lean/Six Sigma mindset; FinOps awareness.

The base salary range for this position is $104,600 to $156,800 annually.

We offer a range of market-competitive total rewards that include periodic pay rate adjustments based on market competitiveness. Hired applicants will be eligible for paid holidays, paid time off including vacation, eligibility to purchase company stock, tuition reimbursement, and a 401K with a competitive company match. Certain roles may be eligible for discretionary financial benefits such as incentive pay, equity awards, and participation in a deferred compensation plan.

Hired applicants will be eligible for medical, dental and vision insurance, flexible spending and health savings account eligibility, employer-provided short term disability benefits, eligibility to purchase long term disability benefits, employer-provided basic life insurance and eligibility to purchase voluntary life coverages.

The pay range, incentives and benefits listed above are general guidelines only and not a guarantee of total compensation or benefits. The final offer will depend on multiple factors, including but not limited to, the responsibilities of the job, experience, education, knowledge, skills, and abilities, as well as the job location, applicability of a collective bargaining agreement, length of service, internal equity, and alignment with market data. The incentive pay is dependent on your role, business results and individual performance. All aspects of total rewards offered are subject to the terms and conditions of the specific plans.

At AdvanSix, we are dedicated to building a diverse, inclusive, and authentic workplace, so if you're excited about this role but your past work experience doesn't perfectly align with every qualification in the job posting, we encourage you to still apply. You may just be the right candidate for this or other roles.

About AdvanSix Inc.

AdvanSix Inc. is a chemical company that produces nylon resin and other chemical products. The company was spun off from Honeywell in 2016. AdvanSix's products are used in a variety of industries, including automotive, construction, and consumer goods. The company operates manufacturing facilities in the United States and China. AdvanSix is headquartered in Parsippany, New Jersey.
Learn more about AdvanSix Inc.
Size
1,375 employees
Market Cap
$1 billion
Industry
Net Income
$46 million
5 Year Trend
+7.2%
Revenue
$1.1 billion
NASDAQ

Similar Jobs

More Jobs at AdvanSix Inc.

More Information Technology Jobs

Find similar Big Data Engineer jobs: