Big Data Engineer

AdvanSix is seeking a Big Data Engineer to build and operate their enterprise Unified Data Layer, supporting various departments with trustworthy, performant data products. The role involves engineering data pipelines, modeling, and ensuring data security and quality.

Location: Remote (US)

Salary: $104,600–$156,800/yr

Responsibilities

• Build ingestion pipelines (batch, CDC, streaming) from various sources into landing → curated → semantic layers.
• Implement data contracts, schema/versioning, SCD handling, partitioning, and performance tuning.
• Develop dimensional/semantic models for Power BI datasets and APIs.
• Integrate OT data via OPC UA/MQTT, broker/DMZ patterns, historian feeds, and event/batch frames.
• Collaborate with plant controls on change control, signal quality, and downtime windows.
• Embed data quality rules, unit/integration tests, validation checks, lineage, and monitoring.
• Build alerting and on-call runbooks to minimize MTTR.
• Enforce RBAC, secrets management, PII/HSE classifications, and retention policies.
• Automate build/test/deploy with Git-based CI/CD, optimize cost/performance, and contribute to FinOps.
• Partner with Reporting & BI on semantic model contracts, RLS, and performance SLAs.
• Produce documentation, data dictionaries, runbooks, and support knowledge transfer.

Requirements

• Minimum 5 years' experience in data engineering building production pipelines at scale (batch/CDC/streaming).
• Hands-on with Azure data stack: Databricks or Fabric/Synapse, ADF/Pipelines, ADLS/OneLake, Azure SQL/SQL MI, Key Vault.
• Strong SQL and Python/PySpark; comfort with Spark Structured Streaming and performance tuning.
• Experience implementing tests/observability (freshness, schema, expectations), and Git-based CI/CD.
• Familiarity with SAP S/4HANA structures and SAP DataSphere semantic modeling.
• OT concepts: historians (PHD/PI), OPC UA/MQTT, event/batch frames, ISA-95/99 basics.
• Understanding of Power BI consumption (semantic models, RLS) and APIs for downstream AI/ML apps/agents.

Benefits

• Market-competitive total rewards including paid holidays, vacation, stock purchase, tuition reimbursement, 401K with match.
• Medical, dental, vision insurance, flexible spending, HSA, short-term disability, life insurance, voluntary life coverages.
• Discretionary benefits such as incentive pay, equity awards, deferred compensation.

Additional Information

• The final compensation depends on experience, education, skills, location, and other factors.
• AdvanSix promotes diversity and inclusion, encouraging applicants even if their experience doesn't match all qualifications.
• Equal opportunity employer.