Senior Data Engineer

Dotdigital is a global community of professionals focused on innovation, teamwork, and client solutions, aiming to help brands exceed customer expectations through responsible marketing practices. They offer a customer experience and data platform that enables personalized cross-channel journeys using AI and data unification.

Location: United States

Responsibilities

• Design and build scalable, reliable, and secure data pipelines for streaming, batch, and real-time processing.
• Work in partnership with the Data Science teams to build scalable Pyspark workloads that can be leveraged to generate advanced models.
• Implement and optimise data models and storage solutions using Python and SQL with orchestration tools in a cloud environment.
• Leverage AI to automate both data processing and engineering processes.
• Advocate and uphold best practices for data governance, security, and monitoring.
• Collaborate cross-functionally with engineers, analysts, and data scientists to deliver impactful data solutions.
• Mentor and support junior engineers in data engineering principles and practices.
• Evaluate and recommend new tools and technologies to strengthen data services.

Requirements

• Significant experience delivering Python-based projects for data engineering.
• Experience building and tuning spark pipelines that run at scale across large quantities of data.
• Strong hands-on experience with SQL and NoSQL databases (e.g. SQL Server, MongoDB, Cassandra).
• Proven experience with modern data warehousing and large-scale processing (e.g. Snowflake, DBT, BigQuery, Clickhouse).
• Proficient with data orchestration tools such as Airflow, Dagster, or Prefect.
• Experience with cloud platforms (Azure, AWS, or GCP) for data processing and storage.
• Practical experience with Kafka or equivalent event-driven architectures (e.g. AWS SQS, Azure EventHubs, AWS Kinesis).
• Good understanding of data modelling for OLAP and OLTP workloads.
• Familiar with agile methodologies and CI/CD processes in the context of data solutions.

Benefits

• Parental leave
• Medical benefits
• Paid sick leave
• Dotdigital day
• Share reward
• Wellbeing reward
• Wellbeing Days
• Loyalty reward

Additional Information

• The role involves working in a collaborative, innovative environment with a focus on growth and learning.
• The interview process includes a screening call, a role deep dive with the hiring manager, and a technical interview with the data team.
• Dotdigital emphasizes diversity, equity, and inclusion, and offers various global benefits.