Lead Data Engineer

Brillio is a fast-growing digital technology service provider known for its innovative digital adoption and world-class professionals called 'Brillians'. The company emphasizes contemporary technologies and digital projects, fostering a great workplace environment.

Location: United States

Responsibilities

• Build and support high-quality, modern data architecture at scale.
• Develop state-of-the-art data pipelines and models for decision-making.
• Work on large-scale lakehouse and warehouse analytics systems processing real-time and batch data feeds.
• Help shape data capture methodologies to improve test-driven development and data-driven culture.

Requirements

• 5+ years’ experience with SQL.
• 5+ years’ experience designing and implementing scalable ETL processes.
• 3+ years’ experience with modern Big Data Analytics using Data Lake, Spark, and formats like Parquet.
• 2+ years’ experience building cloud-hosted data systems, preferably on Azure.

Additional Information

• Experience with Azure Databricks/Fabric/Spark, delta lake, Azure Data Explorer/Kusto, AI/ML applications in data engineering, and data governance for AI applications is preferred.