Data Engineer (Azure) - Remote (LATAM)

Bluelight is a leading software consultancy focused on innovative technology, quality, and customer satisfaction, with a presence across the US and Central/South America. They are expanding and seeking talented professionals to join their diverse community.

Location: Remote (US)

Responsibilities

• Develop and maintain ETL data engineering processes using Python (PySpark) within Azure Synapse Analytics Notebooks and Pipelines.
• Design and build data warehousing structures in a Massively Parallel Processing (MPP) SQL Pool.
• Extract data from various sources including REST APIs, SQL databases, and CSV files.
• Design and optimize data notebooks/pipelines in Azure Synapse Analytics for scalability and performance.
• Contribute to data fabric concepts such as data lakes, lakehouses, delta lakes, and data cataloging.
• Create data models and schemas in collaboration with data architects.
• Implement data quality checks and validation processes.
• Identify and resolve performance bottlenecks, optimize ETL pipelines.
• Monitor ETL jobs, diagnose issues, and ensure pipeline reliability.
• Maintain documentation of data processes and transformations.
• Collaborate with cross-functional teams to understand data requirements.
• Ensure data security and compliance with governance and privacy standards.

Requirements

• Bachelor’s degree in Computer Science, Information Technology, or related field, or equivalent work experience.
• Certifications related to data engineering or data science (e.g., Azure Data Engineer) are a plus.
• Proven experience in ETL data engineering using Python (PySpark).
• Experience extracting data from REST APIs, SQL databases, and CSV files.
• Proficiency in Azure Synapse Analytics resources including Notebooks, Pipelines, Linked Services, and Azure Key Vault.
• Ability to write complex SQL queries and optimize query performance.
• Knowledge of data integration best practices and tools.
• Experience with version control systems like Git (Azure DevOps).
• Strong problem-solving and analytical skills.
• Excellent communication skills and ability to work collaboratively.
• Familiarity with big data technologies, machine learning, and data analysis is preferred.
• Experience with data visualization tools (Power BI, Tableau) and Agile methodologies is a plus.