Principal Architect - Databricks

Tiger Analytics is a fast-growing advanced analytics consulting firm specializing in Data Science, Machine Learning, and AI, serving Fortune 100 companies with recognized market leadership.

Location: United States

Responsibilities

• Design Databricks-driven enterprise data warehousing (EDW), lakehouse, and business intelligence (BI) systems.
• Build scalable pipelines using Azure Hub, Device SDK, DPS, and Stream Analytics.
• Implement information lifecycle management (ILM) from data ingestion to archiving.
• Define, build, and enforce global data governance and master data management practices.
• Extract and manipulate unstructured data into connected datasets for advanced analytics.

Requirements

• Strong proficiency in building optimized spark pipelines, delta lakes, and lakehouses with Databricks.
• Experience with Azure IoT infrastructure including Azure Hub, Device SDK, DPS, and Device Twins.
• Experience with Azure Functions, Cosmos DB, and Azure Stream Analytics.
• Experience with AWS IoT Core, Device Management, and Device Defender.
• Experience with AWS Lambda, DynamoDB, Amazon Kinesis, and EMR.
• Deep expertise in enterprise data warehousing and business intelligence tools.
• Proven ability to manage both structured and unstructured data assets.
• Excellent communication skills for translating complex technical concepts.
• Demonstrated teamwork skills in cross-functional environments.
• Extensive background in end-to-end data management principles and data lifecycle execution.

Benefits

• Significant career development opportunities.
• Part of a small, challenging, and entrepreneurial environment with high individual responsibility.

Additional Information

• Experience in architecting and building Azure IoT platforms/apps, exposure to containerization and serverless architecture is a plus.