Job#:2220 - Senior Data Engineer
Job Description:
We are seeking a Senior Data Engineer with strong experience in modern data engineering, cloud data platforms, analytics, and data modeling. The ideal candidate will have hands-on experience with Microsoft Fabric, Azure Synapse Analytics, Azure Data Factory, Databricks, SQL, Python, PySpark, and Power BI.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and data engineering solutions.
- Develop config-driven data pipelines using Databricks and Azure Data Factory.
- Build and manage Databricks workflows using PySpark, Python, and Databricks SQL.
- Work with Microsoft Fabric and Azure Synapse Analytics for data integration, processing, and analytics.
- Develop and optimize SQL queries and data transformation processes.
- Create and maintain Power BI datasets and reporting solutions.
- Design data models using Star Schema and Snowflake Schema.
- Implement and manage open table formats such as Delta Lake and Apache Iceberg.
- Explore Databricks Genie and AI-driven analytics capabilities, including no-code/low-code solutions.
- Utilize GitHub Copilot and other AI-assisted development tools where applicable.
- Implement data virtualization solutions and integrate data across multiple sources.
- Ensure data quality, performance, scalability, and reliability across data platforms.
- Collaborate with data analysts, developers, architects, and business stakeholders.
