Senior Data Engineer – Databricks & Power BI_ Exp: 8–10 Years

Job Description:

Skills and Technical Expertise

Data Engineering Platforms

Strong hands-on experience with modern data platforms including:

• Databricks
• Apache Spark and distributed data processing

Data Visualization and Analytics

Experience building enterprise dashboards and reports using:

• Microsoft Power BI

Key capabilities:

• Data modeling for BI
• Dashboard performance optimization
• Advanced analytics and visualization

Data Processing and Programming

Strong programming experience in:

• Python
• SQL
• PySpark
• Spark SQL

Experience building high-performance distributed data processing pipelines.

Data Ingestion and Integration

Experience integrating data from multiple sources including:

• REST APIs
• Relational databases
• Cloud storage platforms
• Enterprise SaaS applications

Knowledge of ingestion frameworks such as:

• Kafka
• Event-driven data pipelines

Data Architecture and Modeling

Strong understanding of:

• Data warehouse architecture
• Dimensional modeling
• Data lakehouse architecture
• Data partitioning and indexing strategies

Cloud and Data Platform Knowledge

Experience working with cloud data platforms including:

• AWS / Azure data services
• Distributed storage systems
• Data lake architecture

Data Governance and Quality

Experience implementing:

• Data quality monitoring
• Data lineage tracking
• Metadata management
• Data governance frameworks

Preferred Qualifications

• Experience with lakehouse architecture
• Experience with data orchestration tools
• Experience with streaming data platforms
• Knowledge of data security and access control

Nice to Have

• Experience with machine learning data pipelines
• Experience with real-time analytics
• Experience with large-scale enterprise data platforms