Sr. Data Engineer
Experience: 5+ Years
Job Location: Remote
No. of Positions: Multiple
Qualifications: BE/B Tech, ME/MTech, MCA or Higher
Work Timings: 1:30 PM IST to 10:30 PM IST
Functional Area: Database Development
We are looking for a Senior Database Engineer/Data Engineer (Azure) with strong experience in Azure cloud, advanced SQL skills, and hands-on expertise in building scalable data pipelines and database solutions. The role involves end-to-end data engineering, performance tuning, Azure development, and ensuring secure, reliable, and optimized data workflows.
Key Responsibilities
- Design and maintain relational database schemas and optimize SQL queries, stored procedures, and scripts.
- Build, optimize, and maintain dynamic and parameterized Azure Data Factory (ADF) pipelines with robust error handling and retry logic.
- Develop scalable data processing workflows using Azure Databricks & PySpark.
- Work on Azure Synapse Analytics and write advanced T-SQL queries for data validation across SQL Server and Synapse.
- Manage ADLS Gen2 with Delta Lake / Lakehouse design (Bronze/Silver/Gold layers).
- Perform performance tuning for SQL queries and Spark jobs.
- Implement and maintain CI/CD pipelines using Azure DevOps/Git for version-controlled, unified deployments.
- Work with Service Principals and Managed Identities for secure access.
- Monitor and troubleshoot database and pipeline performance.
- Administer SQL Server / PostgreSQL, ensuring high availability, security, and DR processes.
- Support modernization and cloud migration initiatives (e.g., SSIS to Azure).
- Collaborate with cross-functional teams across applications, analytics, and data engineering.
Required Skills & Experience
- 5+ years of experience in Data Engineering / Database Development.
- Strong proficiency in SQL Server or PostgreSQL; expertise in T-SQL and query optimization.
- Hands-on expertise in ADF, Azure Databricks, PySpark, and Azure Synapse.
- Solid understanding of ADLS Gen2, Delta Lake, and Lakehouse architecture.
- Experience with CI/CD using Azure DevOps/Git.
- Knowledge of Service Principals and Managed Identities.
- Strong performance tuning skills (SQL + Spark).
- Experience working with international clients (USA/Europe).
- Excellent analytical and communication skills.