Azure Data Engineer

Location India
Discipline: Microsoft Azure, Data Engineering, Data & Analytics
Job type: Contract
Job ref: 32175
Published: 29 days ago

Role Type: Contract

Location: Remote

Duration: 6 months+

Start: ASAP

Job Role:

As an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining data engineering solutions on the Azure cloud platform. You will collaborate with cross-functional teams to understand data requirements, architect scalable data pipelines, and ensure the integrity and reliability of our client's data infrastructure. The ideal candidate will have a strong background in data engineering, expertise in Azure data services, and a passion for leveraging data to drive business insights and innovation.

Responsibilities:

  • Design, develop, and maintain end-to-end data pipelines on Azure, including data ingestion, processing, storage, and visualization.

  • Collaborate with senior data architects, data analysts, and business stakeholders to understand data requirements and translate them into technical solutions.

  • Architect and implement scalable and reliable data solutions using Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure SQL Datawarehouse.

  • Optimize and tune data pipelines for performance, scalability, and cost-efficiency, leveraging best practices and automation tools.

  • Ensure data quality, integrity, and security throughout the data lifecycle, implementing data governance policies and compliance standards.

  • Monitor and troubleshoot data pipelines, identifying and resolving issues in a timely manner to minimize impact on business operations.

  • Stay up-to-date on the latest Azure data services, technologies, and best practices, and provide guidance and mentorship to team members.

Qualifications:

  • Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience).

  • Proven experience as a data engineer, with a focus on designing and building data solutions on Azure.

  • In-depth knowledge of Azure data services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure SQL Datawarehouse, and Azure Data Lake Storage.

  • Strong proficiency in SQL and programming languages such as Python or Scala for data manipulation and transformation.

  • Experience with data modeling, schema design, and performance optimization techniques.

  • Familiarity with data integration patterns, ETL/ELT processes, and data warehousing concepts.

  • Excellent problem-solving and analytical skills, with the ability to troubleshoot complex data issues and drive resolution.

  • Effective communication and collaboration skills, with the ability to work effectively in a remote and cross-functional team environment.

  • Azure certifications (e.g., Azure Data Engineer Associate) preferred