Role Type: Contract
Location: Remote
Duration: 6 months+
Start: ASAP
Job Role:
As an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining data engineering solutions on the Azure cloud platform. You will collaborate with cross-functional teams to understand data requirements, architect scalable data pipelines, and ensure the integrity and reliability of our client's data infrastructure. The ideal candidate will have a strong background in data engineering, expertise in Azure data services, and a passion for leveraging data to drive business insights and innovation.
Responsibilities:
Design, develop, and maintain end-to-end data pipelines on Azure, including data ingestion, processing, storage, and visualization.
Collaborate with senior data architects, data analysts, and business stakeholders to understand data requirements and translate them into technical solutions.
Architect and implement scalable and reliable data solutions using Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure SQL Datawarehouse.
Optimize and tune data pipelines for performance, scalability, and cost-efficiency, leveraging best practices and automation tools.
Ensure data quality, integrity, and security throughout the data lifecycle, implementing data governance policies and compliance standards.
Monitor and troubleshoot data pipelines, identifying and resolving issues in a timely manner to minimize impact on business operations.
Stay up-to-date on the latest Azure data services, technologies, and best practices, and provide guidance and mentorship to team members.
Qualifications:
Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience).
Proven experience as a data engineer, with a focus on designing and building data solutions on Azure.
In-depth knowledge of Azure data services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure SQL Datawarehouse, and Azure Data Lake Storage.
Strong proficiency in SQL and programming languages such as Python or Scala for data manipulation and transformation.
Experience with data modeling, schema design, and performance optimization techniques.
Familiarity with data integration patterns, ETL/ELT processes, and data warehousing concepts.
Excellent problem-solving and analytical skills, with the ability to troubleshoot complex data issues and drive resolution.
Effective communication and collaboration skills, with the ability to work effectively in a remote and cross-functional team environment.
Azure certifications (e.g., Azure Data Engineer Associate) preferred