We are seeking an experienced Azure Data Engineer with hands-on expertise in Azure Data Factory and Visual Studio Data Cube. The ideal candidate will have a strong background in developing optimized pipelines in Azure Data Factory, particularly focusing on partitioned refresh strategies. Additionally, proficiency in utilizing Visual Studio Data Cube to integrate seamlessly with Power BI, including implementing partitioned refresh for tables in the data model, is crucial for success in this role.
Azure Data Factory Development:
Design, develop, and optimize Azure Data Factory pipelines.
Implement partitioned refresh strategies to enhance data processing efficiency.
Collaborate with cross-functional teams to understand data requirements and translate them into effective data solutions.
Visual Studio Data Cube Integration:
Utilize Visual Studio Data Cube for developing data models that integrate seamlessly with Power BI.
Implement partitioned refresh for tables within the data model to ensure optimal performance.
Work closely with business intelligence teams to understand reporting needs and deliver data models that meet those requirements.
Azure Cloud Expertise:
Leverage Azure cloud services to build scalable and reliable data solutions.
Stay abreast of the latest Azure updates and incorporate new features into existing data architecture.
Collaboration and Communication:
Collaborate with other developers, data engineers, and stakeholders to ensure effective communication and alignment of goals.
Document development processes, best practices, and solutions for knowledge sharing.
Troubleshooting and Optimization:
Identify and resolve issues related to Azure services and applications.
Continuously optimize Azure-based solutions for performance, scalability, and reliability.
Bachelor’s degree in Computer Science, Information Technology, or a related field.
Proven experience as an Azure Data Engineer with a focus on Azure Data Factory and Visual Studio Data Cube.
In-depth knowledge of optimizing data pipelines and implementing partitioned refresh strategies.
Hands-on experience in developing data models in Visual Studio for integration with Power BI.
Strong understanding of Azure cloud services and their application in data solutions.
Excellent problem-solving skills and the ability to troubleshoot complex issues.
Familiarity with containerization technologies such as Docker and orchestration tools like Kubernetes.
Relevant certifications in Azure development or data engineering are a plus.