DATA ENGINEER
Key Responsibilities:
- Collaborate with data architects, analysts, and business stakeholders to understand data requirements and design scalable solutions.
- Develop and maintain data pipelines using Azure Data Factory, Azure Synapse Analytics, and other relevant Azure services.
- Work with Microsoft Fabric to build, manage, and optimize data flows and fabric components for seamless integration and data processing.
- Implement data ingestion processes from various sources, including on-premises databases, cloud platforms, and third-party APIs.
- Assist in data transformation, cleansing, and aggregation processes to ensure high data quality and consistency.
- Support the creation of data models and schemas that facilitate efficient querying and reporting.
- Perform data validation, troubleshooting, and optimization of ETL/ELT processes.
- Contribute to the deployment and management of data solutions in a cloud environment, ensuring performance, scalability, and security.
- Stay up-to-date with the latest advancements in Azure data services and provide recommendations for continuous improvement.
Qualifications:
- Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field.
- 1-2 years of experience working with data engineering, preferably in a cloud environment.
- Hands-on experience with Azure data services, including Azure Synapse Analytics and Azure Data Factory.
- Familiarity with Microsoft Fabric and its components is highly desirable.
- Strong experience in Microsoft Power BI.
- Proficiency in SQL and experience with data modeling concepts.
- Understanding of ETL/ELT processes and data pipeline orchestration.
- Basic knowledge of data governance, security, and compliance in a cloud environment.
- Strong problem-solving skills, attention to detail, and the ability to work collaboratively in a team-oriented environment.
- Excellent communication skills and the ability to articulate technical concepts to non-technical stakeholders.
Preferred Qualifications:
- Experience with Python or other scripting languages for data processing.
- Familiarity with Power BI for data visualization and reporting.
- Certification in Azure Data Engineering or related Azure certifications.
vacancies@datamtx.com | 076 428 6656
http://www.datamtx.com/