Data Architect (Colombo 01) - RMD
FOR OUR CLIENT!
KEY RESPONSIBILITIES
- Design and Develop Scalable Data Pipelines using Python to process
- Manage workflows using orchestration tools with Apache Airflow
- Work extensively with Snowflake to design and optimize data models, schemas, and queries for analytics and reporting
- Leverage message like Kafka, SQS, or similar tools to enable real-time or batch data processing in distributed environments
- Partner with Data Science, Product, and Engineering teams
- Ensure compliance with data governance and security standards to maintain data integrity and privacy
- Create & maintain detailed documents for data solutions, pipelines & workflows
CANDIDATE PROFILE
- 9+ years experience in data engineering
- Expertise in Python for ETL, data manipulation, and scripting
- Experience with Snowflake equivalent cloud-based data warehouses
- Expertise in orchestration tools: Apache Airflow/similar
- Expertise in messaging queues: Kafka, AWS SQS, CI/CD pipelines, cloud platforms: AWS, Azure, or GCP
- Experience with stream processing frameworks like Apache Flink, Iceberg for data lake optimization & management
- Familiarity with programming languages: Scala or Java for data engineering tasks
- Strong problem-solving skills with a passion for solving complex data challenges
- Excellent communication and collaboration skills to work with cross-functional teams
APPLY NOW
