(#ADS) is seeking an experienced and driven Data Engineer Consultant to join their team in Lahore, with the flexibility of remote work. This contract role will focus on building and maintaining robust data engineering solutions. The ideal candidate will be well-versed in large-scale data pipelines, cloud infrastructure, and leveraging cutting-edge tools such as Azure Data Factory, Azure Synapse, Databricks, DBT, and PowerBI.
As a Data Engineer Consultant, your role will be pivotal in creating data-driven architectures that provide actionable business insights. If you’re passionate about working with data at scale and have a track record of successful project leadership, we invite you to apply.
Key Responsibilities
- Data Pipeline Development:
- Design, develop, and maintain large-scale data pipelines using Azure Data Factory, Databricks, DBT, and other technologies within our data engineering stack.
- Collaborate with data scientists, analysts, and software engineers to build Data and Domain Models that support business insights and analytics.
- Mentorship and Leadership:
- Provide technical guidance and mentorship to junior data engineers, ensuring high-quality outcomes and fostering growth within the team.
- Offer strategic insights and lead data engineering initiatives across the team, ensuring alignment with company goals.
- Optimization & Performance:
- Continuously monitor and optimize data pipelines and Databricks workflows for efficiency, scalability, and reliability.
- Troubleshoot performance issues within the data pipelines and distributed systems, providing innovative solutions to enhance performance.
- ETL/ELT & Data Quality:
- Implement and manage ETL/ELT processes, ensuring that data quality and integrity are maintained across all data systems.
- Develop and maintain robust data architecture documentation and best practices to guide future development.
- Automation and Infrastructure Management:
- Drive initiatives around CI/CD for data pipelines and Infrastructure as Code (IaC), ensuring the automation, scalability, and reliability of our data environments.
- Apply Test-Driven Development (TDD) methodologies, writing unit tests, system integration tests, and data quality tests to ensure software robustness.
- Cloud and Data Governance:
- Manage data governance practices, data security, and observability frameworks, ensuring data privacy and compliance.
- Work closely with cloud-based technologies (preferably Microsoft Azure) to implement efficient, cloud-native data solutions.
Core Skills & Experience
- Minimum of 5+ years in data engineering or a related role, with a demonstrated ability to work with complex, large-scale data infrastructures.
- Expertise in building scalable data pipelines using Azure Data Services.
- Solid experience with DBT to perform data transformations in a modern data stack.
- Strong proficiency with ETL/ELT processes and data warehousing concepts.
- Experience with large-scale OLAP/OLTP databases.
- Hands-on expertise with version control systems (e.g., Git) and continuous integration/deployment (CI/CD) tools.
- Advanced programming skills in Python, with the ability to write effective, efficient code for complex data workflows.
- Excellent problem-solving abilities and experience troubleshooting complex cloud-based architectures.
- In-depth understanding of cloud infrastructure, preferably Microsoft Azure.
- Knowledge of data governance, security, and data observability frameworks (e.g., Elementary, Anomalo) is required.
Preferred Qualifications
- Certified Azure Solutions Architect and Azure Data Engineer Associate (AZ-305 and DP-203).
- Experience with streaming platforms such as Kafka or Azure Event Hub.
- Familiarity with containerization technologies such as Docker and Kubernetes.
- Experience working with IaC tools like Terraform.
Benefits
By joining (#ADS), you will gain:
- Competitive Remuneration:
- Attractive contract-based compensation with performance-based incentives.
- Remote Flexibility:
- Hybrid work environment that offers both on-site collaboration and the flexibility to work remotely.
- Growth Opportunities:
- Exposure to cutting-edge technologies and opportunities to grow within a leading company in data engineering.
- Dynamic Team Environment:
- Work within a collaborative and supportive team that values continuous learning and innovation.
Application Instructions
Interested candidates should submit their CV to hirra.asghar@aldaimsolutions.com or apply through the official website.
In your application, kindly include:
- Relevant work experience, particularly in data engineering and using Azure Data tools.
- Educational qualifications, certifications, and any relevant industry achievements.
- Links to your GitHub or portfolio if applicable.
Asad Hameed is an inspiring professional who advanced from salesman to Managing Director of a renowned print media company with 200 employees in just eight years. His journey reflects his ability to align personal skills and education with career goals, showcasing exceptional dedication and strategic growth. Asad’s expertise lies in helping others unlock their potential, craft impactful job applications, and achieve success. His story serves as a guide for professionals striving to excel in competitive industries.
Latest posts by Asad Hameed (see all)
- Associate Product Manager (Scrum Master) – Join BoolMind in Lahore - January 23, 2025
- Sr. Factory Reporting & Operations Specialist – Haier Pakistan - January 23, 2025
- Senior Education Consultant – ABN Overseas Education - January 23, 2025
Apply for this job