Systems Limited is seeking an experienced Senior Data Engineer – Azure to join our team in Lahore, Punjab, Pakistan. In this pivotal role, the Senior Data Engineer will design, develop, and optimize large-scale data solutions using Azure services. If you possess deep expertise in Azure Data services, data architecture, and building ETL/ELT pipelines, and are passionate about delivering scalable, efficient, and secure data systems, we would love to hear from you.
Key Responsibilities
As a Senior Data Engineer – Azure, your responsibilities will include:
- Develop Data Pipelines: Design, develop, and maintain scalable and reliable data pipelines using various Azure services, ensuring efficient and secure data processing.
- Architect Data Solutions: Architect end-to-end solutions for data storage, transformation, and analytics within the Azure cloud environment.
- Optimize Data Models: Optimize data models for improved performance and cost-efficiency, balancing scalability and speed.
- Build ETL/ELT Pipelines: Develop and manage complex ETL/ELT pipelines using Azure Data Factory, Databricks, or similar tools.
- Data Integration: Implement data ingestion and transformation solutions for a wide array of data sources, including both structured and unstructured data.
- Ensure Data Quality & Security: Enforce robust data governance, data quality, and security protocols utilizing tools such as Azure Purview.
- Documentation: Maintain detailed documentation regarding data engineering processes, workflows, and pipelines to ensure clear and consistent data operations.
- Performance Optimization: Regularly monitor, troubleshoot, and optimize data infrastructure to ensure high performance, reliability, and security.
- Collaborative Work: Partner with data analysts, data scientists, and stakeholders to understand their requirements, ensuring data systems align with organizational needs.
- Mentoring: Provide mentorship and guidance to junior engineers, sharing expertise and promoting best practices in data engineering and Azure technologies.
Required Qualifications
The ideal candidate should possess the following qualifications:
- Proficiency in Azure Services: Hands-on experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure SQL Database, and Azure Blob Storage.
- Programming Skills: Strong knowledge of Python, Scala, or SQL for data processing, ensuring efficient and scalable data handling.
- Big Data Experience: Expertise in working with distributed data systems such as Spark and Hadoop, with the ability to optimize performance in these environments.
- Database Expertise: Deep familiarity with relational databases (e.g., SQL Server, PostgreSQL) as well as NoSQL databases (e.g., CosmosDB).
- ETL/ELT Experience: Proven track record in designing and building complex ETL/ELT pipelines, enabling high-volume and complex data processing workflows.
- Educational Requirements: A Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field is preferred.
How to Apply
If you are passionate about data engineering and have experience working with Azure, apply today to join our talented team. Please submit your CV with details of your relevant experience and expertise.
Asad Hameed is an inspiring professional who advanced from salesman to Managing Director of a renowned print media company with 200 employees in just eight years. His journey reflects his ability to align personal skills and education with career goals, showcasing exceptional dedication and strategic growth. Asad’s expertise lies in helping others unlock their potential, craft impactful job applications, and achieve success. His story serves as a guide for professionals striving to excel in competitive industries.
Latest posts by Asad Hameed (see all)
- Associate Product Manager (Scrum Master) – Join BoolMind in Lahore - January 23, 2025
- Sr. Factory Reporting & Operations Specialist – Haier Pakistan - January 23, 2025
- Senior Education Consultant – ABN Overseas Education - January 23, 2025
Apply for this job