Clustox is a forward-thinking technology company with a mission-driven project aimed at restoring coral reefs impacted by global warming. We are seeking a talented Azure Data Engineer to join our team. The role involves developing scalable and efficient data solutions for global clients while working in a multicultural, innovative, and dynamic team environment. If you’re passionate about solving complex problems, creating advanced data solutions, and driving impactful projects, we want you on our team!
Key Responsibilities:
- Data Pipeline Development: Design and develop scalable and efficient data pipelines using Azure Data Factory, Databricks, and Synapse Analytics.
- Programming & Libraries: Utilize programming languages such as Python and libraries like PySpark and Spark Streaming to build robust solutions.
- Data Storage Solutions: Implement data storage systems like Azure Data Lake, Azure SQL Database, and Cosmos DB to optimize data storage and retrieval.
- Real-Time & Batch Data Pipelines: Develop and manage data pipelines to feed both real-time and batch data to AI/ML models.
- Machine Learning Support: Support deployment, monitoring, and scaling of machine learning models using Azure Machine Learning and MLOps practices.
- Data Integration: Integrate data from various sources, both cloud and on-premises, ensuring smooth data flows.
- ETL Processes: Design and optimize Extract, Transform, and Load (ETL) processes for enhanced data quality and consistency.
- Data Models: Design and implement data models tailored for operational and analytical systems in the cloud.
- Data Optimization: Monitor and tune data pipelines and databases to optimize performance and reduce operational costs.
- Data Security: Implement robust data security practices, including encryption and access controls, ensuring compliance with standards like GDPR and HIPAA.
- Collaboration with Teams: Work closely with data analysts, data scientists, business stakeholders, and DevOps teams to streamline workflows and deliver actionable insights.
- Visualization: Utilize tools like Tableau, Power BI, or Looker for data visualization and advanced analytics to enable data-driven decisions.
Qualifications & Skills:
- Experience: Minimum of 3+ years of experience as a Data Engineer, specializing in Azure-based technologies and cloud solutions.
- Technical Expertise: Proficiency in Azure Data Factory, Databricks, Synapse Analytics, Azure SQL Database, and Cosmos DB.
- Programming Skills: Strong expertise in Python, PySpark, and Spark Streaming.
- Data Management: Experience with data frames like Pandas and Spark DataFrames, and optimization of ETL processes.
- Security & Compliance: Knowledge in implementing data security practices, including encryption and access control. Familiar with compliance standards like GDPR and HIPAA.
- Machine Learning Support: Experience working with AI/ML models, and deployment and monitoring via Azure Machine Learning.
- Visualization & Analytics Tools: Familiarity with tools such as Tableau, Power BI, or Looker for data visualization and analytics.
- Collaboration: Excellent team player with strong interpersonal and communication skills to work effectively with cross-functional teams.
What We Offer:
- Innovative Projects: Work on mission-driven projects, including global sustainability initiatives like restoring coral reefs affected by climate change.
- Growth Opportunities: Learn and grow with the opportunity to take on new roles and responsibilities as you advance in your career.
- International Clients: Collaborate with top-tier clients in the global technology market.
- Dynamic Team Environment: Work with an international and multicultural team that fosters creativity and innovative thinking.
- Flexible Work Environment: Embrace a collaborative atmosphere where new ideas and methodologies are encouraged and rewarded.
Application Instructions:
To apply for the Azure Data Engineer position, please submit your updated CV to email address or apply directly on our website. Make sure to include details of your relevant work experience, qualifications, and certifications.
- Associate Product Manager (Scrum Master) – Join BoolMind in Lahore - January 23, 2025
- Sr. Factory Reporting & Operations Specialist – Haier Pakistan - January 23, 2025
- Senior Education Consultant – ABN Overseas Education - January 23, 2025