The successful candidate will report to the Data Lead Engineer and will be responsible for, inter alia, the following:
Key Responsibility: Data Engineering and Pipeline Development
Core Tasks:
- Design, develop, implement and maintain efficient batch and real-time data pipelines.
- Build and optimise ETL/ELT processes to support the extraction, transformation and loading of data from various sources.
- Develop and maintain data integration solutions, ensuring seamless data flow between internal systems, databases, APIs and third-party applications.
- Monitor data pipelines and resolve technical issues to ensure reliability, availability and performance.
- Identify opportunities to improve data processing efficiency and automate data workflows.
Key Responsibility: Architecture, Modelling and Management
Core Task:
- Assist in the development and implementation of scalable data architecture solutions.
- Develop and maintain data models, including conceptual, logical and physical data models.
- Support the design, development and maintenance of data lakes and data warehouses.
- Manage and optimise relational and NoSQL databases to ensure efficient data storage and retrieval.
- Ensure that data structures and models meet business and technical requirements.
Key Responsibility: Data Quality, Governance and Security
Core Tasks:
- Implement data quality checks and validation processes to ensure data accuracy, consistency and integrity.
- Apply established data governance standards, including metadata management and Master Data Management (MDM) practices.
- Ensure that data solutions comply with organisational data governance, security and privacy requirements.
- Implement appropriate access controls and data protection measures in line with organisational policies.
- Identify and address data inconsistencies, duplication and quality-related issues.
Key Responsibility: Cloud and Data Platform Management
Core Tasks:
- Develop, implement and maintain cloud-based data engineering solutions.
- Work with cloud and big data technologies to support large-scale data processing and storage requirements.
- Support the optimisation, performance and reliability of data infrastructure and platforms.
- Collaborate with DevOps and Engineering teams on data platform deployment, integration and maintenance.
Key Responsibility: Data Analytics and Integration Support
Core Tasks:
- Prepare, structure and make data accessible for reporting, business intelligence and advanced analytics.
- Collaborate with Data Analysts and other relevant stakeholders to understand data requirements and develop appropriate technical solutions.Collaborate with Data Analysts and other relevant stakeholders to understand data requirements and develop appropriate technical solutions.
- Support the integration of data analytics and machine learning workflows into existing data platforms.
- Develop and maintain data exchange solutions and services for internal and external data consumption.
- Provide technical support to ensure that data is accessible, reliable and fit for analytical use.
- Be involved in weekly working sessions with data team, one shared request backlog that the business sponsors prioritises, provide documented feedback and knowledge transfer to junior engineers.
Key Responsibility: Collaboration and Continuous Improvement
Core Tasks:
- Work closely with the Data Engineering Lead, Data Analytics, DevOps, Engineering, Security and Compliance teams to deliver data-related initiatives.
- Translate business and technical requirements into practical data engineering solutions.Translate business and technical requirements into practical data engineering solutions.
- Document data processes, technical specifications, data models and pipeline configurations.
- Stay informed of emerging data engineering technologies, tools and industry practices.
- Recommend improvements to existing data infrastructure, processes and technologies.
- Participate in technical projects and contribute to the successful delivery of data initiatives.
EDUCATION:
- Bachelor's Degree in Computer Science, Information Technology, Software Engineering, Data Engineering or a related field.
- Postgraduate qualification in Data Engineering, Information Technology, Big Data, Computer Science or a related discipline.
- Relevant professional certifications in cloud computing, data engineering or database technologies.
SKILLS, KNOWLEDGE & EXPERIENCE
- Relevant professional certifications in cloud computing, data engineering or database technologies.
- Data Architecture, Data Modelling, Data management, Data Security,
REQUIRED KEY COMPETENCIES/ATTRIBUTES: Technical Competencies
- Data Pipeline Development
- ETL/ELT Processes
- Data Modelling and Architecture
- Data Warehousing and Data Lakes
- Data Integration
- Database Management
- Cloud and Big Data Technologies
- Data Governance and Quality
- Data Analytics Integration
- Data Security and Privacy
Behavioural Competencies
- Analytical Thinking
- Problem-Solving
- Collaboration
- Communication
- Attention to Detail
- Adaptability
- Accountability
- Continuous Learning
- Stakeholder engagement
Interested people should please submit an updated and condensed CV by clicking Apply Now.