Job Descriptions
We are seeking a highly skilled Data Engineer to join our team. The successful candidate will be responsible for identifying data sources, designing and implementing data engineering solutions, and ensuring appropriate storage of data in line with relevant legislation.
As a Data Engineer, your role is to drive and deliver on the Data engineering needs of the organisation; designing, building, operationalising, securing and monitoring data pipelines and data stores. You will collaborate with colleagues and business owners to understand needs and deliver solutions. You will be a key Data delivery partner and bring a superior and innovative approach to solution delivery
Responsibilities:
- Designs, implements, and maintains complex data engineering solutions to acquire and prepare data.
- Creates and maintains data pipelines to connect data within and between data stores, applications and organisations.
- Carries out complex data quality checking and remediation.
- Identify data sources and evaluate, design, and implement on-premise, cloud-based, and hybrid data engineering solutions.
- Structure and store data for uses including analytics, machine learning, data mining, sharing with applications and organisations. Harvest structured and unstructured data and integrate, consolidate, and cleanse data.
- Migrate and convert data and apply ethical principles in handling data.
- Ensure appropriate storage of data in line with relevant legislation and build in security, compliance, scalability, efficiency, reliability, fidelity, flexibility, and portability
- Collaborate with cross-functional teams to identify business needs and provide data-driven solutions
- Communicate findings and recommendations to stakeholders in a clear and concise manner
- Provide support and mentoring/coaching to less experienced colleagues
Requirements:
5+ years of relevant data engineering experience with know-how in enterprise class data engineering platforms e.g. Teradata Vantage, Snowflake etc
Relevant 3rd Level qualification (Degree, Masters) in a related field (Data Analytics, Data Science, Computer Science, Technology) Excellent knowledge of data engineering concepts and technologies
Experience with Teradata EDW data warehousing, ETL processes, and data modelling
Ability to work collaboratively in a team environment ¿ Demonstrated ability to lead projects and solutions
Strong delivery methodology and testing approach, innovation mindset
Ability to communicate complex information and problems in a simplified manner
Excellent documentation, report writing & presentation skills