Start your application for this job today
Apply NowData Pipeline Engineer in London
Location:
London
Salary:
£50,000 per year
Recruiter:
Hexegic Limited
Job Hours:
Full-time
Hexegic is a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career.
The Role
The Data Pipeline Engineers ensure that our customer work with updated and correct data in our data analytics tool. You are the first to respond to data health failures on key pipelines. You will be comfortable reading code to identify fixes and making changes.
Core Responsibilities
- Maintain build schedules so that pipelines run effectively.
- Set up and maintaining health checks on different data pipelines
- Respond, Triage, and debug the data pipeline when broken.
- Reading code and writing code changes and/or modifying the monitoring set-up
- Knowing and understanding how to navigate the data pipelines and documentation.
- FollowingStandard Operating Procedures to contact other teams and data providers when data is incorrect or not received on time.
- Communicating outages with the end users of a data pipeline
What We Value
- Comfortable reading and writing code in Python, Pyspark and Java.
- Basic understanding of Spark and interested in learning the basics of tuning Spark jobs.
- Data pipeline monitoring team members should be able to use and navigate pipeline development tools.
- Experience supporting data integration technologies.
What we offer
- salary £50,000 to £60,000
- 25 days annual leave
- Personal development program £5,000 per employee per year!
Related jobs near me
People also searched for
About Hexegic Limited
At Hexegic we are not just passionate about protecting data through our Cyber services we are passionate about helping companies release the potential of the data they hold through our interlinked Data services.
Data is primacy in the modern world and with so many organisations either on the journey to digital transformation or having already realised it there is no better time to get to grips with your organisations data requirements and realise its potential.
We provide Governments and high performing businesses the tools and resources empowering them to safely achieve their mission.
Cyber, Risk and Intelligence
Key Services
• Risk Assessment
• Incident Response
• Managed Services
• Barrier Model Consultancy
• Application Assurance
• Doctrinal Development
• Analysis Training and Capacity Building
• Open-Source Intelligence
• Intelligence Model Development
Data Science, Data Engineering and Analytics
We believe in a multi-disciplinary approach to data science and engineering and our experts come from a diverse range of backgrounds in fields such as software development, anthropology, finance, civil service, and mathematics.
With this approach we have successfully built cohesive teams with broad experiences that can not only manipulate and derive intelligence from data but also speak the language of the operational business teams they support.
As such we now support data transformation projects in some of the largest organisations in the UK.
We offer services in.
• Data Analysis
• Data Development
• Data Modelling
• Data Machine Learning
• Data Engineering/Pipeline
• Data Testing
Data is primacy in the modern world and with so many organisations either on the journey to digital transformation or having already realised it there is no better time to get to grips with your organisations data requirements and realise its potential.
We provide Governments and high performing businesses the tools and resources empowering them to safely achieve their mission.
Cyber, Risk and Intelligence
Key Services
• Risk Assessment
• Incident Response
• Managed Services
• Barrier Model Consultancy
• Application Assurance
• Doctrinal Development
• Analysis Training and Capacity Building
• Open-Source Intelligence
• Intelligence Model Development
Data Science, Data Engineering and Analytics
We believe in a multi-disciplinary approach to data science and engineering and our experts come from a diverse range of backgrounds in fields such as software development, anthropology, finance, civil service, and mathematics.
With this approach we have successfully built cohesive teams with broad experiences that can not only manipulate and derive intelligence from data but also speak the language of the operational business teams they support.
As such we now support data transformation projects in some of the largest organisations in the UK.
We offer services in.
• Data Analysis
• Data Development
• Data Modelling
• Data Machine Learning
• Data Engineering/Pipeline
• Data Testing
About London,
Population: 8,799,774
Train Stations: 333
Education Stats
- Schools: 5659
- Primary Schools: 3557
- Secondary Schools: 1393
- Sixth Forms: 795
- 17% are independent
- Ranking: 1/9
- Top 20%
House Prices
- Average House Price: £773,961
- Compared to UK Average: +£399,319
- -
- -
- -
- Ranking: 1/9
- Top 20%
- -
Average Salary
- Average Salary: £40,701
- +£8,060 UK Average
- -
- -
- -
- Ranking: 9/9
- Top 20%
- Highest Paid Job Advertised: Quantitative Analyst
Crime Stats
- Crimes per 1000: 121
- -
- -
- -
- -
- Ranking: 7/9
- Bottom 40%
- Worse than last year
The best places to find the most Data Pipeline Engineer jobs
Companies:
Recruitment Agencies:
Job Boards:
Average salary comparison
Job salary over time
Salaries by job level
Salary across the UK
Useful Resources:
Career Advice:
CV template for a Data Pipeline Engineer
View Now