Senior Data Engineer in UK

We are looking for an experienced Senior Data Engineer passionate about designing and building high-quality data pipelines to power cutting-edge genAI products. The ideal person would have a strong background and expertise in real-time data streaming and cloud technologies. They would also be able to demonstrate a deep understanding of how these and other technologies can be applied to business problems to generate value.

We currently work in an AWS, Snowflake, Looker, Python and airflow stack; you should be comfortable with these (or similar).

The person we’re looking for

We are looking for a self-starter who can see the big picture and understand how our data points are connected. You should be able to use your excellent communication skills to simplify and explain concepts to others. You will also be comfortable liaising with people from all levels of the organisation and translating their needs and wants into clear requirements.

You will be comfortable mentoring people and bringing out the best in them, have excellent communication skills and enjoy fostering best practices.

You’ll be responsible for

• Serving as a data engineering subject matter expert
• Owning and shaping our data streaming roadmap
• Collecting use cases and requirements from the wider data team and other decision-makers to meet project briefs
• Translating use cases, pain points and success criteria into technical requirements
• Designing and getting sign-off for architectural plans
• Collaborating with cross-functional teams to develop and implement robust, scalable solutions
• Designing, building, maintaining and upgrading data pipelines and self-service tooling to provide clean, efficient results
• Writing automated tests to validate requirements
• Promoting data governance through documentation, observability and controls
• Using version control and performing code reviews
• Promoting the adoption of tools and best practices across the team

Skills and experience

Essential skills:

• Significant commercial experience in a Senior Data Engineering role
• Strong experience with tracking technologies such as Snowplow/Rudderstack/Segment
• Previous experience with real-time data streaming platforms such as Kafka/Confluent/Google Cloud Pub/Sub
• Experience with stream processing frameworks such as Faust/Flink/Kafka Streams or similar
• Great Python skills
• Experience mentoring more junior team members
• Comfortable with ELT pipelines and the full data lifecycle
• Comfortable evaluating both business requirements and technical requirements
• A good understanding of techniques to deal with large datasets
• Experience handling real-time data

Desirable skills:

• Comfortable with database technologies such as Snowflake/PostgreSQL and NoSQL technologies such as Elasticsearch/Redis or similar
• An understanding of JavaScript/TypeScript
• An understanding of Docker
• Experience managing data pipelines over time and evolving them to meet new business requirements

Diversity is incredibly important to us. Research shows how people from marginalised groups are less likely to apply for a job unless they meet every requirement. However, these accountabilities are a guide and, if you feel like this role could be for you and you don’t meet every criteria, please do apply. We’d love to hear from you.

Why choose us

Our Culture

Our success is underpinned by our cultural values. These values are not something we stick up on a wall – they don’t need to be. They are behaviours that we recognise and celebrate in each other. They are what we live by every day.

Our Cultural Values

• Positive vibes
• Take the initiative
• Seek feedback
• Stay ahead
• Team 15gifts

Salary: Up to £80,000

Benefits include

• Employee Assistance Programme (confidential counselling)
• Medicash healthcare scheme (reclaim costs for dental, physiotherapy, osteopathy and optical care)
• easitBrighton travel scheme (discounted public transport options)
• Cycle to work scheme
• Life Insurance scheme
• 25 days holiday + bank holidays + your birthday off (rising to 28 after 3 consecutive years with the business & 30 after 5 years)
• Contributory pension scheme

Other extras in the office

• On site changing rooms, showers and internal bike storage
• Breakfast, fresh fruit, snacks, beers
• Yoga and other fitness activities
• Regular social events, including Friday drinks