Our award-winning Fintech client are looking for a Lead Data Engineer to build complex data pipelines in order to compute a variety of advanced analytics and metrics across our universe of exchange order book data.
You will utilise AWS Cloud Technology and Python toolsets to develop these pipelines for new and existing data content at scale and work with the Product team in a truly agile customer centric environment.
This is an amazing opportunity to join a cutting edge Fintech company with the potential to grow your technical, finance, and cloud and data engineering skills.
RESPONSIBILITIES:
- Lead a small team of Data Engineers, providing technical direction.
- Be the SME on Data Engineering across the group.
- Utilise AWS Cloud Technology and Python toolsets to develop complex data pipelines.
- Deliver software within our Agile Development Model.
- Work closely with the Exchange Data Team, Compute Environment Team and The Product Team to support our customers and improve our Data Science product.
- Help with technical initiatives such as but not limited to Technical Prototyping, Data Quality, Performance Tuning, New Product Features and Technical Roadmap delivery.
- Support our Operations team as the Subject Matter Expert for the Data Pipelines.
ESSENTIAL:
- 5-8 Years working in a Data Engineering role.
- Experience of Cloud Technology preferably AWS.
- Experience of working with Data at scale.
- Experience in designing Data Engineering Solutions.
- Experience of Python for the purposes of Data Engineering.
- Willingness to work in a fast paced environment, with tight deadlines.
- Excellent teamwork and ability to work in a multidisciplinary team.
- Experience of PostgresSQL(or any relational database).
DESIRABLE:
- Experience working in Finance.
- Basic understanding of financial markets.
- Experience of working in an Agile Fail Fast Environment.
- Experience of Spark, Jenkins, Docker, RestAPIs, Apache Airflow, NoSQL.
- Experience of Data Concepts such Data Models, Schemas, CDO, Data Quality
- Familiarity with data science tools (Jupyter, Pandas, Plotly)
- Familiarity working with an Agile Development Model.
BENEFITS:
- Competitive salary
- 25 days holiday plus bank holidays
- Share Options after completion of probationary period
- Pension Scheme
- Combination of remote and London based office working
- Continuous learning through training and challenging projects
- Collaborative culture
- Weekly team lunches
- Free fruit, snacks and drinks provided throughout the day (when office based)
- Fridge fully stocked with beer and wine (when office based)
- Regular Team Socials
- Cycle to Work Scheme