Tech Lead – Azure Databricks Data Platform

Exciting opportunity for a dynamic Data Technical Lead with strong Databricks experience and Azure to join a World Leading Energy Trading company.

Specific requirements of this unique demand/role:

Tech Lead Azure Databricks Data Platform

We are seeking a highly experienced Technical Lead with deep expertise in the Azure Data Platform and Databricks ecosystem. The ideal candidate should have strong hands-on experience with Structured Streaming, Delta Live Tables (DLT), PySpark architecture, Python, and SQL, and a proven track record of delivering large-scale enterprise data platforms.

Key responsibilities and qualifications include:

• Leading the design, development, and implementation of scalable, high-performance data solutions on Azure and Databricks.
  Defining and driving data strategy, data governance, data quality, and platform best practices.
• Optimising platform runtime performance and managing overall cloud costs, with a strong focus on Databricks streaming workloads.
• Providing end-to-end technical leadership, from solution architecture through delivery and production support.
• Collaborating with business stakeholders to understand requirements and translate them into robust technical solutions.
• Demonstrating strong ownership, accountability, and stakeholder management skills.
• Having experience within the financial trading domain, including knowledge of trading data models and related business processes.
• Driving technical decision-making, mentoring engineering teams, and ensuring successful delivery of business outcomes.
• The successful candidate will possess excellent communication skills, strong leadership capabilities, and the ability to influence technical direction while delivering complex data solutions from concept to implementation.

Products Data Exchange (PDE) is a centralized data repository of harmonized NA and WONA data.
Business case: Achieving cloud modernization is imperative to alleviate speed and agility challenges faced with the current on-premise data landscapes and to increase technical capabilities necessary to deliver outcomes of the PDS 2030 Vision. Benefits include:
Global Reporting: One of the driving benefits is the ability to enable a consistent and cleansed view of global P&L and Exposure.
Near Real-Time Access: PDE provides near real-time access to curated datasets to enable more global intra-day reportin
Business Application: Endur Products
Project Class: Software Engineering Economics, Software Configuration Management, Software Design

With a focus within Energy Trading, Oil & Gas, Financial Markets and Commodities, we offer a transparent Recruitment Service that has proven to be reliable and effective for over 40 years. We are ISO accredited and proud of our excellent TrustPilot Reviews. Your search for a New Contract Assignment or for a New Permanent Job will be in safe hands with Eaglecliff Recruitment. Please telephone for an immediate response or email your CV for a quick response. Eaglecliff Ltd is acting in the capacity of an employment agency for permanent recruitment and an employment business for contractor resourcing.