Data Analytics Engineer - Expiring soon!
Posted 13/08/2024 by Intec Select Ltd
Data Analytics Engineer – Financial Services – SQL / Python / Power BI – Hampshire
Overview:
An Exciting opportunity has arisen with one of the UK’s largest Life Insurance brokers for a Data Analytics Engineer to join the growing team. Reporting to the Data Platform Manager, you will play a critical role in designing, building, and maintaining the infrastructure that allows the teams to analyse data efficiently and effectively. You will work closely with data scientists, analysts, and business stakeholders to ensure that the data pipelines are robust, scalable, and optimized for performance.
Role & Responsibilities:
Essential Skills & Experience:
Package:
Overview:
An Exciting opportunity has arisen with one of the UK’s largest Life Insurance brokers for a Data Analytics Engineer to join the growing team. Reporting to the Data Platform Manager, you will play a critical role in designing, building, and maintaining the infrastructure that allows the teams to analyse data efficiently and effectively. You will work closely with data scientists, analysts, and business stakeholders to ensure that the data pipelines are robust, scalable, and optimized for performance.
Role & Responsibilities:
- Design, implement, and maintain scalable data pipelines to collect, process, and analyse large datasets from various sources
- Develop and optimize data models that support analytical and reporting needs, ensuring data accuracy and consistency
- Collaborating with key stakeholders to ensure the implementation of data products for insights and informed decisions, providing demos of the semantic model or building dashboards
- Manage and optimize the data storage solutions, including relational and NoSQL databases
- Designing and implementing performant data ingestion pipelines from multiple sources using Apache Spark - ideally in Azure Databricks
- Work closely with data scientists, analysts, and business teams to understand their needs and deliver solutions that drive insights and decision-making
- Identify and resolve performance bottlenecks in data processing and ensure the efficiency of ETL processes
- Implement data validation and monitoring processes to ensure the integrity and quality of our data
- Develop automation scripts and tools to improve the efficiency of data processing and analysis workflows
Essential Skills & Experience:
- 3-5 years’ experience in a similar environment
- Strong experience of Python and SQL
- Excellent proficiency in writing SQL
- Strong knowledge of Data Management principles in a Lakehouse Architecture
- Hands on experience designing and delivering solutions using Azure services including Azure Data Factory, Azure Databricks, Azure Synapse, Azure Storage, Azure DevOps
- Strong Power BI knowledge
- Experience managing data solutions deployments using Azure DevOps (CI/CD)
- Previous experience working with Data Scientists to produce ML pipelines into overall data platform solutions
- Experience working in a heavily regulated industry desirable but not essential
Package:
- £55K-65K basic salary
- Hybrid working – 3 days in the office
- Competitive Bonus
- Excellent Benefits
- Type:
- Permanent
- Start Date:
- 12/08/2024
- Contract Length:
- N/A
- Contact Name:
- Login or register to view
- Telephone:
- Login or register to view
- Job Reference:
- V-44102
- Job ID:
- 222159434
Remember: You should never send money to a prospective employer or disclose any financial information. Should you encounter any job listings requesting payments or financial details, please reach out to us immediately. For further guidance, visit jobsaware.co.uk.
