coverPhoto
Uniting People
Data Engineer
Heathrow, England
£38,306 - £49,416 (Glassdoor Est.)
Rating Highlights
Compensation & Benefits: N/A
Culture & Values: N/A
Career Opportunities: N/A
Work/Life Balance: N/A
Job & Company Insights
Job Type: Full-time
Job Function: data engineer
Industry: N/A
Size: Unknown
Job

Data Engineer

Assist with maintenance and delivery of routine ETL processes and ensure accuracy of the data. Identify and drive improvements and enhancements to the warehouse to ensure it is fit for purpose. Assist in the project to migrate data to AWS, using tools like Lambda, Glue, Python, Spark, Tableau and PowerBI

Assist in the roll out of new tools to the wider business

Key responsibilities:

  • Develop, monitor and error-handle automated data pipelines
  • Extract and load data from various sources
  • Build in line with information management and governance best practices
  • Understand, support and enforce data security protocols
  • Carry out enhancements to existing applications
  • Create low level design for intended functionality

Key Skills:

· Experience or expert knowledge in information technology, computer science, applied mathematics or other relevant area

· A combination of the below skills:

· Experience with data ingestion and pipeline management tools

· Experience with data manipulation, transformation and cleaning techniques (SQL, Python)

· Hands-on experience building ETL pipelines

· Experience in orchestrations tools like AirFlow etc.

· Strong experience with cloud service providers (AWS environments)

· Strong experience in data warehouse tools and techniques (Snowflake or RedShift)

· Programming in scripting languages, Python, Scala or Java is essential

· Understanding of software engineering tools and concepts

· Confident with version control systems

· Knowledge/Experience with steaming and event-processing architectures including technologies such as Kafka and change-data-capture (CDC) products

· Strong Experience in Data Modeling Techniques: ER, Dimensional & Vault 2.0

Experience required:

  • 8+ years senior data engineer having knowledge and ability to perform all of the skills required for datawarehouse design, implement and monitor.
  • 5+ years of ETL design/development
  • Commercial experience with Snowflake Data Warehouse projects (must have some previous Snowflake experience, this is a must-have)
  • Pipelines, ETL/ELT and advanced data ingestion.
  • Security, GDPR and PII data handling principles.

Contract length: 6 months

Job Types: Full-time, Contract

Pay: Up to £425.00 per day

Schedule:

  • Monday to Friday

Work remotely:

  • Temporarily due to COVID-19
Show more
Get alerts to jobs like this, to your inbox.

Suggested Searches