Senior Data Engineer (Portugal-Based Remote/Hybrid)

Detalhes da Vaga

What you'll be doing:
Design, build and maintain ETL/ELT data pipeline that ingests data from multiple sources with different technologies (MySQL, BigQuery, Cloud Storage, CSV, FHIR, JSON, etc.);
Architect and maintain Sword's (complex) data warehouse; We own lots of different types of data;
Work with complex data architectures, like Kappa and lambda architectures. You'll have the opportunity to work with batch and/or streaming processes;
Have the opportunity to work with some of the most exciting and newest technologies in the data field;
Work closely with our Algorithms and AI teams, supporting their needs for data and pipelines.
What you need to have:
Strong experience with Python programming language;
Previous experience in Software Engineering is considered;
Very high level of SQL and data modelling expertise;
Knowledge about other database types, like NoSQL databases is considered;
Experience in cloud-based architectures, such as GCP and AWS;
Experience with orchestration frameworks like Apache Airflow;
Proactivity and capability of proposing improvements to the team, being technical improvements or processual improvements.
What we would love to see:
Knowledge of Data Governance;
Experience with Modern Data Stack such as DBT , Bigquery;
Experience with Kafka Ecosystem. E.g. Kafka, Kafka Connect, Schema Registry and others;
Experience with IaC (Terraform), Containerization (Docker, Kubernetes) and CI/CD;
Capable of Zooming out and being able to propose changes to data architecture.
To ensure you feel good solving a big Human problem, we offer:
A stimulating, fast-paced environment with lots of room for creativity;
A bright future at a promising high-tech startup company;
Career development and growth, with a competitive salary;
The opportunity to work with a talented team and to add real value to an innovative solution with the potential to change the future of healthcare;
A flexible environment where you can control your hours (remotely) with unlimited vacation;
Access to our health and well-being program (digital therapist sessions);
Remote or Hybrid work policy (Portugal only);
* Please note that this position does not offer relocation assistance. Candidates must possess a valid EU visa and be based in Portugal.

#J-18808-Ljbffr


Salário Nominal: A acordar

Fonte: Allthetopbananas_Ppc

Função de trabalho:

Requisitos

Tester Funcional Sénior

A Integer Consulting é uma empresa portuguesa de consultoria em tecnologias de informação. Somos especialistas em serviços de IT outsourcing, software, proje...


Integer Consulting - Lisboa

Publicado a month ago

(Cloud) Data Platform Engineer

HISCOX is an international insurer specialized in the market of luxury goods & property, and high end professional insurance. As experts in risk we give peop...


Hiscox - Lisboa

Publicado a month ago

Data Engineer

A nossa paixão coloca-nos no lugar certo. A CodeWin nasceu da fusão de duas empresas líderes no setor tecnológico: Decode e Sowin. Unimos a nossa paixão, os ...


Codewin - Lisboa

Publicado a month ago

Technical Support Agent - German Speaking

Technical Support Agent - German SpeakingPortugal, HomebasedWe are seeking a Technical Support Agent who is fluent in German to join our Electronic Data Capt...


Iqvia Argentina - Lisboa

Publicado a month ago

Built at: 2024-11-14T23:27:28.241Z