Senior Data Engineer (Portugal-Based Remote/Hybrid)

Detalhes da Vaga

What you'll be doing:Design, build and maintain ETL/ELT data pipeline that ingests data from multiple sources with different technologies (MySQL, BigQuery, Cloud Storage, CSV, FHIR, JSON, etc.
);Architect and maintain Sword's (complex) data warehouse; We own lots of different types of data;Work with complex data architectures, like Kappa and lambda architectures.
You'll have the opportunity to work with batch and/or streaming processes;Have the opportunity to work with some of the most exciting and newest technologies in the data field;Work closely with our Algorithms and AI teams, supporting their needs for data and pipelines.What you need to have:Strong experience with Python programming language;Previous experience in Software Engineering is considered;Very high level of SQL and data modelling expertise;Knowledge about other database types, like NoSQL databases is considered;Experience in cloud-based architectures, such as GCP and AWS;Experience with orchestration frameworks like Apache Airflow;Proactivity and capability of proposing improvements to the team, being technical improvements or processual improvements.What we would love to see:Knowledge of Data Governance;Experience with Modern Data Stack such as DBT, Bigquery;Experience with Kafka Ecosystem.
Kafka, Kafka Connect, Schema Registry and others;Experience with IaC (Terraform), Containerization (Docker, Kubernetes) and CI/CD;Capable of Zooming out and being able to propose changes to data architecture.To ensure you feel good solving a big Human problem, we offer:A stimulating, fast-paced environment with lots of room for creativity;A bright future at a promising high-tech startup company;Career development and growth, with a competitive salary;The opportunity to work with a talented team and to add real value to an innovative solution with the potential to change the future of healthcare;A flexible environment where you can control your hours (remotely) with unlimited vacation; Access to our health and well-being program (digital therapist sessions);Remote or Hybrid work policy (Portugal only);To get to know more about our Tech Stack, check .


Salário Nominal: A acordar

Fonte: Talent_Ppc

Função de trabalho:

Requisitos

It Service Desk Administrator (All Genders)

.Company Description TeamViewer is a leading global technology company that provides a cutting-edge platform to remotely access, control and support devices ...


Teamviewer - Porto

Publicado a month ago

Mec Nico

Recrutamos um profissional para apoiar e dar todo o suporte necessário a trabalhos de diagnóstico, manutenção e reparação de viaturas; manutenção do posto de...


Grupo Torrestir - Porto

Publicado a month ago

Senior Full-Stack Engineer - Internal Ai Ops (Portugal-Based Remote/Hybrid)

.Sword Health is on a mission to free two billion people from pain as the world's first and only end-to-end platform to predict, prevent and treat pain. Deli...


Sword Health - Porto

Publicado a month ago

Scrum Master

.The payments market is the most exciting technology market in the world today for good reason. McKinsey values it globally at over $2 trillion and it's grow...


Planet - Porto

Publicado a month ago

Built at: 2024-11-15T04:02:34.658Z