Senior Data Engineer (Portugal-Based Remote/Hybrid)

Detalhes da Vaga

What you'll be doing:

Design, build and maintain ETL/ELT data pipeline that ingests data from multiple sources with different technologies (MySQL, BigQuery, Cloud Storage, CSV, FHIR, JSON, etc.);

Architect and maintain Sword's (complex) data warehouse; We own lots of different types of data;

Work with complex data architectures, like Kappa and lambda architectures. You'll have the opportunity to work with batch and/or streaming processes;

Have the opportunity to work with some of the most exciting and newest technologies in the data field;

Work closely with our Algorithms and AI teams, supporting their needs for data and pipelines.

What you need to have:

Strong experience with Python programming language;

Previous experience in Software Engineering is considered;

Very high level of SQL and data modelling expertise;

Knowledge about other database types, like NoSQL databases is considered;

Experience in cloud-based architectures, such as GCP and AWS;

Experience with orchestration frameworks like Apache Airflow;

Proactivity and capability of proposing improvements to the team, being technical improvements or processual improvements.

What we would love to see:

Knowledge of Data Governance;

Experience with Modern Data Stack such as DBT , Bigquery;

Experience with Kafka Ecosystem. E.g. Kafka, Kafka Connect, Schema Registry and others;

Experience with IaC (Terraform), Containerization (Docker, Kubernetes) and CI/CD;

Capable of Zooming out and being able to propose changes to data architecture.

To ensure you feel good solving a big Human problem, we offer:

A stimulating, fast-paced environment with lots of room for creativity;

A bright future at a promising high-tech startup company;

Career development and growth, with a competitive salary;

The opportunity to work with a talented team and to add real value to an innovative solution with the potential to change the future of healthcare;

A flexible environment where you can control your hours (remotely) with unlimited vacation;

Access to our health and well-being program (digital therapist sessions);

Remote or Hybrid work policy (Portugal only);

Please note that this position does not offer relocation assistance. Candidates must possess a valid EU visa and be based in Portugal.

#J-18808-Ljbffr


Salário Nominal: A acordar

Fonte: Allthetopbananas_Ppc

Função de trabalho:

Requisitos

Ict Sales Specialist - Porto

Business Area: Local Vodafone Business Unit Posting Country: Portugal Full Time / Part Time: Full Time Contract Type: Permanent At Vodafone, we're working ha...


Vodafone - Porto

Publicado a month ago

Administrador Sap Basis

Randstad Portugal – Porto, Distrito do Porto A Randstad é a empresa número 1 no setor de recursos humanos a nível mundial e líder em Portugal. Com presença e...


Randstad Portugal - Porto

Publicado a month ago

Devops Engineer

DBServices helps to design, develop and support digital platforms for large and mid-sized companies in ITC, Banking, Retail, Government, Health, and other in...


Db Services Portugal - Porto

Publicado a month ago

Administrador(A) De Sistemas & Pré-Vendas

Administrador(a) de Sistemas & Pré-vendasEstás à procura de uma oportunidade para integrar um projeto de telecomunicações líder no mercado B2B? Queres fazer ...


Dellent Consulting - Porto

Publicado a month ago

Built at: 2024-11-14T04:48:23.625Z