Data Engineer W/Spark

Detalhes da Vaga

Your connection with Aubay starts in the following lines:
Aubay Portugal is a multinational French company, in Portugal since 2007. We have offices in Lisbon and Oporto and we are a specialized consultant in Management, Implementation, Development and Maintenance of Information Systems. We have more than 150 active partners and we operate in sectors such as banking, insurance, telecommunications, services, energy and transports.
What are you going to do?
Develop and optimize distributed data pipelines using Apache Spark, ensuring the efficient processing of large datasets;
Implement advanced caching techniques and optimize distributed computation workflows to improve data retrieval times and resource utilization;
Optimize partition key joins to speed up query processing and enhance overall system performance in distributed environments;
Optimize SQL queries for better performance and scalability, particularly in large-scale, distributed database systems;
If applicable, leverage the Cloudera platform to manage and scale data workflows in big data ecosystems, ensuring reliability and efficiency.
What are we looking for?
More than 5 years of professional experience as a Data Engineer;
Expertise in Apache Spark and distributed computation techniques;
Experience with advanced SQL optimization and caching strategies;
Knowledge of the Cloudera ecosystem is a valuable asset for managing big data platforms;
Fluency in English (written and spoken).
What do we have to offer you?
Health Insurance;
Feedback&Coffee – the system that includes Aubay's Performance Management Cycle, with regular moments of feedback and the Career Progression Model;
Working model: hybrid;
A Training Academy designed to think of you and your needs. You can count on technical and behavioural training sessions (e-Learning and classroom), Meet&Techs, Webinars and Mentoring;
Events and Teambuildings.
What makes us different?
Our organizational culture is based on values such as transparency, team spirit, regular feedback and continuous learning;
Reference prizes and birthday present;
We don't have a dress code;
We know your name and all address each other informally;
You will grow in good company. Isn't this one of the ways in which to develop professionally?
If we got your attention, we now hope to spark your enthusiasm. Ready for the first phase?
We are waiting for you!
We will use personal information that you have sent us to consider your application for the relevant function. By giving us your information/documents by email, you consent to Aubay Portugal treating your personal information. Your privacy is important to us. Please check our Privacy Policy, which explains how we will use and store your personal information. It also explains the rights you have regarding your information and how you can contact us for clarification of questions or requests.

#J-18808-Ljbffr


Salário Nominal: A acordar

Fonte: Allthetopbananas_Ppc

Função de trabalho:

Requisitos

Scrum Master Júnior

Job Description Júnior - Entre 1 a 3 anos 3x semana no escritório - Lisboa  Principais tarefas a desenvolver: Treinar, orientar e apoiar as equipas de SCRUM ...


Alter Solutions - Lisboa

Publicado 10 days ago

Senior Python Developer

Job Description We are looking for a Senior Back End Developer with skills and experience with Python . It is expected that this person becomes the main poin...


Alter Solutions - Lisboa

Publicado 3 days ago

Data Architect

Job Title:  Data Architect Location: Lisbon or Porto Work Regime: Hybrid (3x office) Overview / Summary: LUZA Group is looking for Functional Data Architect ...


Luza Group - Lisboa

Publicado 3 days ago

Application Support

Job Description 2nd line of application support Knowing the procedures and participating in the task automation process Managing and monitoring service level...


Alter Solutions - Lisboa

Publicado 3 days ago

Built at: 2024-11-22T11:49:25.754Z