Senior Data Engineer

Senior Data Engineer
Empresa:

Hexa People


Detalhes da Vaga

Our client has over 275 employees worldwide. As part of our continued growth, we are looking for a Senior Data Engineer to join the Data Platform team. We need someone that is an enthusiastic problem solver, who likes to be challenged, and has the drive to go out of their comfort zone. We need you to be resourceful and committed to quality, a good communicator, and a team player.Your role in our client team: The Data Platform team is responsible for collecting, analyzing, and sharing data across the business. You will work on the design, development, and maintenance of reliable, efficient, and scalable data systems and pipelines to support the company's growing business.Key ResponsibilitiesAnalyze complex data challenges and recommend adequate solutions according to the identified requirements.Design, develop, and maintain efficient, reliable, and scalable data systems and pipelines to support the idealized solutions.Work closely with the data analytics team to understand requirements, ensure adequate data architectures, and deliver end-to-end data initiatives.Align with the IT, platform, engineering, and product teams to deliver technically robust and business-aligned solutions to production.Communicate with different teams and stakeholders to align technical and business requirements.Work well in a modern agile software engineering environment, with source code control, release cycles, extensive testing, and continuous deployment.Skills Knowledge and ExpertiseThe right candidate is important to us, and we are looking for someone who has the following skills/knowledge:BSc/MSc in Computer Science or related fields.Experience designing architecturally robust solutions for complex software problems, especially in data-related areas.Experience with rigorous software development practices using state-of-the-art patterns and modern practices.Experience communicating with different teams and stakeholders to align technical and business requirements.Experience with software prototyping, development, and testing.Experience with ETL/ELT pipelines that include both batch and stream processing.Experience with programming in Python/Spark (e.g., PySpark, Spark SQL, Spark Streaming, etc.).Experience with data manipulation libraries (e.g., Pandas, NumPy, etc.).Experience with data querying and manipulation using SQL.Knowledge of Databricks and related technologies (e.g., Delta Lake, Delta Live Tables, etc.).Knowledge of relational (e.g., SQL Server, etc.) and No-SQL (e.g., MongoDB, etc.) databases.Familiarity with message queues and streaming services (e.g., Azure Event Hub, Kafka, etc.).Familiarity with Azure and other cloud-native technologies.Ownership, attention to detail, and commitment to quality.Strong written and verbal English communication skills.BenefitsWe offer you a challenging job in a growing and truly global international SaaS company with a competitive compensation structure. You will be part of a fun and hardworking team:Remote / Hybrid workingHealthcareLife insurance6 weeks - work anywhere option per yearEmployee Assistance programContributory retirement savings planOpportunities for training & developmentGreat team and cultureDiscounts portalIncome protection InsuranceOnline GP services
#J-18808-Ljbffr


Fonte: Whatjobs_Ppc

Função de trabalho:

Requisitos

Senior Data Engineer
Empresa:

Hexa People


Php Developer

A Konica Minolta é uma multinacional japonesa com uma mentalidade de start-up. Apesar de termos mais de 100 anos no mercado mundial estamos em constante dese...


Desde Konica Minolta Portugal - Coimbra

Publicado a month ago

Feedzai - Senior Platform Engineer

Feedzai is currently hiring a Senior Platform Engineer to join their amazing team. About The Company Feedzai is the world's first RiskOps platform for fina...


Desde Damia Group Portugal - Coimbra

Publicado a month ago

Technology Delivery Manager

Technology Delivery Manager Hybrid with our Tech Hub based in Coimbra Competitive Salary + Benefits The Constellation Automotive Group is the largest vertica...


Desde Bca Europe - Coimbra

Publicado a month ago

Embedded & Desktop Linux Systems Engineer - Optimisation

Work across the full Linux stack from kernel through GUI to optimise Ubuntu, the world's most widely used Linux desktop and server, for the latest silicon. ...


Desde Canonical - Coimbra

Publicado a month ago

Built at: 2024-09-21T09:52:04.585Z