Data Engineer - Mid-Senior (Lisbon)

Detalhes da Vaga

Explore our latest thought leadership, ideas, and insights on the issues that are shaping the future of business and society.
Choose a partner with intimate knowledge of your industry and first-hand experience of defining its future.
Discover our portfolio – constantly evolving to keep pace with the ever-changing needs of our clients.
Become part of a diverse collective of free-thinkers, entrepreneurs and experts – and help us to make a difference.
We are a global leader in partnering with companies to transform and manage their business by harnessing the power of technology.
At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.
YOUR ROLEWe are looking for a Data Engineer with experience in data ingestion, processing, and management in cloud environments, especially within the Azure ecosystem. The ideal candidate should be proactive and able to work in agile teams using methodologies like Scrum.
Responsibilities:Develop and manage data pipelines with Azure Data Factory (ADF).Process, transform, and optimize data using Databricks.Collaborate with Product Owners and Tech Leaders to define and implement data solutions in agile sprints.Store and organize data in Azure Storage Accounts.Automate workflows and processes to optimize data ingestion and processing.Document processes and implement best practices throughout the data pipeline.Skills:Ingest data using tools such as Informatica PowerCenter (PWC).YOUR PROFILEMandatory: Knowledge in Azure Data Factory (ADF) for orchestration and automation of data pipelines.Proven experience in pipeline construction.Practice in Databricks with Python and SQL for processing and analyzing large volumes of data.Proven experience in ETL development and generation of partitioned parquet files.Experience in working with SQL and selects in various formats.Proven experience in developing more complex selects.Experience working with Resource Groups, Azure Storage Accounts, Containers, storing and reading files and database and data organization.Knowledge in data formats such as Parquet and experience in data transfer with SFTP.Ability to work in agile teams using methodologies such as Scrum.Experience working with Azure DevOps.Nice to Have: Ingest data from SAP R/3 systems via IDocs.Knowledge of different data integration and automation tools.Experience in data security practices and data management in cloud environments.Experience with Informatica PowerCenter (PWC) for data integration and processing; though "nice to have," it will be essential for development.Familiarity with other storage and processing technologies in Azure environments.Experience with Jira, Confluence, WinSCP or FileZilla, Control-M.Additional Skills: Clear communication and collaboration with cross-functional teams.Proactive in documenting and improving data workflows.Teamwork, commitment, and dedication.Bachelor in Informatic sciences.English level B2.WHAT YOU'LL LOVE ABOUT WORKING HEREJoin a multicultural and inclusive team environment.Enjoy a supportive atmosphere promoting work-life balance.Engage in exciting national and international projects.Your career growth is central to our mission. Our array of career growth programs and diverse professionals are crafted to support you in exploring a world of opportunities.Training and certifications programs.Health and life insurance.Referral program with bonuses for talent recommendations.Great office locations.ABOUT CAPGEMINIChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
Apply now!
Ref. code 1839203
Posted on 07 Oct 2024
Experience level: Experienced Professional
Contract type: Permanent Full Time
Location: Lisbon
Business unit: Engineering And R And D Services
When you join Capgemini, you don't just start a new job. You become part of something bigger.

#J-18808-Ljbffr


Salário Nominal: A acordar

Fonte: Jobleads

Função de trabalho:

Requisitos

Engenheiro Sénior Mern Full- Stack (M/F) – Híbrido (Lisboa)

Descrição da Empresa Somos uma Consultora com competências multidisciplinares dotada de um portfólio que abrange diversas áreas, como Financeira, Telecomunic...


Oney - Lisboa

Publicado a month ago

Iam Application Associate Engineer

.Richemont owns some of the world's leading luxury goods Maisons, with particular strengths in jewellery, fine watches and premium accessories. Each Maison r...


Richemont - Lisboa

Publicado a month ago

Scale Specialist|Thousandeyes

.Cloud and Data Center, Internet of Everything, Networking Job Id: 1430240 Who We Are The name ThousandEyes was born from two big ideas: the power to see wha...


Cisco Systems, Inc. - Lisboa

Publicado a month ago

Reactjs Developer

LOCAL: Lisboa (Híbrido) DESCRITIVO DA FUNÇÃO: A Mind Source está a reforçar a sua Equipa de Web & Mobile Apps com um ReactJS Developer PERFIL:  Experiê...


Mind Source - Lisboa

Publicado a month ago

Built at: 2024-11-15T22:21:11.885Z