Data Engineer / Devops

Detalhes da Vaga

Explore our latest thought leadership, ideas, and insights on the issues that are shaping the future of business and society.
Choose a partner with intimate knowledge of your industry and first-hand experience of defining its future.
Discover our portfolio – constantly evolving to keep pace with the ever-changing needs of our clients.
Become part of a diverse collective of free-thinkers, entrepreneurs and experts – and help us to make a difference.
See our latest news, and stories from across the business, and explore our archives.
We are a global leader in partnering with companies to transform and manage their business by harnessing the power of technology.
At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.
Your roleWe are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will be responsible for developing, maintaining, and optimizing our data pipeline architecture while ensuring the availability and performance of critical data workflows. If you are passionate about data engineering, have hands-on experience with cloud platforms and big data technologies, and are a strong problem-solver, this is the role for you.
Design, build, and maintain scalable, efficient, and reliable data pipelines to support data processing and analytics;Implement best practices in Big Data tools and frameworks, ensuring data integrity and performance;Collaborate with cross-functional teams to integrate new data sources and optimize data pipelines;Work with complex datasets, ensuring data quality, transformation, and storage in BigQuery;Troubleshoot data pipeline issues and implement long-term solutions to improve system stability;Write and optimize complex SQL queries for data extraction and analysis;Utilize Kafka for real-time data streaming and event-driven architecture;Implement solutions using Python for data processing and ETL workflows;Perform code reviews and maintain high-quality code standards.Your profileProficiency in BigQuery with 3+ years of experience;3+ years of experience of Spark in large-scale data processing;3+ years of experience of SQL in writing and optimizing complex queries;Advanced proficiency in Python with 4+ years of experience in scripting and automation;2+ years of experience of Kafka with real-time data streaming;Effective communication in English, both verbal and written.Nice to Have:
Experience with Google Dataflow and Google Dataproc for managing data pipelines in GCP;Knowledge of Scala for parallel data processing;Familiarity with Hadoop for distributed storage and processing of big data.What you'll love about working hereJoin a multicultural and inclusive team environment;Enjoy a supportive atmosphere promoting work-life balance;Engage in exciting national and international projects;Your career growth is central to our mission. Our array of career growth programs and diverse professionals are crafted to support you in exploring a world of opportunities;Training and certifications programs;Referral program with bonuses for talent recommendations;Great office locations.Why Capgemini?Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
Apply now!

#J-18808-Ljbffr


Salário Nominal: A acordar

Fonte: Jobleads

Função de trabalho:

Requisitos

Machine Learning Engineer : Query Team

Constructor is the only search and product discovery platform tailor-made for enterprise e-commerce where conversions matter. Constructor's AI-first solution...


Constructor.Io, Inc. - Lisboa

Publicado 13 days ago

Director, Product Management - Data Platform Lisbon

Director, Product Management - Data PlatformLisbonAt Talkdesk, we are courageous innovators focused on redefining the customer experience, making the impossi...


Tbwa Chiat/Day Inc - Lisboa

Publicado 13 days ago

Arquiteto Mainframe

A DXC Technology é uma empresa multinacional americana líder em soluções de TI abrangentes. A nossa missão é apoiar a transformação digital dos nossos client...


Dxc Technology Inc. - Lisboa

Publicado 13 days ago

Arquiteto Microsoft Azure

Role OverviewThe role is for a senior person, who could be an Architect. The Architect is responsible for two customer systems built on top of Azure DataVers...


Alter Solutions Group - Lisboa

Publicado 13 days ago

Built at: 2024-12-27T10:42:27.970Z