The Big Data Engineer plays a key role in the Digital Engineering team by supporting the strategy and deliverables related to Cloud Platform (GCP) and Data Engineering. The Big Data Engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides specialised guidance and delivers through self and others to:Design, develop, and integrate ETL/ELT data pipelines for the necessary data from several sources for analysis and for Technology actions;Build applications and products that make use of large volumes of data and generate outputs that allow actions that generate incremental value;Deliver and implement core capabilities (frameworks, platform, development infrastructure, documentation, guidelines, and support) to speed up delivery in the Big Data Programme, assuring quality, performance, and alignment to the technology blueprint and patterns;Support stakeholders and functions in obtaining business value from the operational data;Design and produce high-performing stable end-to-end data applications to perform cost-efficient and complex processing of batch and streaming massive volumes of data in a multi-tenancy big data platform in the cloud;Ingest and automate the necessary data from local and group sources onto the GCP platform;Accountable for ensuring the delivery of solution & use case enablement, GCP project & resource enablement, data source ingestion for Networks sources, application production rollouts, and code/execution optimisation for big data solutions;Work with key stakeholders such as the Group Big Data/Neuron team, ADS, ACoE, local market IT, and Big Data teams to define the strategy for evolving the Big Data capability, including solution architectural decisions aligned with the platform architecture;Investigate and drive new technologies adoption to identify where they can bring benefits;Ensure common data architecture, structure and definition, data cleaning, and data integrity;Support data security & privacy, and thorough documentation processes.Who you areDegree in Computer Science or related field3 years of hands-on Big Data Engineering experience, ideally over a Cloud computing environment3 years of experience in working with Big Data technologies such as Hadoop, Spark, Hive/Impala, HBase, etc.Google Cloud Professional certificationProven hands-on experience with Cloud computing, preferably Google Cloud Platform (particular focus on GCS, Big Query, & various GCP database solutions such as Composer, Dataflow, Data Fusion, Cloud Functions, Pub/Sub, Dataproc, Data Catalogue, Kubernetes Engine, Cloud Build, Cloud Run) is mandatoryKnowledge of other cloud providers such as AWS or Azure is desirableHands-on expertise with Apache Nifi, Apache Kafka, CDAP, Apache Airflow is mandatoryHands-on expertise developing and optimising Apache Spark. Skilled in Python development, SQL, and bash scripting mandatory. Additional development languages desired, e.g., Scala, JavaHands-on experience in implementing large-scale batch and streaming-based Big Data solutionsDeep understanding of big data ecosystems and tools like Hadoop, Spark, Airflow, NiFi, Kafka, various data formats, etc.Background in telecommunication networks and its related data sources, its strengths, weaknesses, semantics, and formats is desirableNot a perfect fit?Worried that you don't meet all the desired criteria exactly? At Vodafone, we are passionate about inclusion for all and creating a workplace where everyone can thrive, whatever their personal or professional background. If you're excited about this role but your experience doesn't align exactly with every part of the job description, we encourage you to apply as you may be the right candidate for this role or another role, and our recruitment team can help you see how your skills fit in.What's in it for youWe want you to feel happy and fulfilled at work, without compromising the other things in life that matter to you. There are lots of ways we support this, including hybrid working and generous parental leave. You'll also get four Spirit Days a year to focus on your personal development and wellbeing, plus a host of other great benefits too.Who we areYou may have already heard of Vodafone - We're a leading Telecommunications company in Europe and Africa. But what you might not know is that we are continuously investing in new technologies to improve the lives of millions of customers, businesses, and people around the world, creating a better future for everyone.As part of our global family, whether that's Vodafone, Vodacom, or _VOIS, you'll feel a sense of pride and purpose as you contribute to our culture of innovation. We pursue equality of opportunity and inclusion for all candidates through our employment policies and practices. We recognise and celebrate the importance of diversity and inclusivity in our workspace and we do not tolerate any form of discrimination especially related to but not limited to race, colour, age, veteran status, gender identification, sexual orientation, pregnancy, ethnicity, disability, religion, political affiliation, trade union membership, nationality, indigenous status, medical condition, HIV status, social origin, cultural background, social, or marital status.
#J-18808-Ljbffr
