Industry : E-commerce (Fashion & Home)
Location : Portugal
Work Model : 100% Remote
Assignment Type : B2B or Recibos Verdes
Start Date : ASAP
Project Language : English
Project Overview: Join a leading e-commerce company in fashion and home décor, as they undertake critical data engineering projects to support their evolving business needs. This is an exciting opportunity to contribute to high-impact data solutions for an innovative, customer-focused brand, leveraging the latest in data engineering best practices.
Responsibilities: Project Understanding and Communication: Analyze business and technical challenges from a user perspective.
Collaborate with Data Architects and Project Managers to ensure solutions align with the client's data architecture.
Data Pipeline Development: Design, build, and deploy efficient data pipelines according to project requirements.
Apply best practices for performance, scalability, and maintainability.
Use Terraform to deploy and manage infrastructure efficiently.
Testing and Deployment: Define test cases and conduct testing in collaboration with the Project Manager.
Present completed developments to Data Architects and Lead DataOps, ensuring smooth deployment and active monitoring post-deployment.
Documentation and Peer Review: Document processes, tests, and results thoroughly.
Conduct peer reviews and participate in code reviews for quality assurance.
Requirements: Hard Skills: Google Cloud Platform: Solid understanding and at least 1 year of hands-on experience.
Apache Airflow: Minimum 2 years of experience (Google Composer experience preferred).
Google BigQuery: 2+ years with strong skills in optimization and database architecture design.
Terraform: 1+ year of experience in infrastructure deployment.
Optional: Experience with Apache Spark/PySpark, Google Pub/Sub, Kafka, Google Cloud Storage, or Dataflow (Apache Beam) is a plus.
Soft Skills: English Fluency: Strong written and verbal English skills in a working environment.
Communication: Ability to convey technical concepts effectively and understand user needs.
Organizational Skills: Detail-oriented with the ability to maintain structured documentation.
Problem-Solving: Proactive approach to understanding and addressing data challenges.
#J-18808-Ljbffr