CCapgemini logo

Capgemini

IT Services and IT Consulting · 332k people

GCP Python Data Engineer

Posted 8 Oct

What’s this role about? Design, develop, and optimize scalable ETL/ELT pipelines and data processing solutions on Google Cloud Platform. Collaborate with stakeholders and engineering teams to build robust data models and maintain enterprise data platforms.

New York, New York
On-site
$115K – $145K
Full-time
5-10 years exp
79 5th Ave, New York, NY 10003

Skills required

Tap the ones you have

Want to get this job faster?

Apply with AI

No more application formsOur AI fills them in and submits them for you. You just pick the jobs.

Find hiring manager

Reach the person hiringEmail the person behind the job, not the inbox.

Company

About Capgemini Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organizations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2024 global revenues of €22.1 billion. Make it real | www.capgemini.com

Capgemini

Make it real.

OutsourcingProcess ConsultingPackage Based SolutionsCustom Solution DevelopmentApplication ManagementArtificial IntelligenceBusiness ConsultingCloudDigitalManaged Services
C
10,001+ employees
IT Services and IT Consulting
Public Company
8.6M LinkedIn followers
Raised $5.7B

Responsibilities

  • unstructured data.
  • Build scalable batch and streaming data processing solutions using GCP
  • technologies.
  • Develop event-driven data processing solutions leveraging Pub/Sub and Cloud
  • Functions.
  • Create and maintain data ingestion frameworks for enterprise data platforms.
  • Design and optimize data lake, lakehouse, and data warehouse solutions.
  • Build efficient data models supporting analytics, reporting, and AI/ML
  • workloads.
  • Optimize performance, scalability, and cost efficiency of data pipelines and
  • queries.
  • Develop robust Python-based solutions and frameworks.
  • Automate orchestration and workflow management using Cloud Composer
  • (Airflow).
  • Implement CI/CD pipelines and deployment automation.
  • Apply software engineering best practices for testing, monitoring, and
  • observability.
  • Partner with business stakeholders, analytics teams, data scientists, and
  • engineers to deliver data solutions.
  • Troubleshoot production issues and perform root cause analysis.
  • Continuously improve reliability, scalability, security, and operational
  • excellence.

Qualification

Data & AnalyticsTechnologySoftwareEngineeringConsulting

Required

  • 5+ years of data engineering, software engineering, or related experience.
  • 2+ years of hands-on Google Cloud Platform (GCP) experience.
  • 2+ years of professional Python development experience.
  • Experience developing batch and real-time data pipelines.
  • Advanced SQL development and query optimization skills.
  • Experience with data warehousing, ETL/ELT, and modern data architecture
  • patterns.
  • Strong understanding of cloud-native data engineering practices.
  • BigQuery
  • Dataflow
  • Dataproc
  • Pub/Sub
  • Cloud Functions
  • Cloud Composer (Airflow)
  • Cloud Storage
  • Cloud SQL
  • IAM
  • Cloud Monitoring
  • Cloud Logging
  • Python
  • SQL
  • Bash/Shell Scripting
  • ETL/ELT
  • Data Warehousing
  • Data Lake / Lakehouse Architectures
  • Batch Processing
  • Real-Time Streaming Architectures

Preferred

  • Experience with Vertex AI and Google AI services.
  • Experience building AI/ML data platforms and pipelines.
  • Knowledge of Large Language Models (LLMs) and GenAI concepts.
  • Experience with Gemini models, Agentic AI frameworks, Prompt Engineering, RAG
  • architectures, and Vector Search.
  • Experience with Dataproc, Spark, or PySpark.
  • Familiarity with event-driven architectures.
  • Experience with Terraform or Infrastructure as Code.
  • Understanding of cloud cost optimization and FinOps practices.
  • Financial Services industry experience.
  • Google Cloud Professional Data Engineer Certification.
  • GCP, Google Cloud Platform, Python, BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud
  • Functions, Cloud Composer, Airflow, SQL, ETL, ELT, Data Engineering, Data
  • Pipelines, Streaming, Batch Processing, Cloud Storage, Cloud SQL, Vertex AI,
  • Gemini, Generative AI, Agentic AI, LLM, RAG, Vector Search, Semantic Search,
  • Spark, PySpark, Terraform, Data Warehouse, Data Lake, Lakehouse, CI/CD,
  • The base compensation range for this role in the posted location is: $115,000 -
  • $145,000/ yearly.
  • Capgemini provides compensation range information in accordance with applicable
  • national, state, provincial, and local pay transparency laws. The base
  • compensation range listed for this position reflects the minimum and maximum
  • target compensation Capgemini, in good faith, believes it may pay for the role
  • at the time of this posting. This range may be subject to change as permitted by
  • law.
  • The actual compensation offered to any candidate may fall outside of the posted
  • range and will be determined based on multiple factors legally permitted in the
  • applicable jurisdiction.
  • These may include, but are not limited to: Geographic location, Education and
  • qualifications, Certifications and licenses, Relevant experience and skills,
  • Seniority and performance, Market and business consideration, Internal pay
  • equity.
  • It is not typical for candidates to be hired at or near the top of the posted
  • compensation range.
  • compensation such as variable incentives, bonuses, or commissions, depending on
  • the position and applicable laws.
  • Capgemini offers a comprehensive, non-negotiable benefits package to all
  • regular, full-time employees. In the U.S. and Canada, available benefits are
  • Paid time off based on employee grade (A-F), defined by policy: Vacation
  • 12-25 days, depending on grade, Company paid holidays, Personal Days, Sick
  • Medical, dental, and vision coverage (or provincial healthcare coordination
  • Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
  • Life and disability insurance
  • Employee assistance programs
  • Other benefits as provided by local policy and eligibility
  • Important Notice: Compensation (including bonuses, commissions, or other forms
  • of incentive pay) is not considered earned, vested, or payable until it becomes
  • due under the terms of applicable plans or agreements and is subject to
  • Capgemini’s discretion, consistent with applicable laws. The Company reserves
  • the right to amend or withdraw compensation programs at any time, within the
  • limits of applicable legislation.

Benefits

  • Paid time off
  • Company paid holidays
  • Personal days
  • Sick leave
  • Medical coverage
  • Dental coverage
  • Vision coverage
  • Retirement savings plans
  • Life insurance
  • Disability insurance
  • Employee assistance programs

Interested in this role?

Recommended jobs

  • PPrologis logo

    Senior Semantic Data Engineer

    Prologis·Nashville

    $104K – $144K
    On-site
    Full-time
    5-10 years exp

    Skills required

    Data engineeringData modelingSnowflake
  • MMuleSoft logo

    Solution Engineer (Pre-Sales) – Data Foundation (MuleSoft & Informatica)

    MuleSoft·Boston

    $77.1K – $269.1K
    Hybrid
    Full-time
    2-5 years exp

    Skills required

    MuleSoftInformaticaAPI management
  • SSalesforce logo

    Solution Engineer (Pre-Sales) – Data Foundation (MuleSoft & Informatica)

    Salesforce·Boston

    $77.1K – $269.1K
    Hybrid
    Full-time
    5-10 years exp

    Skills required

    Data integrationMaster data managementData governance