GCP Data Engineer

Company: VMANICO TECHNOLOGIES, INC
Location: Charlotte
Posted on: April 6, 2025

Job Description:

Title: GCP Data Engineer

Apply fast, check the full description by scrolling below to find out the full requirements for this role.
Duration: 12+ months
Location: Charlotte, NC
Need only GC,USC,H4EAD and GCEAD W2 position

MISSION:
We are seeking a highly skilled and experienced Senior Data Engineer with expertise in Google Cloud Platform (GCP), OpenShift, and data engineering tools. The ideal candidate will be responsible for designing, developing, and maintaining scalable ETL pipelines, cloud-based architectures, and hybrid clusters to support our data processing and analytics needs. This role requires proficiency in Python, database development, and modern tools like Spark, Django, and Airflow.


Day to day:
Design, develop, and execute robust ETL pipelines for data extraction, transformation, and loading.

Implement and manage GCP tools such as Dataproc, Composer, and Google Cloud Storage (GCS) for big data processing and orchestration.

Develop and manage workflows using Airflow and OpenShift.

Work with Spark for large-scale data processing and analysis.

Build, deploy, and manage microservices and hybrid clusters.

Develop APIs and manage CI/CD pipelines to ensure seamless application deployment.

Utilize S3 objects for storage and integration with other cloud platforms.

Collaborate with cross-functional teams to design scalable and efficient data architectures.

Ensure the security, reliability, and scalability of the data infrastructure.



Must haves:
5+ years of hands-on experience with GCP services like Dataproc, Composer, and GCS.

Strong experience with OpenShift and Airflow for workflow orchestration.

Proficiency in Python, Spark, and database development.

Hands-on experience with Django framework and microservices architecture.

Familiarity with hybrid cluster setups and cloud-native solutions.

Experience with API development and managing CI/CD pipelines.

Knowledge of working with S3 objects and other cloud storage technologies.

Strong problem-solving skills with attention to detail.

Excellent verbal and written communication skills.



Plusses:
Familiarity with Kubernetes and Docker for containerized applications.

Experience with data warehousing solutions like BigQuery.

Knowledge of data governance and security best practices.

Keywords: VMANICO TECHNOLOGIES, INC, Charlotte , GCP Data Engineer, Engineering , Charlotte, North Carolina