GCP Data Engineer
GCP Data Engineer: (Direct Applicants Only) - Full-Time
The Senior Staff Data Engineer - API serves as a primary development resource for design, writing code, test, implementation, document functionality, and maintain of NextGen solutions for the GCP Cloud enterprise data initiatives. The role requires working closely with data teams, frequently in a matrixed environment as part of a broader project team. Due to the emerging and fast-evolving nature of GCP technology and practice, the position requires that one stay well-informed of technological advancements and be proficient at putting new innovations into effective practice.As a Senior Staff Data Engineer, you will collaborate closely with all team members to create a modular, scalable solution that addresses current needs, but will also serve as a foundation for future success. The position will be critical in building the team’s API engineering practices in test driven development, continuous integration, and automated deployment and is a hands-on team member who actively coaches the team to solve complex problems.
This role will provide application development for specific business environments. Focus on setting technical direction on groups of applications and similar technologies as well as taking responsibility for technically robust solutions encompassing all business, architecture, and technology constraints.
• Work with data engineers, data architects, data scientists, and other internal stakeholders to understand product requirements and then design, build, and monitor data platforms and pipelines that meet today's requirements but can gracefully scale.
• Implement automated workflows that lower manual/operational costs, define and uphold SLAs for timely delivery of data, and move the company closer to democratizing data.
• Enable a self-service data architecture supporting query exploration, dashboards, data catalog, and rich data discovery.
• Promote a collaborative team environment that prioritizes effective communication, team member growth, and success of the team over success of the individual.
• Design and create APIs that accelerate the time from idea to insight.
• Adheres to and supports API best practices, processes, and standards.
• Produce high quality, modular, reusable code that incorporates best practices and serves as an example for less experienced engineers.
• Help mentor team members on complex data projects and following the Agile process.
• Responsible for building and supporting a GCP based ecosystem designed for enterprise-wide analysis of structured, semi-structured, and unstructured data.
• Analyze requirements, design AI/ML based solutions, and integrate those solutions for customer environments.
A successful candidate will have:
• Strong understanding of best practices and standards for GCP Data process design and implementation.
• 2+ years hands-on experience with GCP platform and experience with many of the following components:
o Postman, Dynatraceo Cloud Run, GKE, Cloud Functions
o Bigtable, Cloud SQL, Cloud Spanner
o BigQuery, Cloud Function
o Cloud Run, CI/CD, Cloud Logging
o Vertex AI, NLP, GitHub
• 4+ Years of hands-on experience with many of the following components:
o API Development
o Apigee
o Python FastAPI Framework
o Spark Streaming, Kafka
o SQL, JSON, Avro, Parquet
o Java, Python, or Scala
Certifications (a plus, but not required):
• GCP Cloud Professional Data Engineer
Recommended Jobs
Safety Specialist
Are you looking for more? At Mohawk Industries, we’re committed to more – more customer solutions, more process improvements, more sustainable manufacturing and more opportunities for our t…
Project Manager
Job Description Job Description Position Summary: The Project Manager is responsible for leading cross-functional, large-scale projects from initiation through completion. This role requires s…
Senior Customer Success Manager - SAP Data & AI (South Region)
We help the world run better At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and w…
Inventory Assistant Manager (2nd Shift)
Job Description Job Description Inventory Assistant Manager (2nd Shift)(CC) The Operations Assistant Manager will assist in overseeing all activities related to Glovis Consolidation Center (CC) o…
General Manager/ Managing Director
About the Role: We are partnering with multiple clients across industries to find experienced General Managers / Managing Directors who can lead operations, drive strategic growth, and deliver r…
Fleet Maintenance Operations Specialist
Fleet Maintenance Operations Specialist Full-Time $55,000 - $65,000 + On Call Pay As Needed Overview We are seeking a Fleet Maintenance Operations Specialist to support daily operations…
Electrician
Description Position at Pilgrim's ELECTRICIAN At Pilgrim’s, Safety Is A Condition, which means the safety of our team members comes first - always. ESSENTIAL DUTIES & RESPONSIBILITIES: …
Plant Operating Planning Manager
We have a current opening for a Plant Operating Planning Manager and are actively reviewing applications. Manages Plant operating planning across all the brands/categories produced in Augusta plan…
Restaurant Operations Manager
Job Description Job Description Our globally recognized hospitality and entertainment client is seeking an Operations Manager to support operations at a high-volume, iconic Hollywood location. …
Overnight Studio Cleaner & Lead
Slate is a commercial cleaning company leveraging technology and rigorous quality-control processes to deliver consistent, high-standard cleaning services for business clients nationwide. We are see…