Big Data Engineer
Familiarity with the Technology stack available in the industry for data management, data ingestion, capture, processing and curation ETL development experience with strong SQL background, analyze huge data sets, trends and issues, and create structured outputs.
Experience in building high-performing data processing frameworks leveraging Google Cloud Platform.
Experience in building data pipelines supporting both batch and real-time streams to enable data collection, storage, processing, transformation and aggregation.
Experience in utilizing Google Cloud Platform Services like Big Query, Composer, Dataflow, Pub-Sub, Cloud Monitoring.
Experience in performing ETL and data engineering work by leveraging multiple google cloud components using Dataflow, Data Proc, BigQuery.
Experience in scheduling like Airflow, Cloud Composer etc.
Experience in Hadoop Big data ecosystem Spark - Batch & Streaming (Python, Scala ) Apache Kafka hands on experience.
Experience in developing both batch and real-time streaming data pipelines Python/Shell scripting.
Nice to have Qualifications:Strong understanding towards Kubernetes, Docker containers and to deploy Google Cloud Platform services is a plus.
Knowledge of Scrum/Agile development methodologies is a plus.
Any experience with Spark, PySpark, or Kafka is a plus.
Data analysis / Data mapping skills is a plus.
Knowledge in data manipulation JSON and XML.
Technical Skills:Google Cloud Platform Services: DataFlow, BigQuery, Cloud Storage, DataProc, Airflow, Composer, Pub/Sub and Memorystore/Redis.
Programming languages: Java, Python.
Database: Teradata, BigQuery/BigTable.
Recommended Jobs
Real Estate Sales Buyers Agent
Are you determined to help buyers find their dream home? Do you thrive in changing people's lives through real estate? We’re looking for two positive, motivated, enthusiastic buyer’s agents to join ou…
Bookkeeper with QuickBooks and HR/Benefits
Bookkeeper with QuickBooks and HR/Benefits Experience Who: A growing organization seeking a reliable and detail-oriented professional. What: Manage bookkeeping using QuickBooks, oversee payro…
Specialty Sales (Style, Tech, Beauty, Ulta Beauty) (T2333)
Starting Hourly Rate / Salario por Hora Inicial: $16.00 USD per hour ALL ABOUT TARGET Working at Target means helping all families discover the joy of everyday life. We bring that vision to life…
Data Integration Engineer
API Integration Engineer - Junior to Mid-Level Atlanta, GA Type: Contract-to-Hire Category: Engineer Industry: Retail Reference ID: JN Date Posted: 08/28/2025 Shor…
Seasonal Stocker - Store
Job Description Job Description Overview Stockers are to receive, price, sensor (if applicable) and inspect freight. Stockers must be proficient in all aspects of the Cavender’s Boot City stoc…
Interior Install Tech II - Special Missions
Interior Install Tech II - Special Missions in GAC Brunswick Unique Skills: Will need to have sheetmetal skills as well as interior experience. One weekend day shift and one 2 shift …
Welding Inspectors - Multiple Locations - Contract
We are SGS – the world’s leading testing, inspection and certification company. We are recognized as the global benchmark for quality and integrity. Our 98,000 employees operate a network of 2,65…
ServiceNow Process Owner
Our client, an innovator the aerospace industry, is hiring a ServiceNow Process Owner to join the team in Georgia on a contract basis. The successful candidate will take ownership of maintaining a rob…
Provider Relations In-House Representative - Remote GA
Great companies need great teams to propel their operations. Join the group that solves business challenges and enhances the way we work and grow. Working at Gainwell carries its rewards. You’ll have…
RN-Cardiac Stepdown 2 - Piedmont Atlanta Hospital - Atlanta, Georgia, United States
MINIMUM EDUCATION REQUIRED: Graduate of a nursing program MINIMUM EXPERIENCE REQUIRED: New Graduates of a nursing program eligible MINIMUM LICENSURE/CERTIFICATION REQUIRED BY LAW: Curr…