Data Platform Engineer

Role : Cloud Data Platform Engineer (JR1032489 )

Location: Iselin, NJ or NYC, NY (Hybrid, 3 days in a week from office)

In-person is required

About the Role:
We are seeking a skilled Cloud Data Platform Engineer to design, develop, and maintain our cloud-based data infrastructure. The ideal candidate will have extensive experience working with cloud platforms, data engineering pipelines, and modern data tools to enable scalable analytics and data-driven decision-making.

Key Responsibilities:

• Design, implement, and maintain cloud data platforms leveraging Azure Cloud.
• Develop and optimize ETL/ELT pipelines to transform raw data into actionable insights.
• Manage and configure cloud-based data warehouses, data lakes, and data platforms such as Databricks, Snowflake, and Redshift.
• Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver scalable solutions.
• Automate infrastructure deployment using Infrastructure as Code (IaC) tools like Terraform or CloudFormation.
• Maintain and optimize cluster configurations, notebooks, jobs, and workspace components within Databricks.
• Monitor cloud data platform performance, troubleshoot issues, and implement improvements.
• Promote best practices in DevOps, CI/CD pipelines, and data security.
• Stay abreast of new cloud and data engineering trends and incorporate innovative approaches.

Required Skills & Qualifications:

• Overall 8+ years of experience in IT is required
• Proven experience with cloud platforms such as Azure, AWS, or Google Cloud.
• Strong understanding of data warehousing, data lakes, and ETL processes.
• Programming experience in Python, Java, or Scala.
• Deep expertise with cloud data platforms, particularly Databricks; knowledge of Snowflake, Redshift, etc., is a plus.
• Solid understanding of Databricks architecture including clusters, notebooks, jobs, and workspace management.
• Familiarity with relational databases and NoSQL technologies.
• Hands-on experience with Infrastructure as Code tools (Terraform, CloudFormation).
• Understanding of CI/CD practices, automation, and DevOps principles.
• Excellent analytical, problem-solving, and troubleshooting skills.
• Strong communication and collaboration abilities across multidisciplinary teams.

Preferred Qualifications:

• Prior experience working in agile development environments.
• Certifications in cloud platforms or data engineering (e.g., Azure Data Engineer, AWS Certified Data Analytics, Databricks certification).