QA Engineer
Job Purpose
We are seeking a QA Engineer with experience in testing LLM based software. As a member of the QA team, you will have the opportunity to participate in various projects where LLMs are used to solve complex engineering problems. You will participate in creating and executing automated tests for such applications. You will also participate in the creation and improvement of prompts driving these applications.
Responsibilities
- Implement automated test frameworks and take ownership of existing frameworks for LLM based applications.
- Implement automated tests that use AI for reasoning on the correctness of LLM generated information.
- Improve testing methodologies for LLM based applications.
- Participate and designing and improving prompts used in LLM based applications.
Knowledge and Experience
- Bachelor’s degree in STEM fields.
- 3+ years in QA and QA automation.
- Experience using Agentic AI tools to build test automation tools.
- Proficiency in Python.
- Ability to learn quickly and adapt to new technologies and processes, with a focus on keeping up to date with the latest developments in LLM related technologies.
- Ability to independently learn new complex business domains.
- Strong problem-solving skills and attention to detail.
- Excellent communication and teamwork skills.
- Ability to communicate fluently and professionally in complex technical and business contexts.
Preferred Knowledge and Experience
- Knowledge of fixed income markets and financial instruments.
#LI-JM1
----------: Intercontinental Exchange, Inc. is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to legally protected characteristics.Recommended Jobs
Dairy Cow Milker
Dairy Cow Milker (6456) Location: Rayle, Georgia Job Number: 6456 Dairy Milker needed in Wilkes county, Georgia. Shifts are 5am and 5pm. Off every 3rd milking shift. Duties will include: Ma…
Tax Manager, CPA Remote (COR987321)
Our client, a boutique tax advisory firm, who provides customized tax and advisory services, is seeking a Remote Tax Manager to join their team The Remote Tax Manager will prepare, direct and manage…
API Architect (Onsite Hybrid)
Req ID: 372922 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organiza…
Gynelogical Oncology Physician
Gynecological Oncology Physician Join a dynamic team in a thriving medical community as a Gynecological Oncology Physician. This full-time opportunity is designed for a skilled professional eag…
Construction Laborer
Prepare construction sites by clearing obstacles and debris Load and upload construction materials and equipment Operate various hand and power tools, including jackhammers and earth tampers …
GARAGE - Assistant Manager - Town Center at Cobb
Overview: We’re not just a fashion brand - we’re a movement. At GARAGE , we live for unapologetic confidence, turning everyday moments into something unforgettable, and creating spaces where …
Lead Patient Transporter, Days
Overview: Piedmont Rockdale is a 161-bed, acute care, not-for-profit community hospital in Conyers that has provided compassionate, patient-centered care to Rockdale County and surrounding communitie…
Housekeeping, Vacation Rentals
Escape to Blue Ridge COMPANY OVERVIEW: With over 350 vacation homes, we are a vacation rental company dedicated to providing guests and owners with the best possible experience during their …
Senior Administrative Assistant - Atlanta
Senior Administrative Assistant - Atlanta, United States of America Who We Are Boston Consulting Group partners with leaders in business and society to tackle their most important challenges an…
Procurement Manager, Sourcing and Contracting (Professional Services)
Your primary responsibility will be overseeing the contracting process for Professional Servies categories including Management Consulting, Tax and Audit, HR Services, Contingent Labor and Legal categ…