QA Engineer
Job Purpose
We are seeking a QA Engineer with experience in testing LLM based software. As a member of the QA team, you will have the opportunity to participate in various projects where LLMs are used to solve complex engineering problems. You will participate in creating and executing automated tests for such applications. You will also participate in the creation and improvement of prompts driving these applications.
Responsibilities
- Implement automated test frameworks and take ownership of existing frameworks for LLM based applications.
- Implement automated tests that use AI for reasoning on the correctness of LLM generated information.
- Improve testing methodologies for LLM based applications.
- Participate and designing and improving prompts used in LLM based applications.
Knowledge and Experience
- Bachelor’s degree in STEM fields.
- 3+ years in QA and QA automation.
- Experience using Agentic AI tools to build test automation tools.
- Proficiency in Python.
- Ability to learn quickly and adapt to new technologies and processes, with a focus on keeping up to date with the latest developments in LLM related technologies.
- Ability to independently learn new complex business domains.
- Strong problem-solving skills and attention to detail.
- Excellent communication and teamwork skills.
- Ability to communicate fluently and professionally in complex technical and business contexts.
Preferred Knowledge and Experience
- Knowledge of fixed income markets and financial instruments.
#LI-JM1
----------: Intercontinental Exchange, Inc. is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to legally protected characteristics.Recommended Jobs
Work from Home Sales Opportunity
Tired of Trading Time for Money? If you’re motivated, coachable, and open to learning a new skill, we’re mentoring individuals into the life insurance industry. ✔️ No prior experience require…
Vice President of Enterprise Sales, East
Get to know Okta Okta is The World’s Identity Company. We free everyone to safely use any technology, anywhere, on any device or app. Our flexible and neutral products, Okta Platform and Auth0 Pla…
Customer Service Representative
Customer Service Representative I – (Remote after training period) Shift: Morning, Mid-Day, Afternoon/Evening Shifts | Full-time Location: Alpharetta, GA (2 weeks in-office training, then Remot…
Laborer (Construction)
Job Description Job Description Come work with the best! At Maine Drilling & Blasting we work with the unity of family and the determination of business owners. We provide a unique and generous a…
CDL A Driver Owner Operator Position No Truck Required
Apply Now 3-7K weekly avg as an owner operator with our truck fuel discounts with our card Yes you can be an owner operator without having to own or buy a truck. Owner Operator opportunities…
Manager - Patient Experience
Responsibilities: Serves as leader coaching operational excellence. Actively assists departments of Piedmont Healthcare System to achieve the goals of specific entity and system. Facilitates and imple…
Certified Physician Assistant (Internal Medicine) - 44
Physician Assistant (PA-C) – Internal Medicine Full-Time | Outpatient | No Call | No Weekends Join a highly respected, physician-led internal medicine practice known for exceptional care, str…
Line Cook (Night)
Line Cook Stars and Strikes Family Entertainment Center is seeking outgoing, energetic personalities to join our team! Our Stars and Strikes Kitchen Crew takes pride in cooking high-quality menu i…
Key Account Specialist
Location: Atlanta, GA, United States Job ID: 86749 We Elevate... Quality of urban life Our elevators, escalators, and moving walks safely transport more than two billion of us up and down bu…