QA Engineer
Job Purpose
We are seeking a QA Engineer with experience in testing LLM based software. As a member of the QA team, you will have the opportunity to participate in various projects where LLMs are used to solve complex engineering problems. You will participate in creating and executing automated tests for such applications. You will also participate in the creation and improvement of prompts driving these applications.
Responsibilities
- Implement automated test frameworks and take ownership of existing frameworks for LLM based applications.
- Implement automated tests that use AI for reasoning on the correctness of LLM generated information.
- Improve testing methodologies for LLM based applications.
- Participate and designing and improving prompts used in LLM based applications.
Knowledge and Experience
- Bachelor’s degree in STEM fields.
- 3+ years in QA and QA automation.
- Experience using Agentic AI tools to build test automation tools.
- Proficiency in Python.
- Ability to learn quickly and adapt to new technologies and processes, with a focus on keeping up to date with the latest developments in LLM related technologies.
- Ability to independently learn new complex business domains.
- Strong problem-solving skills and attention to detail.
- Excellent communication and teamwork skills.
- Ability to communicate fluently and professionally in complex technical and business contexts.
Preferred Knowledge and Experience
- Knowledge of fixed income markets and financial instruments.
#LI-JM1
----------: Intercontinental Exchange, Inc. is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to legally protected characteristics.Recommended Jobs
Senior Solution Advisor - Planning and Analytics South
We help the world run better At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and w…
Lead Teacher 2yr olds
Summary Energetic lead teacher for our 2 year old classroom. Fun learning through hands on activities, art, science, etc. Loving person to guide this group of 2 yr olds and train them in all …
Sales Associate
Sales Associate – Commission Based Bonanza Furniture & Mattress 101 W. Walnut Ave., Dalton, GA 30720 Bonanza Furniture & Mattress is seeking experienced Sales Associates to join our team at our …
After School Teacher
We are seeking educated, experienced, loving teachers for our after care program. Qualified candidates will be ready and excited to nurture and teach children between the ages of 2-5 yea…
Executive Assistant
Rockstar is recruiting for a leading independent registered investment advisory firm based in Alpharetta, GA. The client provides comprehensive financial and retirement planning, wealth management, t…
Lawn Care Technician -- pesticide license 24 needed
Lawn Doctor is looking for individuals dedicated to providing high-quality, customer-focused lawn care services to join our team as Lawn Care Technicians. Licensed chemical applicator wanted …
Electrical Project Manager with Capital City Electrical
Description The Electrical Project Manager oversees and coordinates electrical projects from inception to completion. This role involves planning, budgeting, scheduling, and ensuring compliance wi…
RN Team Leader, Phoebe Sumter Hospice
Coordinates the efforts of the assigned staff. Supervises clinical care provided by all staff members and directs and coordinates the patient flow as necessary. Functions as a member of the managemen…
Barber/Cosmetologist
Description We specialize in an amazing Men’s Grooming Experience. Requirements/Responsibilities Provide reat customer service and a high level grooming service. Candidate must have a current …
Software Engineer, Guidance, Navigation, Control
ABOUT THE JOB At Anduril, our Software Engineers are at the forefront of defense technology, crafting high-impact, cutting-edge solutions that redefine innovation. You'll dive into a diverse ran…