Python GenAI Model Evaluator job at ClifyX Austin, TX, US

Job Description

Please share 2 onsite profiles for Model Evaluators . Location can be either SCV or Austin. Billing : $78/Hr Technical Skills

Strong understanding of LLMs, generative AI, and transformer-based architectures.
Experience with Python, data analysis, and model evaluation frameworks.
Familiarity with prompt engineering, embeddings, RLHF/RLAIF, and LLM-based scoring methods.
Experience building evaluation datasets and working with annotation platforms.
Understanding of safety alignment, bias detection, and adversarial testing.

Tools & Platforms

ML/AI frameworks: PyTorch, TensorFlow, HuggingFace, LangChain.
Evaluation/annotation tools: Scale AI, GroundTruth, Labelbox, Prodigy.
Prompt testing tools: Weights & Biases, MLflow, OpenAI evals, LLM-as-a-judge pipelines.

Job Tags

Similar Jobs

Pyramid Consulting, Inc

Senior Project Manager Job at Pyramid Consulting, Inc

...Job Description Immediate need for a talented Senior Project Manager. This is a 04 months Contract to hire opportunity with long-term... ...in Charlotte NC, Raleigh NC, Atlanta GA, Richmond VA(Remote). Please review the job description below and contact me ASAP...

LinTech Global

Cyber Security Specialist Job at LinTech Global

...Job Description Job Description Cyber Security Specialist Location: 100% Onsite - NMC Portsmouth, Portsmouth, VA LinTech Global... ...Position Overview: The Cyber Security Specialist has IT experience with Cyber Security Policy and threat mitigation. You will have...

Lockheed Martin Corporation

Material Handler Job at Lockheed Martin Corporation

...Demonstrated computer literacy. Able to operate lift truck and trackless tow tractors. Must be able to work any shift. EEO Lockheed Martin is an equal opportunity employer. Qualified candidates will be considered without regard to legally protected characteristics....

Alter Domus

Senior Fund Accountant - Private Equity Job at Alter Domus

...careers.alterdomus.com Alter Domus is currently seeking a Senior Fund Accountant to join our Private Equity Fund Services Team at our... ...public accounting firm performing audits on private equity or hedge funds; ~ Strong verbal and written communication skills; ~...

MANTECH

Government SAP Security Officer Job at MANTECH

...Air Force computer, personnel security, and facility directives (specifically JSIG and DCID documents). Security Clearance: Current Top-Secret Clearance with SCI Eligibility Eligibility for access to Special Access Program Information Willingness to...