Python GenAI Model Evaluator Job at ClifyX, Austin, TX

dk1WRDd1RHF4VGQ2dXE2L0cxTXBXTjRkYVE9PQ==
  • ClifyX
  • Austin, TX

Job Description

Please share 2 onsite profiles for Model Evaluators . Location can be either SCV or Austin. Billing : $78/Hr Technical Skills

  • Strong understanding of LLMs, generative AI, and transformer-based architectures.
  • Experience with Python, data analysis, and model evaluation frameworks.
  • Familiarity with prompt engineering, embeddings, RLHF/RLAIF, and LLM-based scoring methods.
  • Experience building evaluation datasets and working with annotation platforms.
  • Understanding of safety alignment, bias detection, and adversarial testing.
Tools & Platforms
  • ML/AI frameworks: PyTorch, TensorFlow, HuggingFace, LangChain.
  • Evaluation/annotation tools: Scale AI, GroundTruth, Labelbox, Prodigy.
  • Prompt testing tools: Weights & Biases, MLflow, OpenAI evals, LLM-as-a-judge pipelines.

Job Tags

Similar Jobs

ABM Industries

Recycler Job at ABM Industries

Job Description Position Summary Details The Cleaner position provides the cleaning and upkeep of an assigned area. Payrate $18.00 -18.50 per hour. The pay listed is the hourly range or the hourly rate for this position. A specific offer will vary...

Charleston ENT & Allergy

Medical Assistant (CMA, RMA, CCMA) Beaufort Job at Charleston ENT & Allergy

 ...Charleston ENT & Allergy in Beaufort has immediate needs for a qualified Medical Assistants (CCMA, CMA, NCMA or RMA) to join our growing team! Critically important to the success of the practice, our Medical Assistants are our front line, interacting with patients and... 

INTEGRIS Health

Physician - INTEGRIS Health - Oklahoma City, OK Job at INTEGRIS Health

 ...references via email to ****@*****.*** with the following subject line: "ATTN: PUL/PHY 2025," OR via mail to Jessica Cox, Associate Legal Counsel, ATTN: PUL/PHY 2025, INTEGRIS Health, Inc., 3001 Quail Springs Parkway, 2nd Floor, Oklahoma City, OK 73134.... 

Century Business Products Inc.

Field Service Technician Job at Century Business Products Inc.

 ...re looking for someone who shares our commitment to excellence and customer satisfaction. Job Purpose As a Field Service Technician, youll be responsible for providing technical service and support for our customers in the field. Well equip you with the knowledge... 

Fujitsu Network Communications

Knowledge Documentation Specialist II Job at Fujitsu Network Communications

 ...simultaneously+ Use collaboration platforms such as SharePoint Online (SPO), Confluence and MS Teams for planning, knowledge sharing,...  ...and translating them into actionable content+ Provide peer reviews to ensure consistency and quality across deliverables+ Contribute...