Python GenAI Model Evaluator Job at ClifyX, Austin, TX

dk1WRDd1RHF4VGQ2dXE2L0cxTXBXTjRkYVE9PQ==
  • ClifyX
  • Austin, TX

Job Description

Please share 2 onsite profiles for Model Evaluators . Location can be either SCV or Austin. Billing : $78/Hr Technical Skills

  • Strong understanding of LLMs, generative AI, and transformer-based architectures.
  • Experience with Python, data analysis, and model evaluation frameworks.
  • Familiarity with prompt engineering, embeddings, RLHF/RLAIF, and LLM-based scoring methods.
  • Experience building evaluation datasets and working with annotation platforms.
  • Understanding of safety alignment, bias detection, and adversarial testing.
Tools & Platforms
  • ML/AI frameworks: PyTorch, TensorFlow, HuggingFace, LangChain.
  • Evaluation/annotation tools: Scale AI, GroundTruth, Labelbox, Prodigy.
  • Prompt testing tools: Weights & Biases, MLflow, OpenAI evals, LLM-as-a-judge pipelines.

Job Tags

Similar Jobs

Ojalatravel

Independent International Travel Specialist Job at Ojalatravel

 ...Job Description Job Description Independent International Travel Specialist Are you passionate about travel and helping others explore the world? Do you have a keen eye for detail and excellent organizational skills? If so, we're looking for you! Join our team... 

VSV WINS INC

Environmental Health & Safety (EHS) Officer Job at VSV WINS INC

Environmental Health & Safety (EHS) Officer Location: Littleton, MA (Hybrid) Employment Type: Full-Time, Permanent Industry:...  ...internal stakeholders to promote a strong safety culture Manage multiple EHS-related projects simultaneously in a fast-paced environment... 

Cloudflare

Public Relations Director (San Francisco) Job at Cloudflare

 ...Public Relations Director Join Cloudflares mission to help build a better Internet. We run one of the worlds largest networks, powering millions of websites and other Internet properties for customers ranging from individual bloggers to Fortune 500 companies. We protect... 

Concord IT Systems

ETL Architect - Talend Job at Concord IT Systems

 ...Title: ETL ARCHITECT TALENDRate $60/hr on W2Location: ATLANTA, GA / CHARLOTTE, NCHybrid 2 to 3 days ..CLIENT: Venusgeo / American AirlinesEnd date:Start date: ASAP.Required skills:Primary Technical Skills: ETL Architect - Talend. Hands-on experience with... 

Lockheed Martin Corporation

Material Handler Job at Lockheed Martin Corporation

 ...Demonstrated computer literacy. Able to operate lift truck and trackless tow tractors. Must be able to work any shift. EEO Lockheed Martin is an equal opportunity employer. Qualified candidates will be considered without regard to legally protected characteristics....