Note: The job is a remote job and is open to candidates in USA. Call For Referral is seeking experienced Machine Learning and Natural Language Processing (NLP) professionals to contribute to advanced AI research and evaluation projects. The role focuses on designing real-world ML and NLP tasks, developing solutions, and evaluating AI models to enhance their capabilities.

Responsibilities

• Design challenging, real-world machine learning and NLP tasks based on practical industry or research experience
• Develop reference implementations and executable solutions using Python
• Build evaluation frameworks to assess the performance of AI models on complex ML and NLP challenges
• Analyze model behavior and identify reasoning, capability, and performance gaps
• Classify model failures and provide actionable feedback to improve model quality
• Collaborate with fellow domain experts to ensure evaluation consistency and technical accuracy
• Document methodologies, assumptions, and evaluation results clearly and accurately

Skills

• Deep hands-on experience in Machine Learning and/or Natural Language Processing through industry, research, or graduate-level work
• Strong working proficiency in Python for machine learning development and experimentation
• Solid understanding of modern machine learning and NLP techniques, including model training, evaluation, transformers, large language models (LLMs), and related tooling
• Experience designing, developing, or evaluating machine learning systems and workflows
• Strong analytical and problem-solving skills
• Excellent written communication skills
• Ability to work independently and commit approximately 20 hours per week
• Master's degree or PhD in Computer Science, Machine Learning, Artificial Intelligence, Natural Language Processing, or a related field
• Experience with AI model evaluation, AI training, data annotation, or reinforcement learning from human feedback (RLHF)
• Experience building production-grade ML or NLP systems
• Contributions to open-source projects, research publications, or applied AI initiatives
• Familiarity with agentic AI systems and LLM evaluation methodologies

Benefits

• Part-time W-2 employment
• Fully remote within the United States

Company Overview