Oferta de trabajo: LLM Evaluation Expert

Details: #NowHiring #LLMEvaluationExpert Job Title: LLM Evaluation Expert Contract: 6 Months Compensation: This position is offering a hourly rate range from $66 - $68 Belcan is a leading provider of professional IT, Engineering, Workforce Solutions and staffing in the United States, Canada, UK, Europe, and India. A LLM Evaluation Expert Job Virtually is currently available through Belcan. In this role you will be instrumental in evaluating LLM-generated mathematical solutions, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted mathematical problem-solving. If you are interested in this role, Apply Today! Job Description: As an LLM Evaluation Expert specializing in Mathematics, you will play a crucial role in assessing and improving our language models' mathematical capabilities. Your expertise will be instrumental in evaluating LLM-generated mathematical solutions, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted mathematical problem-solving. Key Responsibilities: * Critically analyze and evaluate mathematical responses generated by our LLMs across various fields of mathematics (e.g., algebra, calculus, statistics, number theory) * Exercise expert judgment to select the most appropriate and efficient mathematical solutions from multiple LLM-generated options * Make informed decisions on behalf of our customers, ensuring that selected solutions meet rigorous mathematical standards, are logically sound, and address specific research or application needs * Develop and write mathematical demonstrations to illustrate "what good looks like" in AI-generated solutions, setting benchmarks for accuracy, elegance, and insight * Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output of mathematical concepts * Collaborate with the AI research team to identify areas for improvement in the LLM's mathematical reasoning and problem-solving capabilities * Stay abreast of the latest developments in mathematics, mathematical software, and AI to ensure our evaluations remain cutting-edge Required Qualifications: * Advanced degree (Ph.D. preferred) in Mathematics, Applied Mathematics, or a closely related field * Extensive experience (5+ years) in mathematical research, problem-solving, or applied mathematics across multiple subfields * Demonstrated ability to critically evaluate mathematical proofs, solutions, and reasoning for correctness, efficiency, and elegance * Strong analytical and decision-making skills, with the ability to make complex judgments in abstract and theoretical contexts * Excellent written and verbal communication skills, with the ability to explain complex mathematical concepts clearly * Experience in technical writing, particularly in creating mathematical proofs, explanations, or tutorials Preferred Qualifications: * Previous experience working with or evaluating AI systems, particularly in the context of mathematical problem-solving * Familiarity with computer algebra systems, numerical computing environments, and mathematical software packages * Understanding of machine learning concepts, particularly as they apply to mathematical reasoning and problem-solving * Experience in creating or contributing to mathematical textbooks, research papers, or educational content This role requires a unique blend of mathematical expertise, critical thinking, and communication skills. You will be the bridge between advanced AI technology and practical, real-world mathematical applications. Your work will directly influence the development of next-generation AI mathematical assistants, potentially transforming fields such as scientific computing, data analysis, and mathematical research. If you're passionate about mathematics, have a keen eye for elegant solutions, a