Description

At HackerRank, we help over 2,500 of the most prestigious logos across industries find, hire, and upskill amazing developer talent using our SaaS-based Developer Skills Platform. We pioneered and continue to lead the developer skills market with the ethos of “Skills over Pedigree.” Everyone at HackerRank is passionate about the mission, and we are looking to add smiling faces to help us “Accelerate the World’s Innovation” by making skills matter more than pedigree. This position is Full-Time and Remote within the US. HackerRank is at the forefront of innovation in machine learning and data science. We are launching an ambitious data commercialization program to create a comprehensive benchmark to assess the performance of large language models (LLMs) on coding challenges. We are seeking a highly skilled and motivated research engineer to join our team and drive this initiative forward.

Role and Responsibilities

• Develop and implement a benchmark for assessing LLMs on coding challenges. Conduct research and experiments to evaluate the performance of various LLMs. Prepare and design evaluation metrics and methodologies. Collaborate with cross-functional teams to ensure the seamless integration of the benchmark into our broader data commercialization strategy. Stay abreast of machine learning and LLMs advancements to ensure our benchmarks and models remain cutting-edge. Contribute to the development and deployment of state-of-the-art machine learning models. We Are Looking For Advanced degree (Master's or Ph.D.) in Computer Science, Machine Learning, Data Science, or a related field. Proven experience in machine learning, with a strong emphasis on LLMs and natural language processing. Demonstrated experience in preparing and conducting evaluations of machine learning models. Proficiency in programming languages such as Python and familiarity with machine learning frameworks (e.g., TensorFlow, PyTorch). Strong analytical and problem-solving skills. Excellent communication and teamwork abilities. Passion for staying current with emerging trends and technologies in the field. Nice To Have Experience in benchmarking and performance evaluation of machine learning models. Familiarity with coding challenges and competitive programming. Published research in relevant fields. Benefits & Perks We have a full package of competitive benefits and perks, which include the following: One-time home office set up stipend Monthly Remote Work Enablement Stipend Professional Development Reimbursement Wellbeing Benefits (Headspace, Cleo, etc) Unlimited paid time off, paid leave for new parents, and flexible work hours Insurance for all employees (term life, personal accident, medical) along with medical insurance for their dependents Employee stock options, flexible work hours, and time off