Public release of evaluation model verifying the performance and capabilities of LLM
‘LLM evaluation model’ paper published in the world’s top authority, EMNLP,
Photo=Provided by NCSOFT,
, “NCsoft announced on the 23rd that it has released ‘VARCO Judge LLM,’ an evaluation model that verifies the performance and capabilities of Large Language Models (LLMs) for the first time in Korea.”,
,
, “‘VARCO Judge LLM’ is an evaluation model that checks how fast and accurately other LLMs perform tasks.”,
,
, “Recently, companies have been spending a lot of time searching for suitable LLM models among various types and sizes of LLMs in the market. By using VARCO Judge LLM, they can effectively verify LLM models that are suitable for their AI services.”,
,
, “According to NCsoft, VARCO Judge LLM boasts excellent bias resolution capabilities and outstanding performance in Korean, surpassing other models of its class. Especially, the company published a paper on the LLM evaluation model in this year’s world-renowned NLP conference, ‘EMNLP (Empirical Methods in Natural Language Processing).'”,
, “By utilizing NCsoft’s evaluation model, companies developing AI-based services can quickly compare and evaluate the quality of various LLMs to adopt a model optimized for their services.”,
,
, “AI model research and development companies can verify the performance level of their LLM through an evaluation model to prove superiority over other models or quickly identify and enhance weaknesses. Model Hub operators can provide models more effectively by accelerating the process of selecting, optimizing, and deploying LLM.”,
,
, “NCsoft, which developed its own language model as the first game company in Korea, actively utilizes AI technology in game development processes and internal business efficiency improvement.”,
,
, “NC Research Director Lee Yeon-soo said, ‘In the rapidly evolving AI market, services that select and apply the optimal model for each industry are becoming even more important’ and ‘VARCO Judge LLM will establish itself as an indispensable tool in the AI business, going beyond improving the quality of existing LLM-based services.'”,
,
,