Building LLM Ops and GPU Farms to Enhance Generative AI Environment “Securing AX Reference…Expanding Global Sales,”
, ‘KT has exported an artificial intelligence (AI) platform, including a large language model (LLM) for Thai, to Thailand. On the 15th, KT announced that it had completed a one-stop project in which it established an ‘LLM Ops’ environment for the operation and management of LLM and an AI service infrastructure ‘GPU Farm’ for Jasmine Technology Solution (JTS), a specialized IT company of Thailand’s Jasmine Group, and also developed a Thai-language dedicated LLM model. KT and JTS had previously signed a contract for the Thai LLM platform development project in March last year. LLM Ops is an environment that manages the entire process of learning, distributing, and operating various LLM models. KT explains that it has built this customized for the client, enabling JTS to operate a complex generative AI operation environment more efficiently and stably. KT, together with its cloud subsidiary KT Cloud, has also established a GPU Farm in Thailand for GPU resource management. Based on this, JTS plans to expand the AI ecosystem in Thailand by supplying GPU subscription services (GPU as a Service, GPUaaS) to Thai companies and institutions. The Thai LLM was jointly developed by KT and Upstage, a domestic specialized LLM company, based on KT’s own model development experience and know-how. This model supports Thai, English, Korean, etc., and can accurately respond to questions related to Thai politics, history, and culture by learning from Thailand’s vast unique data. KT plans to continuously collaborate with JTS in various fields such as AI platform advancement, expansion, maintenance of GPU infrastructure, and discovering new AI-based services as its specialized technology partner. Furthermore, both companies plan to sequentially introduce AI services targeting the Thai AX market and expand the AX business area to other global markets such as the Middle East and Europe, as well as the Southeast Asian market. Lee Jin-hyung, KT’s Senior Vice President of AI Business Strategy for the Strategy and Business Consulting Division, said, “The development and commercialization of the Thai-specific LLM platform is a success that once again proves KT’s AI technological prowess and global business capability,” and added, “Including the experience and know-how gained from this project, KT will diversify its service product lineup in AI and cloud services based on strategic alliances with Microsoft and Palantir.”
KT employees are testing the ‘LLM Ops’ environment developed during the Thai LLM platform construction project./Photo provided by KT,