Lightblue Co., Ltd.
Lightblue releases commercially available Japanese LLM “Karasu” and “Qarasu” Achieved the highest performance among existing Japanese published models, making it possible to use LLM in an on-premises environment ……
Lightblue Co., Ltd. (Representative Director: Atomu Sonoda,
Headquarters: Chiyoda-ku, Tokyo, hereinafter referred to as
“Lightblue”), which operates the generative AI research and
development “LLab” and develops and provides Japanese LLM, is available for commercial use. We are pleased to announce that the Japanese LLM “Karasu” and “Qarasu” have been released.
■ About the Karasu/Qarasu series
The Karasu series performs continuous pre-learning and fine-tuning for Shisa (https://huggingface.co/augmxnt/shisa-7b-v1
In addition, the Qarasu series is a fine-tuned model of the 14 billion parameter Qwen-14B (https://huggingface.co/Qwen/Qwen-14B) using the know-how cultivated with the Karasu series.
As a 7 billion parameter model, the Karasu series is extremely lightweight and has performance comparable to some 13B models. The Qarasu series is a 14 billion parameter model that achieves the highest performance among the existing Japanese published models and shows performance approaching GPT-3.5.
Day
The average score for six tasks on MT-Bench, which is one of the benchmarks for evaluating the performance of native language models, is 6.70 for Karasu and 7.60 for Qarasu (Table 1).
The model name comes from Yatagarasu, a crow that appears in Japanese mythology and the god of guidance.
Details of the various models released are listed in the note article. ・“Note article by data scientist (English version)”
https://note.com/peter_lightblue/n/ne08a7c8cc47a
・”Note article translated into Japanese”
https://note.com/peter_lightblue/n/n2def04ca0d30
List of released “Karasu/Qarasu” series models
https://huggingface.co/collections/lightblue/karasu-658e78e9188f3934c6fb701e A chat-style demo of Qarasu is also available.
https://lightblue-qarasu.serveo.net
*Due to excessive access, there may be a waiting time until your request is processed.
■ Performance of Karasu/Qarasu series
Figure 1: Evaluation results using the Japanese language model benchmark MT-Bench
[Image 1
https://github.com/QwenLM/Qwen/blob/main/Tongyi Qianwen LICENSE AGREEMENT). ■ About LLab
Lightblue’s generative AI specialized development team “LLab” supports truly practical LLM implementation in the field aiming to utilize generative AI. “LLab” not only provides on-premises unique models tailored to individual companies, but also makes full use of the know-how cultivated through DX consulting and contract development, and provides customization based on an understanding of the business operations of each company, department, and site. will be carried out. [Sites where original development is effective]
1. Highly specialized sites:
There are many specialized terms for each industry and company, such as construction and pharmaceuticals.
2. Sites with a high level of information security:
High-level data breach countermeasures are required in fields such as finance and medicine.
3. Sites where it is difficult to access the Internet:
It is difficult to establish a communication environment such as in factories and construction sites.
If you are interested in using LLab and this model to promote the use of AI within your company, please contact us using the link below. http://lightblue-tech.hubspotpagebuilder.com/lightblue-llab
About Lightblue Co., Ltd.
Lightblue is a startup company from the University of Tokyo that aims to democratize AI and develops solutions centered on image analysis and natural language processing AI. We have established a team called “LLab” specializing in the research and development of generative AI and LLM, and are working on developing AI models with an emphasis on safety and transparency. We aim to expand the scope of use of AI technology and bring about positive change in society.
Company name: Lightblue Co., Ltd. Established: January 2018
Representative: Representative Director Atomu Sonoda Location: 3-28-5 Kanda Ogawa-cho, Chiyoda-ku, Tokyo Axle Ochanomizu PB02AI Advisor: Fujio Toriumi (Professor, Graduate School of Engineering, University of Tokyo)
Business details: Developing solutions centered on image analysis and natural language processing AI.
・Human Sensing, an image analysis system that focuses on people ・ChatGPT “Lightblue Assistant” for businesses that can be used in Slack and Teams
●Lightblue corporate site https://www.lightblue-tech.com/
Lightblue’s generative AI specialized development team “LLab” supports truly practical LLM implementation in the field aiming to utilize generative AI. “LLab” not only provides on-premises unique models tailored to individual companies, but also makes full use of the know-how cultivated through DX consulting and contract development, and provides customization based on an understanding of the business operations of each company, department, and site. will be carried out. [Sites where original development is effective]
1. Highly specialized sites:
There are many specialized terms for each industry and company, such as construction and pharmaceuticals.
2. Sites with a high level of information security:
High-level data breach countermeasures are required in fields such as finance and medicine.
3. Sites where it is difficult to access the Internet:
It is difficult to establish a communication environment such as in factories and construction sites.
If you are interested in using LLab and this model to promote the use of AI within your company, please contact us using the link below. http://lightblue-tech.hubspotpagebuilder.com/lightblue-llab
About Lightblue Co., Ltd.
Lightblue is a startup company from the University of Tokyo that aims to democratize AI and develops solutions centered on image analysis and natural language processing AI. We have established a team called “LLab” specializing in the research and development of generative AI and LLM, and are working on developing AI models with an emphasis on safety and transparency. We aim to expand the scope of use of AI technology and bring about positive change in society.
Company name: Lightblue Co., Ltd. Established: January 2018
Representative: Representative Director Atomu Sonoda Location: 3-28-5 Kanda Ogawa-cho, Chiyoda-ku, Tokyo Axle Ochanomizu PB02AI Advisor: Fujio Toriumi (Professor, Graduate School of Engineering, University of Tokyo)
Business details: Developing solutions centered on image analysis and natural language processing AI.
・Human Sensing, an image analysis system that focuses on people ・ChatGPT “Lightblue Assistant” for businesses that can be used in Slack and Teams
●Lightblue corporate site https://www.lightblue-tech.com/