MOSS

MOSS is the first conversational large-scale language model in China released by the Natural Language Processing Laboratory of Fudan University.

On February 20, 2023, a reporter from Jiefang Daily and Shangguan News learned from the Natural Language Processing Laboratory of Fudan University that MOSS had been released by Professor Qiu Xipeng's team and invited the public to participate in the internal testing. On February 21st, the platform released an announcement thanking everyone for their attention, while also pointing out that MOSS is still a very immature model and there is still a long way to go before ChatGPT

MOSS is an open-source conversational language model that supports both Chinese and English languages as well as multiple plugins. The MOSS Moon series model has 16 billion parameters and can run on a single A100/A800 or two 3090 graphics cards at FP16 precision, and on a single 3090 graphics card at INT4/8 precision. The MOSS base language model was pre trained on approximately 700 billion words in Chinese, English, and code, and subsequently fine tuned through dialogue instructions, plugin reinforcement learning, and human preference training, possessing multi round dialogue ability and the ability to use multiple plugins.

Limitations: Due to the small amount of model parameters and the autoregressive generation paradigm, MOSS may still generate misleading replies containing factual errors or harmful content containing bias/discrimination. Please carefully identify and use the content generated by MOSS, and do not spread the harmful content generated by MOSS to the Internet. If any adverse consequences occur, the disseminator shall bear the responsibility.