The sector of large linguistic models continues to grow. StabilityAI, maker of the popular Stable Diffusion imaging tool, has released an open source language modeling toolkit.
baptized as “StableLM”, alpha versions of the publicly accessible package currently contain models with 3,000 and 7,000 million parameters, with models of 15,000, 30,000 and 65,000 million parameters “in development” and a model of 175,000 million planned for the future.
Announcing StableLMâ —
We’re releasing the first of our large language models, starting with 3B and 7B param models, with 15-65B to follow. Our LLMs are released under CC BY-SA license.
We’re also releasing RLHF-tuned models for research use. Read more→ https://t.co/R66Wa4gbnW pic.twitter.com/gvDDJMFBYJ
— Stability AI (@StabilityAI) April 19, 2023
Compared, GPT-4 has an estimated parameter count of one trillion, six times that of its predecessor GPT-3.
However, parameter count may not be a uniform measure of LLM effectiveness, as StabilityAI pointed out in the blog post announcing the release of StableLM:
“StableLM is trained on a new experimental dataset built on top of The Pile, but three times larger with 1.5 trillion content tokens […] The richness of this dataset provides StableLM with surprisingly high performance in conversational and programming tasks, despite its small size of 3 to 7 trillion parameters.”
At the moment it is not clear to what extent the StableLM models are robust. The StabilityAI team noted on the organization’s Github page that more information on LM’s capabilities, including model specifications and training settings, would be forthcoming soon.
As long as the models perform well enough in tests, the arrival of a powerful open source alternative to OpenAI’s ChatGPT could prove interesting to the world of cryptocurrency trading.
As we told you before, people are building advanced trading bots using the GPT API and new variants that incorporate access to third party tools such as BabyAGI and AutoGPT.
Adding open source models to the mix could be a boon for tech-savvy traders who don’t want to pay OpenAI access premiums.
Interested parties can try a real-time interface to the 7B-parameter StableLM model hosted on HuggingFace. However, at the time of publishing this article, our attempts to do so found the website overwhelmed or at capacity.
Clarification: The information and/or opinions expressed in this article do not necessarily represent the views or editorial line of Cointelegraph. The information presented here should not be taken as financial advice or investment recommendation. All investment and commercial movement involve risks and it is the responsibility of each person to do their due research before making an investment decision.
Keep reading:
Investments in crypto assets are not regulated. They may not be suitable for retail investors and the entire amount invested may be lost. The services or products offered are not directed or accessible to investors in Spain.