SCB10X collaborates with Together.ai, a leading LLM service provider, to introduce the Typhoon model in two versions: Typhoon 1.5 8B Instruct and Typhoon 1.5X 70B-awq (Activation-Aware Weight Quantization – a model compression technique that considers the importance of each parameter).
Both models are now available on the Togeter.ai Playground, but the pricing has not been officially announced. SCB10X mentions that inquiries should be directed to Together.ai, but confirms that usage fees will be charged in tokens.
The availability of LLM through token-based cloud services is crucial for testing the model’s capabilities or deploying it as an option without incurring hosting costs, which can be expensive and may not be worthwhile if usage is not frequent enough.
The Typhoon 1.5X 70B model is derived from the Llama 3 70B model, which is available for download on HuggingFace and utilizes the Llama 3 Community License.
Source: SCB10X
TLDR: SCB10X partners with Together.ai to offer Typhoon models for token-based cloud services, including the Typhoon 1.5X 70B derived from the Llama 3 70B model.
Leave a Comment