Introducing Windows AI Studio Expansion for VS Code: Unleashing Language Models on Your PC

Microsoft has introduced Windows AI Studio, which is an extension of VS Code that facilitates the convenient execution of models on a PC. While we may be familiar with the term Large Language Model (LLM) in this era, Microsoft states that there are still Small Language Models (SLM) that are compact enough to run on a PC. Some examples that have been simultaneously released include Microsoft’s own Phi models, which are divided into Phi-1.5 (13B) and Phi-2 (2.7B), as well as popular models from other companies such as Llama 2-7B, Mistral-7B, Falcon-7B, and Stable Diffusion XL.

Windows AI Studio serves as an extension of VS Code that conveniently facilitates the execution of customized models on a PC, supporting the use of a PC’s GPU/NPU. The role of this extension is to fetch models from Azure AI Studio and other popular sources like Hugging Face, along with various model customization tools.

Currently, Windows AI Studio is not available for testing, but it is expected to be released in the coming weeks.

TLDR: Microsoft has unveiled Windows AI Studio, an extension of VS Code that simplifies the execution of models on a PC. It supports both LLM and SLM models and provides tools for model customization. Windows AI Studio is set to be released in the near future.