Meta open-sources a large language model with 30 billion parameters, Muse Glimmer.

Meta has released the Muse Glimmer, a 30 billion parameter model. Designed for local, resident operation, the model utilizes 4-bit quantization and DFlash speculative decoding technology to run smoothly on devices with 24GB of video memory, such as Macs and consumer-grade GPUs. It supports offline operation, multimodal perception, tool calls, and code writing.