Skip to content
Punjab Education Desk

Reflection releases Beam: a 501B parameter open-weight model for agentic coding

Reflection has released Beam, a 501B parameter open-weight mixture-of-experts model designed for agentic coding and long-context reasoning [2].

By Ali RazaOfficial admin

1 min read

Share

What happened

Reflection, a new US-based laboratory, has released Beam, an open-weight mixture-of-experts (MoE) model designed for agentic coding and long-context reasoning [2]. The model features 501 billion total parameters, with 23 billion parameters active per token [2]. It supports a context window of 1 million tokens and accepts text as input [2].

Beam is released under the Apache 2.0 license and is available on Hugging Face [2]. To optimize performance, the model includes a dedicated open-source Rust-based harness [2]. It also features day-0 support for several libraries, including transformers, SGLang, and vLLM [2]. For users running the model on Blackwell hardware, the NVFP4 checkpoint can fit on four B300s [2].

Developers can customize the model using several methods provided by the Reflection team and RadixArk [2]. These include:

  • Supervised fine-tuning (SFT) using TRL’s SFTTrainer, which can involve training LoRA adapters with PEFT to manage memory [2].
  • Reinforcement learning (RL) using recipes built with Miles, which allows for full-parameter RL or training LoRA adapters [2].
  • A specific recipe developed by Reflection and RadixArk that uses GRPO in Miles with BF16 [2].

In benchmark testing, the model achieved the following scores:

  • SWE Bench Pro v2-Hard: 76.5% (BF16), 78.4% (FP8), and 78.6% (NVFP4) [2].
  • SWE Bench Pro v1: 66.1% (BF16), 65.9% (FP8), and 65.6% (NVFP4) [2].
  • Terminal Bench v2.1: 80.1% (BF16), 78.9% (FP8), and 78.2% (NVFP4) [2].
  • SWEBench Verified: 81.6% (BF16), 80.2% (FP8), and 80.7% (NVFP4) [2].
  • DeepSWE v1.1: 43.3% (BF16), 43.0% (FP8), and 42.7% (NVFP4) [2].
  • SWE Atlas Codebase QnA: 31.8% (BF16), 32.2% (FP8), and 31.4% (NVFP4) [2].
  • SWEBench Multilingual: 78.3% (BF16), 78.1% (FP8), and 77.5% (NVFP4) [2].

Who is affected

This model is intended for teams that require a frontier-scale model on their own infrastructure, cloud, or hardware [2]. It is specifically built for agentic coding use cases and long-context reasoning [2].

Sources

  1. 1. Introducing Reflection Beam: an open-weight model for agentic coding on AWS — AWS Machine Learning Blog
  2. 2. Welcome Beam: a 501B open model you can own, customize, and scale — Hugging Face

Drafted with AI assistance from the reports above and checked automatically for sourcing. Always confirm dates, fees and requirements on the official website before acting.

Was this helpful?

Comments

No comments yet. Share a question or what you know.

Leave a comment

Be respectful. Comments with links are reviewed before they appear. Your email is used only to contact you about your comment.

AI Models 3 min read 6 views

Meta Releases Muse Wonder AI Models

Meta releases two new AI models, Muse Wonder and Muse Wonder Full, which can compete with the industry's best models. The models are available for Muse Code subscribers and can be accessed through the Meta Model API.