Skip to main content

Model profile

ZAYA1-74B-Preview

ZyphraCurrentReleased May 7, 2026
Data verified
Overall Score
Unranked
Arena Elo
Not listed
Eligible category ranks
1of 8
Price (1M tokens)
$0 in / $0 out
API pricing
Speed
Not listed
Context
256K

Evidence coverage

7 of 323 tracked benchmarks are published. 7 are verified and 0 provisional. 4 of 8 categories are measured.

Updated July 23, 2026Methodology
Published / tracked
7 / 323
Verified
7
Provisional
0
Categories with evidence
4 / 8

Evidence by category

  • Agentic1 benchmark
    Verified
  • Coding2 benchmarks
    Verified
  • Reasoning0 benchmarks
    Not measured
  • Knowledge3 benchmarks
    Verified
  • Math1 benchmark
    Verified
  • Multilingual0 benchmarks
    Not measured
  • Multimodal0 benchmarks
    Not measured
  • Inst. Following0 benchmarks
    Not measured
Open WeightSelf-hostReasoning
Confidence:
Low
74b-preview

BenchLM is tracking ZAYA1-74B-Preview, but this profile is currently excluded from the public leaderboard because it still lacks enough non-generated benchmark coverage to rank safely. Only non-generated public benchmark rows appear below.

ZAYA1-74B-Preview is a open weight model with a 256K token context window. It uses explicit chain-of-thought reasoning, which typically improves performance on math and complex reasoning tasks at the cost of higher latency and token usage.

ZAYA1-74B-Preview sits inside the ZAYA1 family alongside ZAYA1-8B. This profile currently has 7 of 323 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.

Its strongest category is Coding (#67). This performance profile makes it particularly well-suited for software development and code generation tasks.

Peer position

Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.

Range 77.4483.93

  1. Claude Mythos 5
    Anthropic
    #183.93
    Claude Mythos 5 is #1 with a score of 83.93.
    Compare
  2. Claude Fable 5
    Anthropic
    #283.68
    Claude Fable 5 is #2 with a score of 83.68.
    Compare
  3. GPT-5.6 Sol
    OpenAI
    #381.96
    GPT-5.6 Sol is #3 with a score of 81.96.
    Compare
  4. Kimi K3
    Moonshot AI
    #480.96
    Kimi K3 is #4 with a score of 80.96.
    Compare
  5. Claude Opus 4.8
    Anthropic
    #578.34
    Claude Opus 4.8 is #5 with a score of 78.34.
    Compare
  6. Muse Spark 1.1
    Meta
    #677.44
    Muse Spark 1.1 is #6 with a score of 77.44.
    Compare
  7. ZAYA1-74B-PreviewCurrent model
    Zyphra
    UnrankedNot measured
    ZAYA1-74B-Preview is Unranked with a score of Not measured.

Category percentile

More

Relative position among models eligible for each sourced category. A higher percentile means a stronger position within that category's ranked cohort; 100 is highest.

  1. Coding45%
    Eligible cohort rank #67 of 122Category score 49.5

Category evidence

Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.

Category scores, ranks, weighting, benchmark coverage, and evidence status
CategoryScore
AgenticWeight 22%1 benchmarkVerifiedScore pending
CodingRank #67 of 122Percentile 45thWeight 20%2 benchmarksVerified49.5
ReasoningWeight 17%0 benchmarksNot measuredNot measured
KnowledgeRank Not rankedWeight 12%3 benchmarksVerified58.0
MathRank Not rankedWeight 5%1 benchmarkVerified56.5
MultilingualWeight 7%0 benchmarksNot measuredNot measured
MultimodalWeight 12%0 benchmarksNot measuredNot measured
Inst. FollowingWeight 5%0 benchmarksNot measuredNot measured

Benchmark Details

Rows below have a displayable published verification record. Each source link and provenance note remains in the page HTML while its category is closed. Source-unverified manual rows and generated rows stay hidden.

Agentic1 benchmark
τ²-bench AirlineProvider exact

τ²-Bench Airline Domain

56.1%Display only
Source: Zyphra ZAYA1-74B-Preview launch postProvenance: Zyphra reports ZAYA1-74B-Preview avg@1 at 56.1 on Tau2 Airline.
Coding2 benchmarks
SWE-bench VerifiedProvider exact

Software Engineering Benchmark Verified

53.2%Weighted 16%
Source: Zyphra ZAYA1-74B-Preview launch postProvenance: Zyphra reports ZAYA1-74B-Preview avg@1 at 53.2 on SWE-bench Verified.
LiveCodeBench v6Provider exact
65.7%Display only
Source: Zyphra ZAYA1-74B-Preview launch postProvenance: Zyphra reports ZAYA1-74B-Preview avg@1 at 65.7 on LiveCodeBench-v6. BenchLM stores it on the display-only v6 key because provider v6 slices should not overwrite the weighted LiveCodeBench row.
Knowledge3 benchmarks
MMLU-ProProvider exact

Massive Multitask Language Understanding Professional

68.1%Weighted 30%
Source: Zyphra ZAYA1-74B-Preview launch postProvenance: Zyphra reports ZAYA1-74B-Preview avg@1 at 68.1 on MMLU-Pro in the launch chart.
GPQAProvider exact

Graduate-Level Google-Proof Q&A

57.3%Weighted 7%
Source: Zyphra ZAYA1-74B-Preview launch postProvenance: Zyphra reports ZAYA1-74B-Preview avg@1 at 57.3 on GPQA-Diamond. BenchLM stores that exact value on the weighted GPQA lane and the display GPQA-Diamond lane.
GPQA-DProvider exact

GPQA Diamond

57.3%Display only
Source: Zyphra ZAYA1-74B-Preview launch postProvenance: Zyphra reports ZAYA1-74B-Preview avg@1 at 57.3 on GPQA-Diamond.
Math1 benchmark
AIME26Provider exact

AIME 2026

76.4%Weighted 25%
Source: Zyphra ZAYA1-74B-Preview launch postProvenance: Zyphra reports ZAYA1-74B-Preview avg@1 at 76.4 on AIME 2026.

ZAYA1 Family

74b-preview · preview

Frequently Asked Questions

How does ZAYA1-74B-Preview perform overall in AI benchmarks?

ZAYA1-74B-Preview has 7 published benchmark scores on BenchLM, but it does not yet have enough non-generated coverage to receive a global overall rank.

Is ZAYA1-74B-Preview good for knowledge and understanding?

ZAYA1-74B-Preview has visible benchmark coverage in knowledge and understanding, but BenchLM does not currently assign it a global category rank there.

Is ZAYA1-74B-Preview good for coding and programming?

ZAYA1-74B-Preview ranks #67 out of 122 models in coding and programming benchmarks with an average score of 49.5. There are stronger options in this category.

Is ZAYA1-74B-Preview good for mathematics?

ZAYA1-74B-Preview has visible benchmark coverage in mathematics, but BenchLM does not currently assign it a global category rank there.

Is ZAYA1-74B-Preview good for agentic tool use and computer tasks?

ZAYA1-74B-Preview has visible benchmark coverage in agentic tool use and computer tasks, but BenchLM does not currently assign it a global category rank there.

Is ZAYA1-74B-Preview open source?

Yes, ZAYA1-74B-Preview is an open weight model created by Zyphra, meaning it can be downloaded and run locally or fine-tuned for specific use cases.

Which sibling models are related to ZAYA1-74B-Preview?

ZAYA1-74B-Preview belongs to the ZAYA1 family. Related variants on BenchLM include ZAYA1-8B.

Does ZAYA1-74B-Preview have full benchmark coverage on BenchLM?

Not yet. ZAYA1-74B-Preview currently has 7 published benchmark scores out of the 323 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.

What is the context window size of ZAYA1-74B-Preview?

ZAYA1-74B-Preview has a published context window of 256K, which determines how much text it can process in a single interaction.

Last updated: July 23, 2026 · Runtime metrics stay blank until BenchLM has a sourced snapshot.

Choose with this week’s evidence

Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.

Free. One email per week.