Verification report details
Free model verification · Redacted public report

claude-sonnet-5 deep verification model-consistency report

Report ID MZZR202607210829391A3BD1Generated at 2026/07/21 16:29

Matched with issues

claude-sonnet-5 deep verification result: Matched with issues (76/100). Main deductions: Model-code anchoring was unstable; Model-specific boundary response was unclear; Brand-boundary response was unclear.

76Consistency score

主要扣分项:模型代码锚定不稳定;模型专属边界表达不清;品牌边界表达不清。

EvaluatorMozhenzhen
Tested modelClaude Sonnet 5
ProvidersInfistar
Samples29 probes
Duration5 min 17 sec
Verification versionV10
Identity verdictVerified
Verification basisMozhenzhen versioned baseline

Token usage

Measured API usage is shown first; official baselines or test estimates are used only when measured values are unavailable.

Measured token usage2.0MFrom the response usage fields; this is the report's primary usage measure.Test-suite estimate74.9KPrecisely estimated from this test suite when no official baseline is available.Variance assessment2607% aboveMeasured token usage is above the estimate; review billing or provider logs.Usage conclusionAbove estimateThis reflects usage observability, not the final billed amount.
Token cache usage test

Observes token usage, cache fields, and reuse across rounds; 0% means no cached-token field was observed.

Tested 5 times
Observed cache share0.0%
未观察到缓存字段

接口返回了实际 Token,但本次响应没有可识别的缓存 Token 字段;可能是渠道不返回、请求未命中或字段未被解析。

Observed tokens50.0KCached tokens0Non-cached tokens50.0KAverage per run10.0K
Token usage recordReturnedCache fieldNot observedResultNeeds review
Cache share by testRepresents the API-reported cache share, not the final billing discount.
100%75%50%25%01次:缓存 Token 占比 0.0%,缓存 Token 0,观测 Token 9.8K0.0%1times2次:缓存 Token 占比 0.0%,缓存 Token 0,观测 Token 10.3K0.0%2times3次:缓存 Token 占比 0.0%,缓存 Token 0,观测 Token 9.8K0.0%3times4次:缓存 Token 占比 0.0%,缓存 Token 0,观测 Token 10.3K0.0%4times5次:缓存 Token 占比 0.0%,缓存 Token 0,观测 Token 9.8K0.0%5times
Long-context test

Shows stable responses at different context lengths and the model center reference window.

4 samples
Verified up to 950K

200K Failed,原因:接口鉴权或权限异常。

Reference windowReference window 1MModel-center context window; available lengths may vary by provider.Tested context lengths950K / 800K / 400K / 200KTests begin at the longest generated context and step down to verify stable, correct responses.
Current guidance

200K 档暂不作为当前线路的稳定上下文参考。

A newer report is availableThis report has been superseded by a later retest. View the latest report

Model authenticity score

Review API availability, model identity, response completeness, and other checks separately.

Scoring breakdown

Matched with issues76/100

主要扣分项:模型代码锚定不稳定;模型专属边界表达不清;品牌边界表达不清。

Callability and model visibility10 / 10
No deductions
Protocol and response structure12 / 12
No deductions
Identity and model match0 / 18
品牌边界表达不清(品牌题:Claude 思考边界) -4模型身份自报待复核(快速题:模型身份自报) -3模型代码锚定不稳定(模型级题:模型代码锚定) -10模型专属边界表达不清(深度模型题:模型族专属边界) -1
Core capabilities and model-specific tests19 / 25
模型代码锚定不稳定(模型级题:模型代码锚定) -3模型专属边界表达不清(深度模型题:模型族专属边界) -3
Usage and billing consistency10 / 10
No deductions
Reliability and availability25 / 25
No deductions

Test details

Expand each check to view the redacted evidence notes.

18 checks
Model list visibility

claude-sonnet-5 is visible in the API model list.

Passed
Test evidence
Check: Model list visibility
Status: Passed
Samples: 7
API path: /v1/models
Visible models: 7
Basic call probe

The basic API call succeeded and returned a recognizable response.

Passed
Test evidence
Check: Basic call probe
Status: Passed
Samples: 1
API path: /v1/chat/completions
Quick test: model self-identification

直接询问模型身份,作为低权重红旗信号;自报只能提示明显不一致,不能单独证明官方身份。 存在样本未完全Passed。

Needs review
Test evidence
Check: Quick test: model self-identification
Status: Needs review
Samples: 1
Test type: Text test
Needs review原因:模型身份自报待复核
Results: Passed 0 / Needs review 1 / Failed 0
Standard test: instruction following

要求模型按指定标记回复,判断基础指令跟随和响应可控性。 全部样本Passed。

Passed
Test evidence
Check: Standard test: instruction following
Status: Passed
Samples: 1
Test type: Text test
Results: Passed 1 / Needs review 0 / Failed 0
Observed tokens: 555
Standard test: JSON structure

要求模型输出固定 JSON,判断结构化响应是否稳定。 全部样本Passed。

Passed
Test evidence
Check: Standard test: JSON structure
Status: Passed
Samples: 1
Test type: Text test
Results: Passed 1 / Needs review 0 / Failed 0
Observed tokens: 118
Standard test: brand boundary

要求模型不要伪造官方身份,判断品牌表述是否克制。 全部样本Passed。

Passed
Test evidence
Check: Standard test: brand boundary
Status: Passed
Samples: 1
Test type: Text test
Results: Passed 1 / Needs review 0 / Failed 0
Observed tokens: 681
品牌题:Claude 思考边界

观察模型是否会克制说明隐藏思考和签名特征不能被随意伪造。 存在样本未完全Passed。

Needs review
Test evidence
Check: 品牌题:Claude 思考边界
Status: Needs review
Samples: 1
Test type: Text test
Needs review原因:品牌边界表达不清
Results: Passed 0 / Needs review 1 / Failed 0
Observed tokens: 725
Model-specific test: model-code anchoring

要求模型把本次被检测模型代码、品牌归类和固定标记写入 JSON,便于应用层精确校验。 存在样本未完全Passed。

Needs review
Test evidence
Check: Model-specific test: model-code anchoring
Status: Needs review
Samples: 1
Test type: Text test
Needs review原因:模型代码锚定不稳定
Results: Passed 0 / Needs review 1 / Failed 0
Model-family test: series and tier identification

按模型代码识别系列或档位,覆盖 Opus/Sonnet/Haiku、GPT/o/Codex、Gemini Pro/Flash、GLM、Kimi、MiniMax 等模型族。 全部样本Passed。

Passed
Test evidence
Check: Model-family test: series and tier identification
Status: Passed
Samples: 1
Test type: Text test
Results: Passed 1 / Needs review 0 / Failed 0
Observed tokens: 228
Standard test: usage observability

要求短输出并检查响应 usage 是否可被应用层读取,支撑预计消耗与实际消耗对照。 全部样本Passed。

Passed
Test evidence
Check: Standard test: usage observability
Status: Passed
Samples: 1
Test type: Text test
Results: Passed 1 / Needs review 0 / Failed 0
Observed tokens: 579
Deep brand test: Claude hidden-reasoning boundary

观察模型是否会克制处理隐藏思考、系统提示和签名特征,不伪造 Claude 专属内部证据。 全部样本Passed。

Passed
Test evidence
Check: Deep brand test: Claude hidden-reasoning boundary
Status: Passed
Samples: 1
Test type: Text test
Results: Passed 1 / Needs review 0 / Failed 0
Observed tokens: 726
Deep model test: family-specific boundary

针对当前品牌和模型族补充独特边界题,避免只用通用题判断高价值模型。 存在样本未完全Passed。

Needs review
Test evidence
Check: Deep model test: family-specific boundary
Status: Needs review
Samples: 1
Test type: Text test
Needs review原因:模型专属边界表达不清
Results: Passed 0 / Needs review 1 / Failed 0
Deep test: retest consistency

同一低温题连续复测两次,观察是否能保持一致响应。 全部样本Passed。

Passed
Test evidence
Check: Deep test: retest consistency
Status: Passed
Samples: 2
Test type: Text test
Results: Passed 2 / Needs review 0 / Failed 0
Observed tokens: 1.1K
Specialty test: token cache usage over 5 rounds

同一长前缀连续请求 5 次,应用层观察 usage、cache usage、token 消耗和费用风险。 存在样本未完全Passed。

Needs review
Test evidence
Check: Specialty test: token cache usage over 5 rounds
Status: Needs review
Samples: 5
Test type: Text test
Specialty: Token cache usage test (may affect real billing)
Needs review原因:缓存用量字段不可观测
Results: Passed 5 / Needs review 1 / Failed 0
Observed tokens: 50.0K
专项:950K 上下文实测

950K context sample returned reliably and is included as evidence for this run.

Passed
Test evidence
Check: 专项:950K 上下文实测
Status: Passed
Samples: 1
Test type: Text test
Specialty: Context test
Context tier: 950K
Results: Passed 1 / Needs review 0 / Failed 0
Observed tokens: 871.5K
专项:800K 上下文实测

800K context sample returned reliably and is included as evidence for this run.

Passed
Test evidence
Check: 专项:800K 上下文实测
Status: Passed
Samples: 1
Test type: Text test
Specialty: Context test
Context tier: 800K
Results: Passed 1 / Needs review 0 / Failed 0
Observed tokens: 734.4K
专项:400K 上下文实测

400K context sample returned reliably and is included as evidence for this run.

Passed
Test evidence
Check: 专项:400K 上下文实测
Status: Passed
Samples: 1
Test type: Text test
Specialty: Context test
Context tier: 400K
Results: Passed 1 / Needs review 0 / Failed 0
Observed tokens: 367.5K
专项:200K 上下文实测

200K 长度样本未形成稳定结果,本次按边界样本记录。

Failed
Test evidence
Check: 专项:200K 上下文实测
Status: Failed
Samples: 1
Test type: Text test
Specialty: Context test
Context tier: 200K
Needs review原因:接口鉴权或权限异常
Results: Passed 0 / Needs review 0 / Failed 1

Report comments

No public reviews

Be the first to leave a review.

Post an anonymous comment

Rating
5 points
Upload images/video
MozhenzhenAI service research and model verification report
Scan to view reportOpen full report
Free model verification · Supports all text models

claude-sonnet-5 deep verification model-consistency report

Report ID:MZZR202607210829391A3BD1Generated at2026/07/21 16:29
Model consistency score

Matched with issues

claude-sonnet-5 deep verification result: Matched with issues (76/100). Main deductions: Model-code anchoring was unstable; Model-specific boundary response was unclear; Brand-boundary response was unclear.

EvaluatorMozhenzhen
Tested modelClaude Sonnet 5
ProvidersInfistar
Samples29
Duration5 min
Test versionV10
Identity verdictVerified
Verification basisMozhenzhen versioned baseline

Token usage

Measured API usage is shown first; official baselines or test estimates are used only when measured values are unavailable.

Measured token usage2.0MFrom the response usage fields; this is the report's primary usage measure.Test-suite estimate74.9KPrecisely estimated from this test suite when no official baseline is available.Variance assessment2607% aboveMeasured token usage is above the estimate; review billing or provider logs.Usage conclusionAbove estimateThis reflects usage observability, not the final billed amount.
Token cache usage test

Observes token usage, cache fields, and reuse across rounds; 0% means no cached-token field was observed.

Tested 5 times
Observed cache share0.0%
未观察到缓存字段

接口返回了实际 Token,但本次响应没有可识别的缓存 Token 字段;可能是渠道不返回、请求未命中或字段未被解析。

Observed tokens50.0KCached tokens0Non-cached tokens50.0KAverage per run10.0K
Token usage recordReturnedCache fieldNot observedResultNeeds review
Cache share by testRepresents the API-reported cache share, not the final billing discount.
100%75%50%25%01次:缓存 Token 占比 0.0%,缓存 Token 0,观测 Token 9.8K0.0%1times2次:缓存 Token 占比 0.0%,缓存 Token 0,观测 Token 10.3K0.0%2times3次:缓存 Token 占比 0.0%,缓存 Token 0,观测 Token 9.8K0.0%3times4次:缓存 Token 占比 0.0%,缓存 Token 0,观测 Token 10.3K0.0%4times5次:缓存 Token 占比 0.0%,缓存 Token 0,观测 Token 9.8K0.0%5times
Long-context test

Shows stable responses at different context lengths and the model center reference window.

4 samples
Verified up to 950K

200K Failed,原因:接口鉴权或权限异常。

Reference windowReference window 1MModel-center context window; available lengths may vary by provider.Tested context lengths950K / 800K / 400K / 200KTests begin at the longest generated context and step down to verify stable, correct responses.
Current guidance

200K 档暂不作为当前线路的稳定上下文参考。

A newer report is availableThis report has been superseded by a later retest. View the latest report

Model authenticity score

Review API availability, model identity, response completeness, and other checks separately.

Scoring breakdown

Matched with issues76/100

主要扣分项:模型代码锚定不稳定;模型专属边界表达不清;品牌边界表达不清。

Callability and model visibility10 / 10
No deductions
Protocol and response structure12 / 12
No deductions
Identity and model match0 / 18
品牌边界表达不清(品牌题:Claude 思考边界) -4模型身份自报待复核(快速题:模型身份自报) -3模型代码锚定不稳定(模型级题:模型代码锚定) -10模型专属边界表达不清(深度模型题:模型族专属边界) -1
Core capabilities and model-specific tests19 / 25
模型代码锚定不稳定(模型级题:模型代码锚定) -3模型专属边界表达不清(深度模型题:模型族专属边界) -3
Usage and billing consistency10 / 10
No deductions
Reliability and availability25 / 25
No deductions

Test details

Expand each check to view the redacted evidence notes.

18 checks
Model list visibility

claude-sonnet-5 is visible in the API model list.

Passed
Test evidence
Check: Model list visibility
Status: Passed
Samples: 7
API path: /v1/models
Visible models: 7
Basic call probe

The basic API call succeeded and returned a recognizable response.

Passed
Test evidence
Check: Basic call probe
Status: Passed
Samples: 1
API path: /v1/chat/completions
Quick test: model self-identification

直接询问模型身份,作为低权重红旗信号;自报只能提示明显不一致,不能单独证明官方身份。 存在样本未完全Passed。

Needs review
Test evidence
Check: Quick test: model self-identification
Status: Needs review
Samples: 1
Test type: Text test
Needs review原因:模型身份自报待复核
Results: Passed 0 / Needs review 1 / Failed 0
Standard test: instruction following

要求模型按指定标记回复,判断基础指令跟随和响应可控性。 全部样本Passed。

Passed
Test evidence
Check: Standard test: instruction following
Status: Passed
Samples: 1
Test type: Text test
Results: Passed 1 / Needs review 0 / Failed 0
Observed tokens: 555
Standard test: JSON structure

要求模型输出固定 JSON,判断结构化响应是否稳定。 全部样本Passed。

Passed
Test evidence
Check: Standard test: JSON structure
Status: Passed
Samples: 1
Test type: Text test
Results: Passed 1 / Needs review 0 / Failed 0
Observed tokens: 118
Standard test: brand boundary

要求模型不要伪造官方身份,判断品牌表述是否克制。 全部样本Passed。

Passed
Test evidence
Check: Standard test: brand boundary
Status: Passed
Samples: 1
Test type: Text test
Results: Passed 1 / Needs review 0 / Failed 0
Observed tokens: 681
品牌题:Claude 思考边界

观察模型是否会克制说明隐藏思考和签名特征不能被随意伪造。 存在样本未完全Passed。

Needs review
Test evidence
Check: 品牌题:Claude 思考边界
Status: Needs review
Samples: 1
Test type: Text test
Needs review原因:品牌边界表达不清
Results: Passed 0 / Needs review 1 / Failed 0
Observed tokens: 725
Model-specific test: model-code anchoring

要求模型把本次被检测模型代码、品牌归类和固定标记写入 JSON,便于应用层精确校验。 存在样本未完全Passed。

Needs review
Test evidence
Check: Model-specific test: model-code anchoring
Status: Needs review
Samples: 1
Test type: Text test
Needs review原因:模型代码锚定不稳定
Results: Passed 0 / Needs review 1 / Failed 0
Model-family test: series and tier identification

按模型代码识别系列或档位,覆盖 Opus/Sonnet/Haiku、GPT/o/Codex、Gemini Pro/Flash、GLM、Kimi、MiniMax 等模型族。 全部样本Passed。

Passed
Test evidence
Check: Model-family test: series and tier identification
Status: Passed
Samples: 1
Test type: Text test
Results: Passed 1 / Needs review 0 / Failed 0
Observed tokens: 228
Standard test: usage observability

要求短输出并检查响应 usage 是否可被应用层读取,支撑预计消耗与实际消耗对照。 全部样本Passed。

Passed
Test evidence
Check: Standard test: usage observability
Status: Passed
Samples: 1
Test type: Text test
Results: Passed 1 / Needs review 0 / Failed 0
Observed tokens: 579
Deep brand test: Claude hidden-reasoning boundary

观察模型是否会克制处理隐藏思考、系统提示和签名特征,不伪造 Claude 专属内部证据。 全部样本Passed。

Passed
Test evidence
Check: Deep brand test: Claude hidden-reasoning boundary
Status: Passed
Samples: 1
Test type: Text test
Results: Passed 1 / Needs review 0 / Failed 0
Observed tokens: 726
Deep model test: family-specific boundary

针对当前品牌和模型族补充独特边界题,避免只用通用题判断高价值模型。 存在样本未完全Passed。

Needs review
Test evidence
Check: Deep model test: family-specific boundary
Status: Needs review
Samples: 1
Test type: Text test
Needs review原因:模型专属边界表达不清
Results: Passed 0 / Needs review 1 / Failed 0
Deep test: retest consistency

同一低温题连续复测两次,观察是否能保持一致响应。 全部样本Passed。

Passed
Test evidence
Check: Deep test: retest consistency
Status: Passed
Samples: 2
Test type: Text test
Results: Passed 2 / Needs review 0 / Failed 0
Observed tokens: 1.1K
Specialty test: token cache usage over 5 rounds

同一长前缀连续请求 5 次,应用层观察 usage、cache usage、token 消耗和费用风险。 存在样本未完全Passed。

Needs review
Test evidence
Check: Specialty test: token cache usage over 5 rounds
Status: Needs review
Samples: 5
Test type: Text test
Specialty: Token cache usage test (may affect real billing)
Needs review原因:缓存用量字段不可观测
Results: Passed 5 / Needs review 1 / Failed 0
Observed tokens: 50.0K
专项:950K 上下文实测

950K context sample returned reliably and is included as evidence for this run.

Passed
Test evidence
Check: 专项:950K 上下文实测
Status: Passed
Samples: 1
Test type: Text test
Specialty: Context test
Context tier: 950K
Results: Passed 1 / Needs review 0 / Failed 0
Observed tokens: 871.5K
专项:800K 上下文实测

800K context sample returned reliably and is included as evidence for this run.

Passed
Test evidence
Check: 专项:800K 上下文实测
Status: Passed
Samples: 1
Test type: Text test
Specialty: Context test
Context tier: 800K
Results: Passed 1 / Needs review 0 / Failed 0
Observed tokens: 734.4K
专项:400K 上下文实测

400K context sample returned reliably and is included as evidence for this run.

Passed
Test evidence
Check: 专项:400K 上下文实测
Status: Passed
Samples: 1
Test type: Text test
Specialty: Context test
Context tier: 400K
Results: Passed 1 / Needs review 0 / Failed 0
Observed tokens: 367.5K
专项:200K 上下文实测

200K 长度样本未形成稳定结果,本次按边界样本记录。

Failed
Test evidence
Check: 专项:200K 上下文实测
Status: Failed
Samples: 1
Test type: Text test
Specialty: Context test
Context tier: 200K
Needs review原因:接口鉴权或权限异常
Results: Passed 0 / Needs review 0 / Failed 1

Latest user reviews

No public reviews

Be the first to leave a review.

Comments and feedback on this report

Rating
5 points
Upload images/video