Promptfoo

真实多模型对比

  • Exported 2026-07-28T18:52:16.856Z
  • Evaluated 2026-07-28T18:50:02.336Z
  • Author demo@example.com

Total Results

9

Pass Rate

33.3%

Passed

3

Failed

3

Errors

3

Prompts

3

Evaluation results

3 of 3 rows shown
Promptfoo evaluation results table
input [GLM-4.7-Flash] Translate the following Chinese sentence into English: {{input}} [Agnes-2.0-Flash] Translate the following Chinese sentence into English: {{input}} [qwen3:latest(本地)] Translate the following Chinese sentence into English: {{input}}
今天天气真好,我们去公园散步吧。
FAIL Score 0.00
Thinking: 1. **Analyze the Source Sentence:** * Source: "今天天气真好,我们去公园散步吧。" * Segments: * 今天 : Today * 天气 : Weather * 真好 : Really good / very nice / beautiful * , (comma): Separator * 我们 : We * 去 : Go * 公园 : Park * 散步 : Take a walk / go for a walk * 吧 (ba): Suggestion particle (let's / shall we) 2. **Determine the Tone and Context:** * Tone: Casual, friendly, suggesting an activity. * Context: A conversation between friends or family members. 3. **Drafting Translations (Iterative Process):** * *Literal Translation:* Today weather really good, we go park take a walk ba. (Too broken). * *Attempt 1 (Direct):* The weather is really good today, let's go to the park for a walk. (Grammatically correct, standard). * *Attempt 2 (Slightly more natural flow):* It's such nice weather today. Let's go for a walk in the park. (Good, "such nice weather" captures "真好"). * *Attempt 3 (Short & Sweet):* The weather is great today. Let's go for a walk in the park. (Very common). * *Attempt 4 (Focus on "散步"):* Let's go for a stroll in the park since the weather is so nice today. (A bit wordy). 4. **Refining Options based on Nuance:** * *Option A (Standard/Neutral):* "The weather is really nice today. Let's go for a walk in the park." * *Option B (More casual):* "It's such beautiful weather today. Let's go for a walk in the park." * *Option C (Concise):* "Great weather today. Let's go for a walk in the park." 5. **Selecting the Best Translations:** * *Most accurate/versatile:* "The weather is really nice today. Let's go for a walk in the park." * *Alternative (using "stroll"):* "The weather is lovely today. Let's go for a stroll in the park." 6. **Final Polish:** * "The weather is really nice today. Let's go for a walk in the park." -> This covers all bases perfectly. 7. **Formatting the Output:** * Provide the most natural translation first. * Provide a few variations (casual, literal) to give the user choices. * *Drafting the final response:* * "The weather is really nice today. Let's go for a walk in the park." * "It's such beautiful weather today. Let's go for a stroll in the park." 8. **Final Review against Source:** * 今天天气真好 -> The weather is really nice today. * 我们去公园散步吧 -> Let's go for a walk in the park. Matches perfectly. *Self-Correction during drafting:* "Walk" vs "Stroll". "散步" is usually "take a walk" or "go for a walk". "Stroll" is a bit more leisurely, but "walk" is the standard translation. I will stick with "walk" as the primary choice. *Structure:* Present the most natural English sentence. *Result:* "The weather is really nice today. Let's go for a walk in the park." Here are a few ways to translate this sentence into English, depending on the tone you want: **Most Natural/Common:** > "The weather is really nice today. Let's go for a walk in the park." **Slightly more casual:** > "It's such beautiful weather today. Let's go for a stroll in the park." **Short & Simple:** > "Great weather today. Let's go for a walk in the park."

Custom function returned false /[a-zA-Z]/.test(output) && !/[一-龥]/.test(output) && output.trim().length > 3

ERROR Score 0.00
API call error: Error: Request failed after 4 retries: TypeError: fetch failed (Cause: Error: Request was cancelled.)
PASS Score 1.00
The weather is really nice today; let's go for a walk in the park.

All assertions passed

我喜欢吃苹果和香蕉。
FAIL Score 0.00
Thinking: 1. **Analyze the source sentence:** "我喜欢吃苹果和香蕉。" * 我 : I * 喜欢 : like * 吃 : eat * 苹果 : apples * 和 : and * 香蕉 : bananas 2. **Determine the grammatical structure:** * Subject: 我 * Verb phrase: 喜欢 + 吃 * Object: 苹果和香蕉 3. **Draft initial translations:** * Literal: I like eat apples and bananas. * Corrected grammar: I like eating apples and bananas. / I like to eat apples and bananas. 4. **Refine based on natural English usage:** * "I like eating apples and bananas." (Very common, implies a habit or general preference). * "I like to eat apples and bananas." (Also common, slightly more specific about the action, but often interchangeable). * "I enjoy eating apples and bananas." (A bit more formal, but "like" is the direct translation of "喜欢"). 5. **Select the best options:** * The most direct and natural translation is "I like eating apples and bananas." 6. **Final Polish:** * "I like eating apples and bananas." 7. **Output generation:** Present the translation clearly. I like eating apples and bananas.

Custom function returned false /[a-zA-Z]/.test(output) && !/[一-龥]/.test(output) && output.trim().length > 3

ERROR Score 0.00
API call error: Error: Request failed after 4 retries: TypeError: fetch failed (Cause: Error: Request was cancelled.)
PASS Score 1.00
I like to eat apples and bananas.

All assertions passed

这本书很有意思,我已经读了三遍。
FAIL Score 0.00
Thinking: 1. **Analyze the source sentence:** "这本书很有意思,我已经读了三遍。" * "这本书" : This book. * "很有意思" : very interesting / fascinating / engaging. * "我" : I. * "已经" : already. * "读了" : read (past tense marker implied). * "三遍" : three times / three rounds. 2. **Determine the core meaning:** The speaker finds the book interesting and has read it three times. 3. **Draft initial translations:** * *Literal:* This book is very interesting, I already read three times. * *Slightly better:* This book is very interesting, and I have already read it three times. 4. **Refine for natural English flow and grammar:** * *Option 1 (Standard/Neutral):* "This book is very interesting; I have already read it three times." (Using a semicolon or period is good for separation). * *Option 2 (Focus on "interesting"):* "This book is fascinating. I've already read it three times." * *Option 3 (Focus on the action):* "I've already read this book three times because it's so interesting." (Combining clauses, but maybe too interpretive). * *Option 4 (Simple):* "This book is really interesting. I've read it three times already." 5. **Select the best options based on common usage:** * *Most direct translation:* "This book is very interesting. I have already read it three times." * *Slightly more casual:* "This book is really interesting. I've read it three times already." 6. **Final Polish:** * "This book is very interesting. I have already read it three times." (Solid, accurate). * "This book is fascinating. I've read it three times already." (Good vocabulary). 7. **Construct the final output:** Provide a few variations to give the user choices (Standard, Casual, Emphatic). * *Standard:* "This book is very interesting. I have already read it three times." * *Natural/Conversational:* "This book is really interesting. I've read it three times already." 8. **Review against the source:** * 这本书 -> This book * 很有意思 -> very interesting / really interesting * 我已经读了 -> I have already read / I've read... already * 三遍 -> three times Everything matches. 9. **Final Output Generation:** (Presenting the most natural translation first). "This book is very interesting. I have already read it three times." Here are a few ways to translate this sentence into English, depending on the tone you want: **Standard & Natural:** > "This book is very interesting. I have already read it three times." **More Casual:** > "This book is really interesting. I've read it three times already." **Slightly more formal:** > "This book is fascinating. I have read it three times."

Custom function returned false /[a-zA-Z]/.test(output) && !/[一-龥]/.test(output) && output.trim().length > 3

ERROR Score 0.00
API call error: Error: Request failed after 4 retries: TypeError: fetch failed (Cause: Error: Request was cancelled.)
PASS Score 1.00
This book is very interesting; I have already read it three times.

All assertions passed

No rows match the current search and status filters.