The merged parent used in these specialist comparisons is now released as Humaneness Voice Large 1.6 Alpha: 1.5 + final RealSpeech rank 4, merged once. Apply only the selected new bucket adapter. Do not reload either ancestor.
1.5 Original model · 1.6 merged model · Complete context manuals for humans and agents
Read 1.5 context manual · Read 1.6 + adapter context manual. Exact prompts, CFG, adapter scales and failed gates are retained. New model/documentation contributions: CC BY 4.0; existing upstream and gated specialist terms remain applicable.
The original grid used generic GENERAL/SCRIPT directions at CFG1. It did not systematically use target-specific manual winners. The new study freezes the actual rank-4 manual wording, preserves every literal word, seed, reference, adapter and frame budget, then independently varies CFG and adapter strength. The previous recordings and conclusions remain below.
Ranking:100% requested EARS emotion/style head, standardized using frozen training statistics; low-pole targets reverse the sign. Formal/casual contrasts average the desired head and negative opposite head. CE and genuineness are diagnostics. Higher target z means stronger desired delivery, not a human rating. More CFG is not automatically better.
Selection:20 original-text outcomes per configuration select wording, CFG and scale. Fifty additional unseen-text reference pairs test the frozen choices. A recommended adapter must improve against both the same-CFG no-adapter control and the best manual-only setting. Quality gates: per-take WER≤15%, mean WER≤10%, valid/terminated fraction≥90%, paired identity change≥−0.05 over50pairs. Failed outcomes stay visible. Language-cluster bootstrap intervals use only five fixed reference voices; findings across72targets remain exploratory.
Five languages: EN/DE/FR/NL/ES; original seeds1701/1702; reference187frames/14.96seconds. CFG1/1.25/1.5/2/2.5/3/4/5 × bucket strength0/0.5/0.75/1. CFG4/5 are stress conditions, not presumed improvements. No-reference use of these bucket recommendations has not been validated.
Taxonomy:S_MONO means Monologue, S_TECH means Teacher/Didactic, VOLT means Volatility. The two corrected style recipes and17dimension/contrast recipes are new searches, not historical manual winners.53other targets reuse directly applicable manual recipes.
Best tested agent route: No new configuration passes the held-out gates; retain standard fallback and inspect audio. Bucket scale 0.0, CFG 1.0.
| Held-out condition | n | Target z↑ | Raw head | CE↑ | Genuine↑ | Voice↑ | WER↓ | Valid | QA |
|---|---|---|---|---|---|---|---|---|---|
| standard | 50 | -0.382 | 0.114 | 6.266 | 4.349 | 0.591 | 0.010 | 1.000 | pass |
| manual | 50 | 1.935 | 1.350 | 5.695 | 4.355 | 0.547 | 0.050 | 0.880 | fail |
| adapter | 50 | 2.057 | 1.415 | 5.722 | 4.360 | 0.528 | 0.088 | 0.920 | fail |
| matched_no_adapter | 50 | 1.935 | 1.350 | 5.695 | 4.355 | 0.547 | 0.050 | 0.880 | fail |
Incremental adapter gain versus same-CFG control: 0.122 z;95% cluster interval [-0.08992190036067646, 0.3342187343034436]. Versus best manual-only: 0.122 z. Manual-only versus standard: 2.317 z.
| Scale | CFG | Target z | CE | Genuine | WER | Provisional QA |
|---|---|---|---|---|---|---|
| 0.0 | 1.0 | -0.060 | 6.081 | 4.442 | 0.000 | True |
| 0.5 | 1.0 | 0.023 | 6.093 | 4.387 | 0.003 | True |
| 0.75 | 1.0 | -0.121 | 6.115 | 4.430 | 0.000 | True |
| 1.0 | 1.0 | -0.123 | 6.110 | 4.430 | 0.003 | True |
| 0.0 | 1.25 | 0.054 | 6.102 | 4.497 | 0.006 | True |
| 0.5 | 1.25 | 0.002 | 6.080 | 4.514 | 0.009 | True |
| 0.75 | 1.25 | 0.038 | 6.107 | 4.472 | 0.000 | True |
| 1.0 | 1.25 | -0.061 | 6.050 | 4.508 | 0.003 | True |
| 0.0 | 1.5 | 0.275 | 6.086 | 4.514 | 0.000 | True |
| 0.5 | 1.5 | 0.133 | 6.105 | 4.552 | 0.009 | True |
| 0.75 | 1.5 | 0.224 | 6.035 | 4.496 | 0.009 | True |
| 1.0 | 1.5 | -0.002 | 6.053 | 4.509 | 0.006 | True |
| 0.0 | 2.0 | 0.905 | 5.979 | 4.474 | 0.014 | True |
| 0.5 | 2.0 | 0.570 | 6.012 | 4.473 | 0.009 | True |
| 0.75 | 2.0 | 0.349 | 5.984 | 4.514 | 0.011 | True |
| 1.0 | 2.0 | 0.288 | 5.946 | 4.464 | 0.014 | True |
| 0.0 | 2.5 | 0.429 | 5.879 | 4.450 | 0.008 | True |
| 0.5 | 2.5 | 0.634 | 5.949 | 4.488 | 0.005 | True |
| 0.75 | 2.5 | 0.609 | 5.908 | 4.444 | 0.009 | True |
| 1.0 | 2.5 | 0.721 | 5.925 | 4.526 | 0.003 | True |
| 0.0 | 3.0 | 1.208 | 5.859 | 4.478 | 0.011 | True |
| 0.5 | 3.0 | 1.056 | 5.762 | 4.424 | 0.005 | True |
| 0.75 | 3.0 | 1.170 | 5.859 | 4.482 | 0.003 | True |
| 1.0 | 3.0 | 1.214 | 5.855 | 4.491 | 0.003 | True |
| 0.0 | 4.0 | 1.713 | 5.699 | 4.385 | 0.038 | False |
| 0.5 | 4.0 | 1.554 | 5.689 | 4.444 | 0.019 | True |
| 0.75 | 4.0 | 1.395 | 5.734 | 4.459 | 0.028 | False |
| 1.0 | 4.0 | 1.755 | 5.613 | 4.391 | 0.025 | True |
| 0.0 | 5.0 | 2.027 | 5.623 | 4.388 | 0.050 | True |
| 0.5 | 5.0 | 1.985 | 5.532 | 4.333 | 0.050 | True |
| 0.75 | 5.0 | 2.012 | 5.563 | 4.358 | 0.024 | True |
| 1.0 | 5.0 | 2.125 | 5.494 | 4.311 | 0.055 | False |
direct_manual_recipe
{
"id": "manual-de7bf3e68eea",
"general": "Employ deliberate, uneven pacing, where pauses are not for breath but for genuine processing of contradictory information.",
"inline": [
"Begin with a halting, staggered delivery, allowing significant, uncomfortable gaps between key syllables.",
"Mid-phrase, accelerate briefly with a rush of confused energy before immediately decelerating again.",
"The final utterance should be delivered with a slow, weighted emphasis on the last syllable, as if confirming a difficult realization."
],
"cfg": 3,
"recipe": "P05",
"strategy": "local-Gemma-mutation",
"timing_syntax": "canonical",
"canonical_labels": true,
"neutral_event": "keep",
"parent": "cfg-3",
"origin": "exact_frozen_manual_recipe"
}Exact machine-readable comparison · Agent tool recommendations
Intense Confusion. Base: 1.5 Alpha + merged real-speech rank4; new adapter: rank32. Every row is a matched seed/text/reference test. Scale zero disables the new adapter; all other scales are applied absolutely, never compounded.
Adapter training data: {"en": 25, "de": 4, "nl": 2, "es": 5, "fr": 4}. All available accepted languages were pooled, globally shuffled, for three epochs. Peak LR 2e-05 at the end of the first-epoch warmup, then cosine decay. All original optimizer/RNG checkpoints remain saved.
Taxonomy: S_MONO is monologue, not monotone; VOLT is volatility, not volume. No claim is made that a classifier score alone proves the audible performance.
| Condition | n | Target score ↑ | Content Enjoyment ↑ | Genuineness ↑ | WER ↓ |
|---|---|---|---|---|---|
| Merged base, no bucket adapter | 20 | 0.369 ± 0.197 | 6.169 ± 0.141 | 4.363 ± 0.251 | 0.00% ± 0.00 |
| Rank32 × 0.5 | 20 | 0.343 ± 0.091 | 6.192 ± 0.164 | 4.350 ± 0.201 | 0.53% ± 2.35 |
| Rank32 × 0.75 | 20 | 0.343 ± 0.137 | 6.235 ± 0.137 | 4.364 ± 0.237 | 0.00% ± 0.00 |
| Rank32 × 1.0 | 20 | 0.327 ± 0.091 | 6.203 ± 0.101 | 4.276 ± 0.196 | 0.31% ± 1.40 |
Fixed speaker reference:
| Condition | n | Target score ↑ | Content Enjoyment ↑ | Genuineness ↑ | WER ↓ |
|---|---|---|---|---|---|
| Merged base, no bucket adapter | 4 | 0.317 ± 0.007 | 6.239 ± 0.157 | 4.248 ± 0.345 | 0.00% ± 0.00 |
| Rank32 × 0.5 | 4 | 0.334 ± 0.022 | 6.295 ± 0.072 | 4.220 ± 0.301 | 0.00% ± 0.00 |
| Rank32 × 0.75 | 4 | 0.341 ± 0.019 | 6.279 ± 0.080 | 4.269 ± 0.243 | 0.00% ± 0.00 |
| Rank32 × 1.0 | 4 | 0.325 ± 0.017 | 6.303 ± 0.122 | 4.168 ± 0.290 | 1.56% ± 3.12 |
| Prompt / seed | Merged base · no new LoRA | Rank32 × 0.5 | Rank32 × 0.75 | Rank32 × 1.0 |
|---|---|---|---|---|
| Seed 1701 The door is still open. I put your coat on the chair. Tell me when you are ready. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] The door is still open. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] I put your coat on the chair. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Tell me when you are ready. | Target 0.322 · CE 6.13 · Genuine 3.99 · WER 0.0% | Target 0.329 · CE 6.24 · Genuine 4.01 · WER 0.0% | Target 0.329 · CE 6.25 · Genuine 4.08 · WER 0.0% | Target 0.315 · CE 6.20 · Genuine 3.96 · WER 0.0% |
| Seed 1702 The door is still open. I put your coat on the chair. Tell me when you are ready. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] The door is still open. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] I put your coat on the chair. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Tell me when you are ready. | Target 0.316 · CE 6.09 · Genuine 3.92 · WER 0.0% | Target 0.318 · CE 6.23 · Genuine 3.94 · WER 0.0% | Target 0.329 · CE 6.28 · Genuine 4.06 · WER 0.0% | Target 0.325 · CE 6.20 · Genuine 3.89 · WER 0.0% |
| Seed 1701 I found the little box. It was beside the old window. We can look inside together. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] I found the little box. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] It was beside the old window. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] We can look inside together. | Target 0.321 · CE 6.40 · Genuine 4.63 · WER 0.0% | Target 0.322 · CE 6.34 · Genuine 4.35 · WER 0.0% | Target 0.368 · CE 6.39 · Genuine 4.56 · WER 0.0% | Target 0.349 · CE 6.41 · Genuine 4.48 · WER 6.2% |
| Seed 1702 I found the little box. It was beside the old window. We can look inside together. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] I found the little box. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] It was beside the old window. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] We can look inside together. | Target 0.307 · CE 6.34 · Genuine 4.44 · WER 0.0% | Target 0.367 · CE 6.37 · Genuine 4.58 · WER 0.0% | Target 0.337 · CE 6.20 · Genuine 4.38 · WER 0.0% | Target 0.311 · CE 6.40 · Genuine 4.34 · WER 0.0% |
Fixed speaker reference:
| Condition | n | Target score ↑ | Content Enjoyment ↑ | Genuineness ↑ | WER ↓ |
|---|---|---|---|---|---|
| Merged base, no bucket adapter | 4 | 0.310 ± 0.030 | 6.328 ± 0.084 | 4.446 ± 0.271 | 0.00% ± 0.00 |
| Rank32 × 0.5 | 4 | 0.293 ± 0.016 | 6.362 ± 0.171 | 4.263 ± 0.041 | 0.00% ± 0.00 |
| Rank32 × 0.75 | 4 | 0.285 ± 0.021 | 6.332 ± 0.098 | 4.327 ± 0.202 | 0.00% ± 0.00 |
| Rank32 × 1.0 | 4 | 0.293 ± 0.031 | 6.277 ± 0.067 | 4.299 ± 0.250 | 0.00% ± 0.00 |
| Prompt / seed | Merged base · no new LoRA | Rank32 × 0.5 | Rank32 × 0.75 | Rank32 × 1.0 |
|---|---|---|---|---|
| Seed 1701 Die Tür ist noch offen. Ich habe deinen Mantel auf den Stuhl gelegt. Sag mir, wenn du bereit bist. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Die Tür ist noch offen. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Ich habe deinen Mantel auf den Stuhl gelegt. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Sag mir, wenn du bereit bist. | Target 0.327 · CE 6.40 · Genuine 4.51 · WER 0.0% | Target 0.299 · CE 6.32 · Genuine 4.31 · WER 0.0% | Target 0.306 · CE 6.27 · Genuine 4.43 · WER 0.0% | Target 0.337 · CE 6.24 · Genuine 4.66 · WER 0.0% |
| Seed 1702 Die Tür ist noch offen. Ich habe deinen Mantel auf den Stuhl gelegt. Sag mir, wenn du bereit bist. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Die Tür ist noch offen. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Ich habe deinen Mantel auf den Stuhl gelegt. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Sag mir, wenn du bereit bist. | Target 0.342 · CE 6.21 · Genuine 4.78 · WER 0.0% | Target 0.313 · CE 6.14 · Genuine 4.22 · WER 0.0% | Target 0.294 · CE 6.23 · Genuine 4.33 · WER 0.0% | Target 0.294 · CE 6.21 · Genuine 4.21 · WER 0.0% |
| Seed 1701 Ich habe die kleine Schachtel gefunden. Sie stand neben dem alten Fenster. Wir können gemeinsam hineinschauen. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Ich habe die kleine Schachtel gefunden. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Sie stand neben dem alten Fenster. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Wir können gemeinsam hineinschauen. | Target 0.278 · CE 6.35 · Genuine 4.14 · WER 0.0% | Target 0.280 · CE 6.54 · Genuine 4.24 · WER 0.0% | Target 0.257 · CE 6.40 · Genuine 4.04 · WER 0.0% | Target 0.276 · CE 6.36 · Genuine 4.08 · WER 0.0% |
| Seed 1702 Ich habe die kleine Schachtel gefunden. Sie stand neben dem alten Fenster. Wir können gemeinsam hineinschauen. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Ich habe die kleine Schachtel gefunden. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Sie stand neben dem alten Fenster. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Wir können gemeinsam hineinschauen. | Target 0.291 · CE 6.36 · Genuine 4.36 · WER 0.0% | Target 0.280 · CE 6.44 · Genuine 4.29 · WER 0.0% | Target 0.282 · CE 6.43 · Genuine 4.51 · WER 0.0% | Target 0.265 · CE 6.29 · Genuine 4.25 · WER 0.0% |
Fixed speaker reference:
| Condition | n | Target score ↑ | Content Enjoyment ↑ | Genuineness ↑ | WER ↓ |
|---|---|---|---|---|---|
| Merged base, no bucket adapter | 4 | 0.279 ± 0.024 | 6.128 ± 0.084 | 4.504 ± 0.301 | 0.00% ± 0.00 |
| Rank32 × 0.5 | 4 | 0.278 ± 0.014 | 6.148 ± 0.039 | 4.435 ± 0.068 | 2.63% ± 5.26 |
| Rank32 × 0.75 | 4 | 0.293 ± 0.016 | 6.237 ± 0.144 | 4.564 ± 0.115 | 0.00% ± 0.00 |
| Rank32 × 1.0 | 4 | 0.285 ± 0.018 | 6.197 ± 0.075 | 4.423 ± 0.082 | 0.00% ± 0.00 |
| Prompt / seed | Merged base · no new LoRA | Rank32 × 0.5 | Rank32 × 0.75 | Rank32 × 1.0 |
|---|---|---|---|---|
| Seed 1701 La porte est encore ouverte. J’ai posé ton manteau sur la chaise. Dis-moi quand tu es prêt. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] La porte est encore ouverte. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] J’ai posé ton manteau sur la chaise. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Dis-moi quand tu es prêt. | Target 0.290 · CE 6.04 · Genuine 4.33 · WER 0.0% | Target 0.296 · CE 6.15 · Genuine 4.43 · WER 0.0% | Target 0.290 · CE 6.27 · Genuine 4.53 · WER 0.0% | Target 0.295 · CE 6.20 · Genuine 4.38 · WER 0.0% |
| Seed 1702 La porte est encore ouverte. J’ai posé ton manteau sur la chaise. Dis-moi quand tu es prêt. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] La porte est encore ouverte. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] J’ai posé ton manteau sur la chaise. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Dis-moi quand tu es prêt. | Target 0.304 · CE 6.09 · Genuine 4.77 · WER 0.0% | Target 0.280 · CE 6.14 · Genuine 4.51 · WER 0.0% | Target 0.313 · CE 6.05 · Genuine 4.51 · WER 0.0% | Target 0.298 · CE 6.13 · Genuine 4.43 · WER 0.0% |
| Seed 1701 J’ai trouvé la petite boîte. Elle était près de la vieille fenêtre. Nous pouvons regarder ensemble ce qu’elle contient. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] J’ai trouvé la petite boîte. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Elle était près de la vieille fenêtre. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Nous pouvons regarder ensemble ce qu’elle contient. | Target 0.247 · CE 6.14 · Genuine 4.17 · WER 0.0% | Target 0.271 · CE 6.10 · Genuine 4.34 · WER 0.0% | Target 0.292 · CE 6.40 · Genuine 4.73 · WER 0.0% | Target 0.260 · CE 6.17 · Genuine 4.34 · WER 0.0% |
| Seed 1702 J’ai trouvé la petite boîte. Elle était près de la vieille fenêtre. Nous pouvons regarder ensemble ce qu’elle contient. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] J’ai trouvé la petite boîte. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Elle était près de la vieille fenêtre. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Nous pouvons regarder ensemble ce qu’elle contient. | Target 0.275 · CE 6.24 · Genuine 4.75 · WER 0.0% | Target 0.263 · CE 6.20 · Genuine 4.46 · WER 10.5% | Target 0.275 · CE 6.24 · Genuine 4.48 · WER 0.0% | Target 0.290 · CE 6.30 · Genuine 4.53 · WER 0.0% |
Fixed speaker reference:
| Condition | n | Target score ↑ | Content Enjoyment ↑ | Genuineness ↑ | WER ↓ |
|---|---|---|---|---|---|
| Merged base, no bucket adapter | 4 | 0.659 ± 0.318 | 6.062 ± 0.079 | 4.291 ± 0.094 | 0.00% ± 0.00 |
| Rank32 × 0.5 | 4 | 0.477 ± 0.100 | 6.164 ± 0.122 | 4.305 ± 0.202 | 0.00% ± 0.00 |
| Rank32 × 0.75 | 4 | 0.507 ± 0.265 | 6.146 ± 0.185 | 4.347 ± 0.193 | 0.00% ± 0.00 |
| Rank32 × 1.0 | 4 | 0.446 ± 0.158 | 6.132 ± 0.029 | 4.269 ± 0.121 | 0.00% ± 0.00 |
| Prompt / seed | Merged base · no new LoRA | Rank32 × 0.5 | Rank32 × 0.75 | Rank32 × 1.0 |
|---|---|---|---|---|
| Seed 1701 De deur staat nog open. Ik heb je jas op de stoel gelegd. Zeg maar wanneer je klaar bent. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] De deur staat nog open. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Ik heb je jas op de stoel gelegd. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Zeg maar wanneer je klaar bent. | Target 0.978 · CE 6.15 · Genuine 4.24 · WER 0.0% | Target 0.558 · CE 6.01 · Genuine 4.01 · WER 0.0% | Target 0.540 · CE 6.21 · Genuine 4.33 · WER 0.0% | Target 0.672 · CE 6.11 · Genuine 4.23 · WER 0.0% |
| Seed 1702 De deur staat nog open. Ik heb je jas op de stoel gelegd. Zeg maar wanneer je klaar bent. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] De deur staat nog open. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Ik heb je jas op de stoel gelegd. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Zeg maar wanneer je klaar bent. | Target 0.882 · CE 5.96 · Genuine 4.25 · WER 0.0% | Target 0.568 · CE 6.12 · Genuine 4.37 · WER 0.0% | Target 0.870 · CE 5.87 · Genuine 4.08 · WER 0.0% | Target 0.378 · CE 6.13 · Genuine 4.33 · WER 0.0% |
| Seed 1701 Ik heb het kleine doosje gevonden. Het stond naast het oude raam. We kunnen er samen in kijken. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Ik heb het kleine doosje gevonden. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Het stond naast het oude raam. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] We kunnen er samen in kijken. | Target 0.439 · CE 6.09 · Genuine 4.24 · WER 0.0% | Target 0.392 · CE 6.24 · Genuine 4.43 · WER 0.0% | Target 0.306 · CE 6.22 · Genuine 4.49 · WER 0.0% | Target 0.309 · CE 6.12 · Genuine 4.12 · WER 0.0% |
| Seed 1702 Ik heb het kleine doosje gevonden. Het stond naast het oude raam. We kunnen er samen in kijken. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Ik heb het kleine doosje gevonden. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Het stond naast het oude raam. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] We kunnen er samen in kijken. | Target 0.337 · CE 6.05 · Genuine 4.43 · WER 0.0% | Target 0.390 · CE 6.28 · Genuine 4.41 · WER 0.0% | Target 0.311 · CE 6.28 · Genuine 4.48 · WER 0.0% | Target 0.426 · CE 6.17 · Genuine 4.39 · WER 0.0% |
Fixed speaker reference:
| Condition | n | Target score ↑ | Content Enjoyment ↑ | Genuineness ↑ | WER ↓ |
|---|---|---|---|---|---|
| Merged base, no bucket adapter | 4 | 0.282 ± 0.018 | 6.088 ± 0.118 | 4.327 ± 0.213 | 0.00% ± 0.00 |
| Rank32 × 0.5 | 4 | 0.334 ± 0.092 | 5.991 ± 0.101 | 4.529 ± 0.172 | 0.00% ± 0.00 |
| Rank32 × 0.75 | 4 | 0.291 ± 0.026 | 6.181 ± 0.132 | 4.313 ± 0.365 | 0.00% ± 0.00 |
| Rank32 × 1.0 | 4 | 0.286 ± 0.024 | 6.108 ± 0.004 | 4.223 ± 0.165 | 0.00% ± 0.00 |
| Prompt / seed | Merged base · no new LoRA | Rank32 × 0.5 | Rank32 × 0.75 | Rank32 × 1.0 |
|---|---|---|---|---|
| Seed 1701 La puerta sigue abierta. He dejado tu abrigo sobre la silla. Dime cuándo estás listo. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] La puerta sigue abierta. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] He dejado tu abrigo sobre la silla. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Dime cuándo estás listo. | Target 0.262 · CE 5.97 · Genuine 4.40 · WER 0.0% | Target 0.282 · CE 5.95 · Genuine 4.33 · WER 0.0% | Target 0.256 · CE 6.12 · Genuine 4.06 · WER 0.0% | Target 0.272 · CE 6.11 · Genuine 4.24 · WER 0.0% |
| Seed 1702 La puerta sigue abierta. He dejado tu abrigo sobre la silla. Dime cuándo estás listo. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] La puerta sigue abierta. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] He dejado tu abrigo sobre la silla. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Dime cuándo estás listo. | Target 0.271 · CE 6.01 · Genuine 4.03 · WER 0.0% | Target 0.284 · CE 5.87 · Genuine 4.44 · WER 0.0% | Target 0.319 · CE 6.04 · Genuine 3.96 · WER 0.0% | Target 0.270 · CE 6.10 · Genuine 4.06 · WER 0.0% |
| Seed 1701 He encontrado la cajita. Estaba junto a la ventana vieja. Podemos mirar juntos lo que hay dentro. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] He encontrado la cajita. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Estaba junto a la ventana vieja. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Podemos mirar juntos lo que hay dentro. | Target 0.298 · CE 6.24 · Genuine 4.53 · WER 0.0% | Target 0.298 · CE 6.10 · Genuine 4.63 · WER 0.0% | Target 0.291 · CE 6.34 · Genuine 4.71 · WER 0.0% | Target 0.322 · CE 6.11 · Genuine 4.16 · WER 0.0% |
| Seed 1702 He encontrado la cajita. Estaba junto a la ventana vieja. Podemos mirar juntos lo que hay dentro. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] He encontrado la cajita. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Estaba junto a la ventana vieja. (Intense Confusion. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Podemos mirar juntos lo que hay dentro. | Target 0.298 · CE 6.13 · Genuine 4.34 · WER 0.0% | Target 0.471 · CE 6.04 · Genuine 4.71 · WER 0.0% | Target 0.298 · CE 6.23 · Genuine 4.53 · WER 0.0% | Target 0.282 · CE 6.11 · Genuine 4.44 · WER 0.0% |