The merged parent used in these specialist comparisons is now released as Humaneness Voice Large 1.6 Alpha: 1.5 + final RealSpeech rank 4, merged once. Apply only the selected new bucket adapter. Do not reload either ancestor.
1.5 Original model · 1.6 merged model · Complete context manuals for humans and agents
Read 1.5 context manual · Read 1.6 + adapter context manual. Exact prompts, CFG, adapter scales and failed gates are retained. New model/documentation contributions: CC BY 4.0; existing upstream and gated specialist terms remain applicable.
The original grid used generic GENERAL/SCRIPT directions at CFG1. It did not systematically use target-specific manual winners. The new study freezes the actual rank-4 manual wording, preserves every literal word, seed, reference, adapter and frame budget, then independently varies CFG and adapter strength. The previous recordings and conclusions remain below.
Ranking:100% requested EARS emotion/style head, standardized using frozen training statistics; low-pole targets reverse the sign. Formal/casual contrasts average the desired head and negative opposite head. CE and genuineness are diagnostics. Higher target z means stronger desired delivery, not a human rating. More CFG is not automatically better.
Selection:20 original-text outcomes per configuration select wording, CFG and scale. Fifty additional unseen-text reference pairs test the frozen choices. A recommended adapter must improve against both the same-CFG no-adapter control and the best manual-only setting. Quality gates: per-take WER≤15%, mean WER≤10%, valid/terminated fraction≥90%, paired identity change≥−0.05 over50pairs. Failed outcomes stay visible. Language-cluster bootstrap intervals use only five fixed reference voices; findings across72targets remain exploratory.
Five languages: EN/DE/FR/NL/ES; original seeds1701/1702; reference187frames/14.96seconds. CFG1/1.25/1.5/2/2.5/3/4/5 × bucket strength0/0.5/0.75/1. CFG4/5 are stress conditions, not presumed improvements. No-reference use of these bucket recommendations has not been validated.
Taxonomy:S_MONO means Monologue, S_TECH means Teacher/Didactic, VOLT means Volatility. The two corrected style recipes and17dimension/contrast recipes are new searches, not historical manual winners.53other targets reuse directly applicable manual recipes.
Best tested agent route: Use manual-only configuration; no clear qualifying incremental adapter gain. Bucket scale 0.0, CFG 4.0.
| Held-out condition | n | Target z↑ | Raw head | CE↑ | Genuine↑ | Voice↑ | WER↓ | Valid | QA |
|---|---|---|---|---|---|---|---|---|---|
| standard | 50 | -0.776 | 2.760 | 6.240 | 4.379 | 0.598 | 0.010 | 1.000 | pass |
| manual | 50 | 0.031 | 3.790 | 5.988 | 4.533 | 0.622 | 0.027 | 0.980 | pass |
| adapter | 50 | 0.076 | 3.847 | 5.962 | 4.535 | 0.580 | 0.027 | 1.000 | pass |
| matched_no_adapter | 50 | 0.031 | 3.790 | 5.988 | 4.533 | 0.622 | 0.027 | 0.980 | pass |
Incremental adapter gain versus same-CFG control: 0.045 z;95% cluster interval [-0.03737792713136011, 0.14386721944558975]. Versus best manual-only: 0.045 z. Manual-only versus standard: 0.807 z.
| Scale | CFG | Target z | CE | Genuine | WER | Provisional QA |
|---|---|---|---|---|---|---|
| 0.0 | 1.0 | -0.750 | 6.141 | 4.398 | 0.000 | True |
| 0.5 | 1.0 | -0.563 | 6.145 | 4.376 | 0.003 | True |
| 0.75 | 1.0 | -0.528 | 6.178 | 4.449 | 0.000 | True |
| 1.0 | 1.0 | -0.460 | 6.173 | 4.477 | 0.015 | True |
| 0.0 | 1.25 | -0.354 | 6.123 | 4.437 | 0.012 | True |
| 0.5 | 1.25 | -0.483 | 6.148 | 4.480 | 0.003 | False |
| 0.75 | 1.25 | -0.461 | 6.139 | 4.476 | 0.006 | True |
| 1.0 | 1.25 | -0.357 | 6.126 | 4.459 | 0.008 | True |
| 0.0 | 1.5 | -0.510 | 6.113 | 4.422 | 0.006 | True |
| 0.5 | 1.5 | -0.405 | 6.111 | 4.460 | 0.005 | True |
| 0.75 | 1.5 | -0.433 | 6.117 | 4.426 | 0.011 | True |
| 1.0 | 1.5 | -0.331 | 6.109 | 4.465 | 0.006 | True |
| 0.0 | 2.0 | -0.219 | 6.075 | 4.522 | 0.009 | False |
| 0.5 | 2.0 | -0.300 | 6.048 | 4.497 | 0.019 | True |
| 0.75 | 2.0 | -0.214 | 6.105 | 4.511 | 0.000 | False |
| 1.0 | 2.0 | -0.213 | 6.085 | 4.473 | 0.006 | False |
| 0.0 | 2.5 | -0.153 | 6.058 | 4.515 | 0.014 | True |
| 0.5 | 2.5 | -0.194 | 6.033 | 4.504 | 0.017 | True |
| 0.75 | 2.5 | -0.125 | 6.016 | 4.462 | 0.013 | True |
| 1.0 | 2.5 | -0.156 | 5.981 | 4.478 | 0.066 | True |
| 0.0 | 3.0 | 0.048 | 5.937 | 4.545 | 0.014 | True |
| 0.5 | 3.0 | -0.033 | 5.966 | 4.518 | 0.012 | False |
| 0.75 | 3.0 | 0.062 | 5.902 | 4.508 | 0.027 | False |
| 1.0 | 3.0 | -0.054 | 5.958 | 4.500 | 0.012 | False |
| 0.0 | 4.0 | 0.113 | 5.924 | 4.556 | 0.006 | True |
| 0.5 | 4.0 | 0.124 | 5.903 | 4.492 | 0.014 | True |
| 0.75 | 4.0 | 0.040 | 5.849 | 4.492 | 0.072 | True |
| 1.0 | 4.0 | 0.107 | 5.820 | 4.519 | 0.017 | False |
| 0.0 | 5.0 | 0.261 | 5.756 | 4.580 | 0.038 | False |
| 0.5 | 5.0 | 0.267 | 5.824 | 4.561 | 0.037 | False |
| 0.75 | 5.0 | 0.243 | 5.738 | 4.539 | 0.026 | False |
| 1.0 | 5.0 | 0.106 | 5.747 | 4.518 | 0.025 | False |
direct_manual_recipe
{
"id": "manual-e8c5567cec7f",
"general": "Emphasize the casual, unscripted nature of the speech; the speaker is rambling slightly, thinking out loud.",
"inline": [
"Allow the pace to vary naturally, speeding up slightly on familiar phrases and slowing down for emphasis.",
"Incorporate subtle vocal texture shifts that suggest momentary distraction or shifting focus.",
"End the clip with a sense of lingering thought, as if the speaker is about to change the subject abruptly."
],
"cfg": 3,
"recipe": "P04",
"strategy": "local-Gemma-mutation",
"timing_syntax": "canonical",
"canonical_labels": true,
"neutral_event": "keep",
"parent": "cfg-3",
"origin": "exact_frozen_manual_recipe"
}Exact machine-readable comparison · Agent tool recommendations
Strong Casual Style. Base: 1.5 Alpha + merged real-speech rank4; new adapter: rank32. Every row is a matched seed/text/reference test. Scale zero disables the new adapter; all other scales are applied absolutely, never compounded.
Adapter training data: {"es": 27, "nl": 23, "fr": 47, "de": 44, "en": 18}. All available accepted languages were pooled, globally shuffled, for three epochs. Peak LR 2e-05 at the end of the first-epoch warmup, then cosine decay. All original optimizer/RNG checkpoints remain saved.
Taxonomy: S_MONO is monologue, not monotone; VOLT is volatility, not volume. No claim is made that a classifier score alone proves the audible performance.
| Condition | n | Target score ↑ | Content Enjoyment ↑ | Genuineness ↑ | WER ↓ |
|---|---|---|---|---|---|
| Merged base, no bucket adapter | 20 | 0.180 ± 0.133 | 6.180 ± 0.141 | 4.344 ± 0.245 | 0.33% ± 1.49 |
| Rank32 × 0.5 | 20 | 0.218 ± 0.201 | 6.138 ± 0.158 | 4.355 ± 0.210 | 0.00% ± 0.00 |
| Rank32 × 0.75 | 20 | 0.245 ± 0.180 | 6.179 ± 0.129 | 4.383 ± 0.220 | 0.53% ± 2.35 |
| Rank32 × 1.0 | 20 | 0.172 ± 0.138 | 6.148 ± 0.152 | 4.251 ± 0.223 | 0.80% ± 2.60 |
Fixed speaker reference:
| Condition | n | Target score ↑ | Content Enjoyment ↑ | Genuineness ↑ | WER ↓ |
|---|---|---|---|---|---|
| Merged base, no bucket adapter | 4 | 0.189 ± 0.161 | 6.209 ± 0.014 | 4.216 ± 0.178 | 0.00% ± 0.00 |
| Rank32 × 0.5 | 4 | 0.311 ± 0.316 | 6.273 ± 0.132 | 4.280 ± 0.304 | 0.00% ± 0.00 |
| Rank32 × 0.75 | 4 | 0.321 ± 0.297 | 6.279 ± 0.099 | 4.234 ± 0.322 | 0.00% ± 0.00 |
| Rank32 × 1.0 | 4 | 0.185 ± 0.137 | 6.267 ± 0.032 | 4.181 ± 0.261 | 0.00% ± 0.00 |
| Prompt / seed | Merged base · no new LoRA | Rank32 × 0.5 | Rank32 × 0.75 | Rank32 × 1.0 |
|---|---|---|---|---|
| Seed 1701 The door is still open. I put your coat on the chair. Tell me when you are ready. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] The door is still open. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] I put your coat on the chair. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Tell me when you are ready. | Target 0.050 · CE 6.20 · Genuine 3.97 · WER 0.0% | Target 0.075 · CE 6.17 · Genuine 3.94 · WER 0.0% | Target 0.109 · CE 6.26 · Genuine 4.17 · WER 0.0% | Target 0.034 · CE 6.22 · Genuine 3.84 · WER 0.0% |
| Seed 1702 The door is still open. I put your coat on the chair. Tell me when you are ready. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] The door is still open. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] I put your coat on the chair. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Tell me when you are ready. | Target 0.057 · CE 6.22 · Genuine 4.22 · WER 0.0% | Target 0.026 · CE 6.17 · Genuine 4.12 · WER 0.0% | Target 0.026 · CE 6.17 · Genuine 3.84 · WER 0.0% | Target 0.109 · CE 6.29 · Genuine 4.12 · WER 0.0% |
| Seed 1701 I found the little box. It was beside the old window. We can look inside together. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] I found the little box. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] It was beside the old window. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] We can look inside together. | Target 0.279 · CE 6.22 · Genuine 4.29 · WER 0.0% | Target 0.688 · CE 6.45 · Genuine 4.58 · WER 0.0% | Target 0.538 · CE 6.41 · Genuine 4.62 · WER 0.0% | Target 0.278 · CE 6.28 · Genuine 4.31 · WER 0.0% |
| Seed 1702 I found the little box. It was beside the old window. We can look inside together. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] I found the little box. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] It was beside the old window. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] We can look inside together. | Target 0.371 · CE 6.20 · Genuine 4.38 · WER 0.0% | Target 0.453 · CE 6.29 · Genuine 4.48 · WER 0.0% | Target 0.612 · CE 6.27 · Genuine 4.30 · WER 0.0% | Target 0.322 · CE 6.27 · Genuine 4.44 · WER 0.0% |
Fixed speaker reference:
| Condition | n | Target score ↑ | Content Enjoyment ↑ | Genuineness ↑ | WER ↓ |
|---|---|---|---|---|---|
| Merged base, no bucket adapter | 4 | 0.097 ± 0.105 | 6.301 ± 0.177 | 4.296 ± 0.204 | 0.00% ± 0.00 |
| Rank32 × 0.5 | 4 | 0.063 ± 0.036 | 6.239 ± 0.096 | 4.250 ± 0.150 | 0.00% ± 0.00 |
| Rank32 × 0.75 | 4 | 0.081 ± 0.039 | 6.316 ± 0.128 | 4.366 ± 0.278 | 2.63% ± 5.26 |
| Rank32 × 1.0 | 4 | 0.104 ± 0.020 | 6.322 ± 0.101 | 4.363 ± 0.076 | 0.00% ± 0.00 |
| Prompt / seed | Merged base · no new LoRA | Rank32 × 0.5 | Rank32 × 0.75 | Rank32 × 1.0 |
|---|---|---|---|---|
| Seed 1701 Die Tür ist noch offen. Ich habe deinen Mantel auf den Stuhl gelegt. Sag mir, wenn du bereit bist. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Die Tür ist noch offen. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Ich habe deinen Mantel auf den Stuhl gelegt. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Sag mir, wenn du bereit bist. | Target 0.253 · CE 6.06 · Genuine 4.60 · WER 0.0% | Target 0.097 · CE 6.11 · Genuine 4.34 · WER 0.0% | Target 0.072 · CE 6.13 · Genuine 4.48 · WER 10.5% | Target 0.125 · CE 6.25 · Genuine 4.37 · WER 0.0% |
| Seed 1702 Die Tür ist noch offen. Ich habe deinen Mantel auf den Stuhl gelegt. Sag mir, wenn du bereit bist. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Die Tür ist noch offen. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Ich habe deinen Mantel auf den Stuhl gelegt. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Sag mir, wenn du bereit bist. | Target 0.053 · CE 6.28 · Genuine 4.25 · WER 0.0% | Target 0.090 · CE 6.24 · Genuine 4.40 · WER 0.0% | Target 0.134 · CE 6.32 · Genuine 4.65 · WER 0.0% | Target 0.109 · CE 6.22 · Genuine 4.39 · WER 0.0% |
| Seed 1701 Ich habe die kleine Schachtel gefunden. Sie stand neben dem alten Fenster. Wir können gemeinsam hineinschauen. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Ich habe die kleine Schachtel gefunden. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Sie stand neben dem alten Fenster. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Wir können gemeinsam hineinschauen. | Target 0.029 · CE 6.40 · Genuine 4.14 · WER 0.0% | Target 0.039 · CE 6.27 · Genuine 4.18 · WER 0.0% | Target 0.041 · CE 6.40 · Genuine 3.99 · WER 0.0% | Target 0.078 · CE 6.39 · Genuine 4.26 · WER 0.0% |
| Seed 1702 Ich habe die kleine Schachtel gefunden. Sie stand neben dem alten Fenster. Wir können gemeinsam hineinschauen. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Ich habe die kleine Schachtel gefunden. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Sie stand neben dem alten Fenster. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Wir können gemeinsam hineinschauen. | Target 0.054 · CE 6.47 · Genuine 4.19 · WER 0.0% | Target 0.025 · CE 6.34 · Genuine 4.07 · WER 0.0% | Target 0.076 · CE 6.41 · Genuine 4.34 · WER 0.0% | Target 0.106 · CE 6.43 · Genuine 4.43 · WER 0.0% |
Fixed speaker reference:
| Condition | n | Target score ↑ | Content Enjoyment ↑ | Genuineness ↑ | WER ↓ |
|---|---|---|---|---|---|
| Merged base, no bucket adapter | 4 | 0.209 ± 0.146 | 6.213 ± 0.107 | 4.470 ± 0.363 | 0.00% ± 0.00 |
| Rank32 × 0.5 | 4 | 0.206 ± 0.125 | 6.183 ± 0.137 | 4.542 ± 0.151 | 0.00% ± 0.00 |
| Rank32 × 0.75 | 4 | 0.274 ± 0.156 | 6.128 ± 0.098 | 4.561 ± 0.080 | 0.00% ± 0.00 |
| Rank32 × 1.0 | 4 | 0.147 ± 0.064 | 6.064 ± 0.145 | 4.288 ± 0.205 | 0.00% ± 0.00 |
| Prompt / seed | Merged base · no new LoRA | Rank32 × 0.5 | Rank32 × 0.75 | Rank32 × 1.0 |
|---|---|---|---|---|
| Seed 1701 La porte est encore ouverte. J’ai posé ton manteau sur la chaise. Dis-moi quand tu es prêt. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] La porte est encore ouverte. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] J’ai posé ton manteau sur la chaise. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Dis-moi quand tu es prêt. | Target 0.054 · CE 6.09 · Genuine 4.09 · WER 0.0% | Target 0.227 · CE 6.28 · Genuine 4.47 · WER 0.0% | Target 0.159 · CE 6.01 · Genuine 4.65 · WER 0.0% | Target 0.181 · CE 6.17 · Genuine 4.43 · WER 0.0% |
| Seed 1702 La porte est encore ouverte. J’ai posé ton manteau sur la chaise. Dis-moi quand tu es prêt. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] La porte est encore ouverte. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] J’ai posé ton manteau sur la chaise. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Dis-moi quand tu es prêt. | Target 0.116 · CE 6.17 · Genuine 4.24 · WER 0.0% | Target 0.078 · CE 5.98 · Genuine 4.37 · WER 0.0% | Target 0.203 · CE 6.09 · Genuine 4.46 · WER 0.0% | Target 0.078 · CE 6.08 · Genuine 3.99 · WER 0.0% |
| Seed 1701 J’ai trouvé la petite boîte. Elle était près de la vieille fenêtre. Nous pouvons regarder ensemble ce qu’elle contient. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] J’ai trouvé la petite boîte. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Elle était près de la vieille fenêtre. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Nous pouvons regarder ensemble ce qu’elle contient. | Target 0.315 · CE 6.33 · Genuine 4.72 · WER 0.0% | Target 0.149 · CE 6.21 · Genuine 4.62 · WER 0.0% | Target 0.231 · CE 6.24 · Genuine 4.55 · WER 0.0% | Target 0.111 · CE 6.15 · Genuine 4.31 · WER 0.0% |
| Seed 1702 J’ai trouvé la petite boîte. Elle était près de la vieille fenêtre. Nous pouvons regarder ensemble ce qu’elle contient. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] J’ai trouvé la petite boîte. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Elle était près de la vieille fenêtre. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Nous pouvons regarder ensemble ce qu’elle contient. | Target 0.351 · CE 6.26 · Genuine 4.83 · WER 0.0% | Target 0.370 · CE 6.25 · Genuine 4.71 · WER 0.0% | Target 0.503 · CE 6.17 · Genuine 4.60 · WER 0.0% | Target 0.218 · CE 5.86 · Genuine 4.42 · WER 0.0% |
Fixed speaker reference:
| Condition | n | Target score ↑ | Content Enjoyment ↑ | Genuineness ↑ | WER ↓ |
|---|---|---|---|---|---|
| Merged base, no bucket adapter | 4 | 0.254 ± 0.120 | 6.172 ± 0.056 | 4.423 ± 0.108 | 0.00% ± 0.00 |
| Rank32 × 0.5 | 4 | 0.355 ± 0.246 | 5.991 ± 0.017 | 4.299 ± 0.126 | 0.00% ± 0.00 |
| Rank32 × 0.75 | 4 | 0.357 ± 0.136 | 6.068 ± 0.040 | 4.333 ± 0.035 | 0.00% ± 0.00 |
| Rank32 × 1.0 | 4 | 0.262 ± 0.263 | 6.062 ± 0.072 | 4.156 ± 0.209 | 4.02% ± 5.07 |
| Prompt / seed | Merged base · no new LoRA | Rank32 × 0.5 | Rank32 × 0.75 | Rank32 × 1.0 |
|---|---|---|---|---|
| Seed 1701 De deur staat nog open. Ik heb je jas op de stoel gelegd. Zeg maar wanneer je klaar bent. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] De deur staat nog open. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Ik heb je jas op de stoel gelegd. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Zeg maar wanneer je klaar bent. | Target 0.366 · CE 6.14 · Genuine 4.36 · WER 0.0% | Target 0.307 · CE 5.99 · Genuine 4.18 · WER 0.0% | Target 0.420 · CE 6.10 · Genuine 4.30 · WER 0.0% | Target 0.080 · CE 6.08 · Genuine 4.18 · WER 0.0% |
| Seed 1702 De deur staat nog open. Ik heb je jas op de stoel gelegd. Zeg maar wanneer je klaar bent. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] De deur staat nog open. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Ik heb je jas op de stoel gelegd. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Zeg maar wanneer je klaar bent. | Target 0.280 · CE 6.12 · Genuine 4.52 · WER 0.0% | Target 0.041 · CE 6.00 · Genuine 4.20 · WER 0.0% | Target 0.440 · CE 6.01 · Genuine 4.38 · WER 0.0% | Target 0.379 · CE 6.16 · Genuine 4.32 · WER 10.5% |
| Seed 1701 Ik heb het kleine doosje gevonden. Het stond naast het oude raam. We kunnen er samen in kijken. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Ik heb het kleine doosje gevonden. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Het stond naast het oude raam. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] We kunnen er samen in kijken. | Target 0.085 · CE 6.18 · Genuine 4.30 · WER 0.0% | Target 0.626 · CE 5.97 · Genuine 4.39 · WER 0.0% | Target 0.416 · CE 6.09 · Genuine 4.33 · WER 0.0% | Target 0.014 · CE 6.01 · Genuine 3.85 · WER 0.0% |
| Seed 1702 Ik heb het kleine doosje gevonden. Het stond naast het oude raam. We kunnen er samen in kijken. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Ik heb het kleine doosje gevonden. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Het stond naast het oude raam. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] We kunnen er samen in kijken. | Target 0.287 · CE 6.25 · Genuine 4.51 · WER 0.0% | Target 0.444 · CE 6.01 · Genuine 4.42 · WER 0.0% | Target 0.153 · CE 6.06 · Genuine 4.33 · WER 0.0% | Target 0.577 · CE 6.00 · Genuine 4.27 · WER 5.6% |
Fixed speaker reference:
| Condition | n | Target score ↑ | Content Enjoyment ↑ | Genuineness ↑ | WER ↓ |
|---|---|---|---|---|---|
| Merged base, no bucket adapter | 4 | 0.151 ± 0.142 | 6.005 ± 0.128 | 4.314 ± 0.330 | 1.67% ± 3.33 |
| Rank32 × 0.5 | 4 | 0.158 ± 0.073 | 6.003 ± 0.140 | 4.405 ± 0.222 | 0.00% ± 0.00 |
| Rank32 × 0.75 | 4 | 0.191 ± 0.080 | 6.104 ± 0.054 | 4.421 ± 0.205 | 0.00% ± 0.00 |
| Rank32 × 1.0 | 4 | 0.163 ± 0.101 | 6.025 ± 0.102 | 4.266 ± 0.345 | 0.00% ± 0.00 |
| Prompt / seed | Merged base · no new LoRA | Rank32 × 0.5 | Rank32 × 0.75 | Rank32 × 1.0 |
|---|---|---|---|---|
| Seed 1701 La puerta sigue abierta. He dejado tu abrigo sobre la silla. Dime cuándo estás listo. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] La puerta sigue abierta. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] He dejado tu abrigo sobre la silla. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Dime cuándo estás listo. | Target 0.051 · CE 5.93 · Genuine 4.18 · WER 0.0% | Target 0.085 · CE 6.06 · Genuine 4.18 · WER 0.0% | Target 0.135 · CE 6.05 · Genuine 4.17 · WER 0.0% | Target 0.121 · CE 5.94 · Genuine 4.02 · WER 0.0% |
| Seed 1702 La puerta sigue abierta. He dejado tu abrigo sobre la silla. Dime cuándo estás listo. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] La puerta sigue abierta. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] He dejado tu abrigo sobre la silla. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Dime cuándo estás listo. | Target 0.072 · CE 5.89 · Genuine 4.00 · WER 6.7% | Target 0.109 · CE 5.81 · Genuine 4.33 · WER 0.0% | Target 0.153 · CE 6.06 · Genuine 4.33 · WER 0.0% | Target 0.104 · CE 6.17 · Genuine 3.94 · WER 0.0% |
| Seed 1701 He encontrado la cajita. Estaba junto a la ventana vieja. Podemos mirar juntos lo que hay dentro. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] He encontrado la cajita. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Estaba junto a la ventana vieja. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Podemos mirar juntos lo que hay dentro. | Target 0.360 · CE 6.17 · Genuine 4.77 · WER 0.0% | Target 0.236 · CE 6.01 · Genuine 4.41 · WER 0.0% | Target 0.310 · CE 6.13 · Genuine 4.61 · WER 0.0% | Target 0.315 · CE 5.98 · Genuine 4.67 · WER 0.0% |
| Seed 1702 He encontrado la cajita. Estaba junto a la ventana vieja. Podemos mirar juntos lo que hay dentro. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] He encontrado la cajita. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Estaba junto a la ventana vieja. (Strong Casual Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Podemos mirar juntos lo que hay dentro. | Target 0.122 · CE 6.03 · Genuine 4.31 · WER 0.0% | Target 0.202 · CE 6.13 · Genuine 4.71 · WER 0.0% | Target 0.164 · CE 6.17 · Genuine 4.57 · WER 0.0% | Target 0.113 · CE 6.00 · Genuine 4.43 · WER 0.0% |