The merged parent used in these specialist comparisons is now released as Humaneness Voice Large 1.6 Alpha: 1.5 + final RealSpeech rank 4, merged once. Apply only the selected new bucket adapter. Do not reload either ancestor.
1.5 Original model · 1.6 merged model · Complete context manuals for humans and agents
Read 1.5 context manual · Read 1.6 + adapter context manual. Exact prompts, CFG, adapter scales and failed gates are retained. New model/documentation contributions: CC BY 4.0; existing upstream and gated specialist terms remain applicable.
The original grid used generic GENERAL/SCRIPT directions at CFG1. It did not systematically use target-specific manual winners. The new study freezes the actual rank-4 manual wording, preserves every literal word, seed, reference, adapter and frame budget, then independently varies CFG and adapter strength. The previous recordings and conclusions remain below.
Ranking:100% requested EARS emotion/style head, standardized using frozen training statistics; low-pole targets reverse the sign. Formal/casual contrasts average the desired head and negative opposite head. CE and genuineness are diagnostics. Higher target z means stronger desired delivery, not a human rating. More CFG is not automatically better.
Selection:20 original-text outcomes per configuration select wording, CFG and scale. Fifty additional unseen-text reference pairs test the frozen choices. A recommended adapter must improve against both the same-CFG no-adapter control and the best manual-only setting. Quality gates: per-take WER≤15%, mean WER≤10%, valid/terminated fraction≥90%, paired identity change≥−0.05 over50pairs. Failed outcomes stay visible. Language-cluster bootstrap intervals use only five fixed reference voices; findings across72targets remain exploratory.
Five languages: EN/DE/FR/NL/ES; original seeds1701/1702; reference187frames/14.96seconds. CFG1/1.25/1.5/2/2.5/3/4/5 × bucket strength0/0.5/0.75/1. CFG4/5 are stress conditions, not presumed improvements. No-reference use of these bucket recommendations has not been validated.
Taxonomy:S_MONO means Monologue, S_TECH means Teacher/Didactic, VOLT means Volatility. The two corrected style recipes and17dimension/contrast recipes are new searches, not historical manual winners.53other targets reuse directly applicable manual recipes.
Best tested agent route: No new configuration passes the held-out gates; retain standard fallback and inspect audio. Bucket scale 0.0, CFG 1.0.
| Held-out condition | n | Target z↑ | Raw head | CE↑ | Genuine↑ | Voice↑ | WER↓ | Valid | QA |
|---|---|---|---|---|---|---|---|---|---|
| standard | 50 | 0.261 | 2.874 | 6.241 | 4.326 | 0.584 | 0.010 | 1.000 | pass |
| manual | 50 | 0.788 | 3.562 | 6.071 | 4.500 | 0.529 | 0.023 | 1.000 | fail |
| adapter | 50 | 0.686 | 3.429 | 6.172 | 4.480 | 0.572 | 0.016 | 1.000 | pass |
| matched_no_adapter | 50 | 0.625 | 3.349 | 6.174 | 4.491 | 0.569 | 0.020 | 0.980 | pass |
Incremental adapter gain versus same-CFG control: 0.061 z;95% cluster interval [-0.03576171592646003, 0.13406738749595548]. Versus best manual-only: -0.102 z. Manual-only versus standard: 0.527 z.
| Scale | CFG | Target z | CE | Genuine | WER | Provisional QA |
|---|---|---|---|---|---|---|
| 0.0 | 1.0 | 0.421 | 6.166 | 4.377 | 0.032 | False |
| 0.5 | 1.0 | 0.435 | 6.185 | 4.381 | 0.024 | False |
| 0.75 | 1.0 | 0.526 | 6.121 | 4.336 | 0.003 | False |
| 1.0 | 1.0 | 0.401 | 6.130 | 4.339 | 0.005 | False |
| 0.0 | 1.25 | 0.418 | 6.159 | 4.424 | 0.014 | False |
| 0.5 | 1.25 | 0.408 | 6.187 | 4.449 | 0.037 | False |
| 0.75 | 1.25 | 0.505 | 6.182 | 4.444 | 0.008 | False |
| 1.0 | 1.25 | 0.545 | 6.179 | 4.411 | 0.009 | True |
| 0.0 | 1.5 | 0.481 | 6.154 | 4.355 | 0.005 | False |
| 0.5 | 1.5 | 0.627 | 6.170 | 4.411 | 0.011 | True |
| 0.75 | 1.5 | 0.533 | 6.186 | 4.388 | 0.024 | False |
| 1.0 | 1.5 | 0.506 | 6.159 | 4.371 | 0.011 | False |
| 0.0 | 2.0 | 0.500 | 6.114 | 4.408 | 0.003 | False |
| 0.5 | 2.0 | 0.559 | 6.129 | 4.435 | 0.005 | True |
| 0.75 | 2.0 | 0.692 | 6.093 | 4.399 | 0.006 | False |
| 1.0 | 2.0 | 0.608 | 6.094 | 4.443 | 0.033 | False |
| 0.0 | 2.5 | 0.523 | 6.131 | 4.451 | 0.003 | False |
| 0.5 | 2.5 | 0.653 | 6.121 | 4.422 | 0.019 | False |
| 0.75 | 2.5 | 0.491 | 6.084 | 4.405 | 0.008 | False |
| 1.0 | 2.5 | 0.661 | 6.122 | 4.446 | 0.008 | False |
| 0.0 | 3.0 | 0.861 | 6.097 | 4.492 | 0.014 | True |
| 0.5 | 3.0 | 0.816 | 6.096 | 4.485 | 0.009 | True |
| 0.75 | 3.0 | 0.605 | 6.074 | 4.387 | 0.051 | False |
| 1.0 | 3.0 | 0.658 | 6.074 | 4.371 | 0.010 | False |
| 0.0 | 4.0 | 0.865 | 6.024 | 4.500 | 0.025 | False |
| 0.5 | 4.0 | 0.851 | 6.041 | 4.480 | 0.027 | False |
| 0.75 | 4.0 | 0.756 | 5.983 | 4.467 | 0.012 | False |
| 1.0 | 4.0 | 0.700 | 6.006 | 4.410 | 0.008 | False |
| 0.0 | 5.0 | 0.889 | 6.010 | 4.496 | 0.044 | True |
| 0.5 | 5.0 | 0.791 | 5.959 | 4.469 | 0.023 | False |
| 0.75 | 5.0 | 0.724 | 5.917 | 4.415 | 0.033 | False |
| 1.0 | 5.0 | 0.745 | 5.955 | 4.457 | 0.019 | False |
direct_manual_recipe
{
"id": "manual-ea97be76622a",
"general": "Craft the delivery to sound like a participant in a deep, meandering thought process shared with a trusted confidant.",
"inline": [
"Employ slight vocal breathiness during transitions to mimic natural thought retrieval.",
"Vary the projection level slightly, moving between confidential softness and moderate conversational volume.",
"Ensure the ending trails off with a sense of unresolved, natural continuation, inviting further response."
],
"cfg": 3,
"recipe": "P06",
"strategy": "local-Gemma-mutation",
"timing_syntax": "canonical",
"canonical_labels": true,
"neutral_event": "keep",
"parent": "cfg-3",
"origin": "exact_frozen_manual_recipe"
}Exact machine-readable comparison · Agent tool recommendations
Strong Conversational Style. Base: 1.5 Alpha + merged real-speech rank4; new adapter: rank32. Every row is a matched seed/text/reference test. Scale zero disables the new adapter; all other scales are applied absolutely, never compounded.
Adapter training data: {"fr": 65, "nl": 23, "es": 39, "de": 34, "en": 23}. All available accepted languages were pooled, globally shuffled, for three epochs. Peak LR 2e-05 at the end of the first-epoch warmup, then cosine decay. All original optimizer/RNG checkpoints remain saved.
Taxonomy: S_MONO is monologue, not monotone; VOLT is volatility, not volume. No claim is made that a classifier score alone proves the audible performance.
| Condition | n | Target score ↑ | Content Enjoyment ↑ | Genuineness ↑ | WER ↓ |
|---|---|---|---|---|---|
| Merged base, no bucket adapter | 20 | 0.525 ± 0.143 | 6.192 ± 0.122 | 4.296 ± 0.248 | 0.00% ± 0.00 |
| Rank32 × 0.5 | 20 | 0.613 ± 0.163 | 6.174 ± 0.127 | 4.378 ± 0.277 | 0.00% ± 0.00 |
| Rank32 × 0.75 | 20 | 0.575 ± 0.139 | 6.194 ± 0.112 | 4.320 ± 0.194 | 0.87% ± 2.15 |
| Rank32 × 1.0 | 20 | 0.524 ± 0.187 | 6.137 ± 0.108 | 4.247 ± 0.201 | 0.53% ± 2.35 |
Fixed speaker reference:
| Condition | n | Target score ↑ | Content Enjoyment ↑ | Genuineness ↑ | WER ↓ |
|---|---|---|---|---|---|
| Merged base, no bucket adapter | 4 | 0.601 ± 0.214 | 6.273 ± 0.060 | 4.197 ± 0.344 | 0.00% ± 0.00 |
| Rank32 × 0.5 | 4 | 0.585 ± 0.143 | 6.225 ± 0.091 | 4.148 ± 0.363 | 0.00% ± 0.00 |
| Rank32 × 0.75 | 4 | 0.615 ± 0.090 | 6.249 ± 0.057 | 4.225 ± 0.150 | 0.00% ± 0.00 |
| Rank32 × 1.0 | 4 | 0.553 ± 0.258 | 6.213 ± 0.028 | 4.168 ± 0.314 | 0.00% ± 0.00 |
| Prompt / seed | Merged base · no new LoRA | Rank32 × 0.5 | Rank32 × 0.75 | Rank32 × 1.0 |
|---|---|---|---|---|
| Seed 1701 The door is still open. I put your coat on the chair. Tell me when you are ready. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] The door is still open. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] I put your coat on the chair. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Tell me when you are ready. | Target 0.306 · CE 6.21 · Genuine 3.74 · WER 0.0% | Target 0.431 · CE 6.18 · Genuine 3.90 · WER 0.0% | Target 0.617 · CE 6.24 · Genuine 4.12 · WER 0.0% | Target 0.461 · CE 6.24 · Genuine 4.12 · WER 0.0% |
| Seed 1702 The door is still open. I put your coat on the chair. Tell me when you are ready. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] The door is still open. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] I put your coat on the chair. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Tell me when you are ready. | Target 0.587 · CE 6.24 · Genuine 4.12 · WER 0.0% | Target 0.494 · CE 6.12 · Genuine 3.80 · WER 0.0% | Target 0.492 · CE 6.21 · Genuine 4.07 · WER 0.0% | Target 0.230 · CE 6.18 · Genuine 3.75 · WER 0.0% |
| Seed 1701 I found the little box. It was beside the old window. We can look inside together. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] I found the little box. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] It was beside the old window. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] We can look inside together. | Target 0.785 · CE 6.35 · Genuine 4.47 · WER 0.0% | Target 0.708 · CE 6.31 · Genuine 4.58 · WER 0.0% | Target 0.643 · CE 6.33 · Genuine 4.36 · WER 0.0% | Target 0.775 · CE 6.24 · Genuine 4.48 · WER 0.0% |
| Seed 1702 I found the little box. It was beside the old window. We can look inside together. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] I found the little box. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] It was beside the old window. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] We can look inside together. | Target 0.726 · CE 6.29 · Genuine 4.46 · WER 0.0% | Target 0.705 · CE 6.29 · Genuine 4.31 · WER 0.0% | Target 0.706 · CE 6.22 · Genuine 4.35 · WER 0.0% | Target 0.747 · CE 6.20 · Genuine 4.32 · WER 0.0% |
Fixed speaker reference:
| Condition | n | Target score ↑ | Content Enjoyment ↑ | Genuineness ↑ | WER ↓ |
|---|---|---|---|---|---|
| Merged base, no bucket adapter | 4 | 0.556 ± 0.171 | 6.328 ± 0.150 | 4.504 ± 0.093 | 0.00% ± 0.00 |
| Rank32 × 0.5 | 4 | 0.583 ± 0.150 | 6.322 ± 0.090 | 4.467 ± 0.135 | 0.00% ± 0.00 |
| Rank32 × 0.75 | 4 | 0.514 ± 0.068 | 6.313 ± 0.106 | 4.212 ± 0.129 | 0.00% ± 0.00 |
| Rank32 × 1.0 | 4 | 0.538 ± 0.134 | 6.213 ± 0.125 | 4.369 ± 0.104 | 0.00% ± 0.00 |
| Prompt / seed | Merged base · no new LoRA | Rank32 × 0.5 | Rank32 × 0.75 | Rank32 × 1.0 |
|---|---|---|---|---|
| Seed 1701 Die Tür ist noch offen. Ich habe deinen Mantel auf den Stuhl gelegt. Sag mir, wenn du bereit bist. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Die Tür ist noch offen. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Ich habe deinen Mantel auf den Stuhl gelegt. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Sag mir, wenn du bereit bist. | Target 0.788 · CE 6.36 · Genuine 4.61 · WER 0.0% | Target 0.605 · CE 6.19 · Genuine 4.37 · WER 0.0% | Target 0.600 · CE 6.24 · Genuine 4.19 · WER 0.0% | Target 0.592 · CE 6.13 · Genuine 4.33 · WER 0.0% |
| Seed 1702 Die Tür ist noch offen. Ich habe deinen Mantel auf den Stuhl gelegt. Sag mir, wenn du bereit bist. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Die Tür ist noch offen. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Ich habe deinen Mantel auf den Stuhl gelegt. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Sag mir, wenn du bereit bist. | Target 0.566 · CE 6.11 · Genuine 4.52 · WER 0.0% | Target 0.760 · CE 6.35 · Genuine 4.63 · WER 0.0% | Target 0.529 · CE 6.21 · Genuine 4.27 · WER 0.0% | Target 0.672 · CE 6.11 · Genuine 4.42 · WER 0.0% |
| Seed 1701 Ich habe die kleine Schachtel gefunden. Sie stand neben dem alten Fenster. Wir können gemeinsam hineinschauen. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Ich habe die kleine Schachtel gefunden. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Sie stand neben dem alten Fenster. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Wir können gemeinsam hineinschauen. | Target 0.392 · CE 6.44 · Genuine 4.51 · WER 0.0% | Target 0.395 · CE 6.39 · Genuine 4.34 · WER 0.0% | Target 0.440 · CE 6.41 · Genuine 4.04 · WER 0.0% | Target 0.357 · CE 6.24 · Genuine 4.24 · WER 0.0% |
| Seed 1702 Ich habe die kleine Schachtel gefunden. Sie stand neben dem alten Fenster. Wir können gemeinsam hineinschauen. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Ich habe die kleine Schachtel gefunden. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Sie stand neben dem alten Fenster. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Wir können gemeinsam hineinschauen. | Target 0.476 · CE 6.40 · Genuine 4.38 · WER 0.0% | Target 0.570 · CE 6.36 · Genuine 4.52 · WER 0.0% | Target 0.488 · CE 6.40 · Genuine 4.34 · WER 0.0% | Target 0.532 · CE 6.38 · Genuine 4.48 · WER 0.0% |
Fixed speaker reference:
| Condition | n | Target score ↑ | Content Enjoyment ↑ | Genuineness ↑ | WER ↓ |
|---|---|---|---|---|---|
| Merged base, no bucket adapter | 4 | 0.526 ± 0.106 | 6.176 ± 0.027 | 4.391 ± 0.239 | 0.00% ± 0.00 |
| Rank32 × 0.5 | 4 | 0.652 ± 0.169 | 6.193 ± 0.047 | 4.539 ± 0.185 | 0.00% ± 0.00 |
| Rank32 × 0.75 | 4 | 0.585 ± 0.132 | 6.150 ± 0.122 | 4.451 ± 0.217 | 1.32% ± 2.63 |
| Rank32 × 1.0 | 4 | 0.617 ± 0.143 | 6.098 ± 0.085 | 4.382 ± 0.163 | 2.63% ± 5.26 |
| Prompt / seed | Merged base · no new LoRA | Rank32 × 0.5 | Rank32 × 0.75 | Rank32 × 1.0 |
|---|---|---|---|---|
| Seed 1701 La porte est encore ouverte. J’ai posé ton manteau sur la chaise. Dis-moi quand tu es prêt. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] La porte est encore ouverte. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] J’ai posé ton manteau sur la chaise. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Dis-moi quand tu es prêt. | Target 0.368 · CE 6.20 · Genuine 4.06 · WER 0.0% | Target 0.446 · CE 6.16 · Genuine 4.31 · WER 0.0% | Target 0.492 · CE 6.04 · Genuine 4.21 · WER 0.0% | Target 0.471 · CE 6.21 · Genuine 4.17 · WER 0.0% |
| Seed 1702 La porte est encore ouverte. J’ai posé ton manteau sur la chaise. Dis-moi quand tu es prêt. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] La porte est encore ouverte. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] J’ai posé ton manteau sur la chaise. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Dis-moi quand tu es prêt. | Target 0.571 · CE 6.20 · Genuine 4.43 · WER 0.0% | Target 0.611 · CE 6.22 · Genuine 4.53 · WER 0.0% | Target 0.452 · CE 6.18 · Genuine 4.36 · WER 0.0% | Target 0.525 · CE 6.02 · Genuine 4.34 · WER 0.0% |
| Seed 1701 J’ai trouvé la petite boîte. Elle était près de la vieille fenêtre. Nous pouvons regarder ensemble ce qu’elle contient. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] J’ai trouvé la petite boîte. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Elle était près de la vieille fenêtre. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Nous pouvons regarder ensemble ce qu’elle contient. | Target 0.561 · CE 6.17 · Genuine 4.46 · WER 0.0% | Target 0.704 · CE 6.15 · Genuine 4.56 · WER 0.0% | Target 0.701 · CE 6.31 · Genuine 4.53 · WER 0.0% | Target 0.701 · CE 6.11 · Genuine 4.53 · WER 0.0% |
| Seed 1702 J’ai trouvé la petite boîte. Elle était près de la vieille fenêtre. Nous pouvons regarder ensemble ce qu’elle contient. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] J’ai trouvé la petite boîte. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Elle était près de la vieille fenêtre. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Nous pouvons regarder ensemble ce qu’elle contient. | Target 0.603 · CE 6.14 · Genuine 4.62 · WER 0.0% | Target 0.849 · CE 6.25 · Genuine 4.76 · WER 0.0% | Target 0.697 · CE 6.07 · Genuine 4.71 · WER 5.3% | Target 0.773 · CE 6.05 · Genuine 4.48 · WER 10.5% |
Fixed speaker reference:
| Condition | n | Target score ↑ | Content Enjoyment ↑ | Genuineness ↑ | WER ↓ |
|---|---|---|---|---|---|
| Merged base, no bucket adapter | 4 | 0.437 ± 0.112 | 6.110 ± 0.071 | 4.115 ± 0.122 | 0.00% ± 0.00 |
| Rank32 × 0.5 | 4 | 0.683 ± 0.155 | 6.110 ± 0.081 | 4.339 ± 0.102 | 0.00% ± 0.00 |
| Rank32 × 0.75 | 4 | 0.690 ± 0.134 | 6.134 ± 0.055 | 4.374 ± 0.127 | 1.39% ± 2.78 |
| Rank32 × 1.0 | 4 | 0.521 ± 0.262 | 6.142 ± 0.051 | 4.209 ± 0.054 | 0.00% ± 0.00 |
| Prompt / seed | Merged base · no new LoRA | Rank32 × 0.5 | Rank32 × 0.75 | Rank32 × 1.0 |
|---|---|---|---|---|
| Seed 1701 De deur staat nog open. Ik heb je jas op de stoel gelegd. Zeg maar wanneer je klaar bent. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] De deur staat nog open. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Ik heb je jas op de stoel gelegd. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Zeg maar wanneer je klaar bent. | Target 0.347 · CE 6.07 · Genuine 4.03 · WER 0.0% | Target 0.555 · CE 6.19 · Genuine 4.31 · WER 0.0% | Target 0.729 · CE 6.10 · Genuine 4.21 · WER 0.0% | Target 0.759 · CE 6.08 · Genuine 4.27 · WER 0.0% |
| Seed 1702 De deur staat nog open. Ik heb je jas op de stoel gelegd. Zeg maar wanneer je klaar bent. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] De deur staat nog open. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Ik heb je jas op de stoel gelegd. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Zeg maar wanneer je klaar bent. | Target 0.423 · CE 6.03 · Genuine 4.02 · WER 0.0% | Target 0.856 · CE 6.11 · Genuine 4.21 · WER 0.0% | Target 0.773 · CE 6.09 · Genuine 4.42 · WER 0.0% | Target 0.712 · CE 6.13 · Genuine 4.23 · WER 0.0% |
| Seed 1701 Ik heb het kleine doosje gevonden. Het stond naast het oude raam. We kunnen er samen in kijken. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Ik heb het kleine doosje gevonden. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Het stond naast het oude raam. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] We kunnen er samen in kijken. | Target 0.599 · CE 6.17 · Genuine 4.28 · WER 0.0% | Target 0.771 · CE 6.00 · Genuine 4.39 · WER 0.0% | Target 0.491 · CE 6.13 · Genuine 4.36 · WER 5.6% | Target 0.207 · CE 6.20 · Genuine 4.14 · WER 0.0% |
| Seed 1702 Ik heb het kleine doosje gevonden. Het stond naast het oude raam. We kunnen er samen in kijken. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Ik heb het kleine doosje gevonden. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Het stond naast het oude raam. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] We kunnen er samen in kijken. | Target 0.380 · CE 6.17 · Genuine 4.13 · WER 0.0% | Target 0.549 · CE 6.14 · Genuine 4.44 · WER 0.0% | Target 0.766 · CE 6.21 · Genuine 4.51 · WER 0.0% | Target 0.404 · CE 6.17 · Genuine 4.19 · WER 0.0% |
Fixed speaker reference:
| Condition | n | Target score ↑ | Content Enjoyment ↑ | Genuineness ↑ | WER ↓ |
|---|---|---|---|---|---|
| Merged base, no bucket adapter | 4 | 0.504 ± 0.106 | 6.074 ± 0.024 | 4.274 ± 0.251 | 0.00% ± 0.00 |
| Rank32 × 0.5 | 4 | 0.564 ± 0.242 | 6.017 ± 0.067 | 4.398 ± 0.418 | 0.00% ± 0.00 |
| Rank32 × 0.75 | 4 | 0.472 ± 0.188 | 6.124 ± 0.100 | 4.336 ± 0.285 | 1.67% ± 3.33 |
| Rank32 × 1.0 | 4 | 0.390 ± 0.102 | 6.019 ± 0.109 | 4.104 ± 0.186 | 0.00% ± 0.00 |
| Prompt / seed | Merged base · no new LoRA | Rank32 × 0.5 | Rank32 × 0.75 | Rank32 × 1.0 |
|---|---|---|---|---|
| Seed 1701 La puerta sigue abierta. He dejado tu abrigo sobre la silla. Dime cuándo estás listo. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] La puerta sigue abierta. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] He dejado tu abrigo sobre la silla. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Dime cuándo estás listo. | Target 0.400 · CE 6.06 · Genuine 3.96 · WER 0.0% | Target 0.392 · CE 6.11 · Genuine 4.24 · WER 0.0% | Target 0.256 · CE 6.04 · Genuine 4.01 · WER 6.7% | Target 0.245 · CE 6.03 · Genuine 3.91 · WER 0.0% |
| Seed 1702 La puerta sigue abierta. He dejado tu abrigo sobre la silla. Dime cuándo estás listo. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] La puerta sigue abierta. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] He dejado tu abrigo sobre la silla. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Dime cuándo estás listo. | Target 0.482 · CE 6.06 · Genuine 4.22 · WER 0.0% | Target 0.320 · CE 6.00 · Genuine 3.88 · WER 0.0% | Target 0.407 · CE 6.19 · Genuine 4.21 · WER 0.0% | Target 0.409 · CE 5.86 · Genuine 3.98 · WER 0.0% |
| Seed 1701 He encontrado la cajita. Estaba junto a la ventana vieja. Podemos mirar juntos lo que hay dentro. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] He encontrado la cajita. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Estaba junto a la ventana vieja. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Podemos mirar juntos lo que hay dentro. | Target 0.651 · CE 6.06 · Genuine 4.55 · WER 0.0% | Target 0.769 · CE 6.01 · Genuine 4.80 · WER 0.0% | Target 0.700 · CE 6.04 · Genuine 4.66 · WER 0.0% | Target 0.424 · CE 6.06 · Genuine 4.24 · WER 0.0% |
| Seed 1702 He encontrado la cajita. Estaba junto a la ventana vieja. Podemos mirar juntos lo que hay dentro. Exact GENERAL / SCRIPT promptGENERAL: One adult speaker in a clean recording. Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word. SCRIPT: (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] He encontrado la cajita. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.8 seconds duration] Estaba junto a la ventana vieja. (Strong Conversational Style. Make the requested delivery clearly audible, not merely implied by the words. Preserve every word.) [3.2 seconds duration] Podemos mirar juntos lo que hay dentro. | Target 0.481 · CE 6.11 · Genuine 4.38 · WER 0.0% | Target 0.776 · CE 5.95 · Genuine 4.67 · WER 0.0% | Target 0.526 · CE 6.23 · Genuine 4.47 · WER 0.0% | Target 0.483 · CE 6.12 · Genuine 4.28 · WER 0.0% |