updated metrics and figures for all chat-finetuned model runs

data/metrics/lyre-chat-small-batch-checkpoint-150-temp-1-test-outputs_scores.json

@@ -1517,15 +1517,15 @@
  "target_response":"[Intro]\n(\nI love you, Atake\n)\n[Chorus: Quavo]\nHe want the scoop, she want the tea\n (She want the tea)\nI cannot speak, we keepin' it street (We keepin' it street)\nI took a loss, but you still gon' get beat (You still gon' get beat)\nHow much it cost? It never been cheap (It never been)\nTurn your clique up, dog (Turn 'em up)\nTurn your bitch up, dog (Turn her up)\nTying these streets, can't cross it (Cross 'em up)\nAll these streets need bosses (Boss 'em up)\nTurn your clique up, dog (Turn 'em up)\nTurn your bitch up, dog (Turn her up)\nTying these streets, can't cross it (Cross 'em up)\nAll these streets need bosses (Go)\n[Verse 1: Quavo]\nIf my dog get low on his pockets, I'm pickin' him up (Soo)\nWe came from the bottom together, my nigga, we get it, we splittin' it up\nIf my bitch tell me pay for that pussy, I take her ass shoppin' and tell her, \"Shut up\" (Shh)\nStandin' on business, standin' on bitches, ain't nothin' to pipe that shit up (Soo)\nIt ain't nothin' to turn a bitch up\nIt ain't nothin' to turn your clique up (Ain't nothin')\nShit, we turned the jeweler up, just look at the diamonds we bust (Yeah)\nLook at the people we touched, shit, I'm feelin' like Puffy and Russ' (Yeah)\nI'm sendin' this shit like a toilet, lil' nigga so nasty, I never been flushed (Ugh, nasty, go)\nBulletproof Brabus, it came with a kit on it (Kit, skrrt, skrrt)\nThe switch is too light, it kick if you spit on it (Kick, frr, grrah, frr)\nHundreds of bands, I put that lil' shit on 'em (Shit, hee, ooh, hee)\nDope in my hand, I had to go flip somethin' (Flip it, flip, go, it's gone) [Chorus: Quavo]\nHe want the scoop, she want the tea (She want the tea)\nI cannot speak, we keepin' it street (We keepin' it street)\nI took a loss, but you still gon' get beat (You still gon' get beat)\nHow much it cost? It never been cheap (It never been)\nTurn your clique up, dog (Turn 'em up)\nTurn your bitch up, dog (Turn her up)\nTying these streets, can't cross it (Cross 'em up)\nAll these streets need bosses (Boss 'em up)\nTurn your clique up, dog (Turn 'em up)\nTurn your bitch up, dog (Turn her up)\nTying these streets, can't cross it (Cross 'em up)\nAll these streets need bosses (Boss 'em up)\n[Verse 2: Future]\nBig dog status, Bal Harbour\nI ball, Lenox mall for my brothers\nGoyard bag, tote the cutter\nI got it out the field, fuck Russell\nGo and ask Lori about the Patek\nThen go and ask Joie and ask Dess\nPhilippe water, tryna drown a bitch\nIt's a habit trickin' on a bitch\nShit, I'm thinkin' I could've been a pimp\nShit, I'm cookin' up dope like it's dinner\nShit, I come from Zone 6, nigga trim\nShit, I'm floatin', I'm higher than a blimp\nShit, it look like I'm swimmin' in glass\nShit, I turn up my bitch 'cause she bad\nShit, I'm makin' her ex-nigga mad\nShit, they go for that bag, I'ma spaz\nReal nigga alert, I'm securin' the bag\nPipin' a bitch, it ain't nothin', I got cash\nTurn up the shooters with switches, go bad\nStay with some scammers, my dog movin' packs\nTrappin' to rappin', my dog, he fall off, no cappin', I'm buyin' him a brick\nFuck on your bitch, then I told her to call off, actually, I'm makin' her quit\nPainkillers got my lil' demons on go, they ready to hit with the stick\nPainkillers got my lil' bitch on go, she ready to eat up the dick\nMy main hitters, call up the gang members, they was already on a lick\nHangin' with Migos, all these drugs and guns, think we Mexican\n \n(Freebandz) [Chorus: Quavo]\nHe want the scoop, she want the tea (She want the tea)\nI cannot speak, we keepin' it street (We keepin' it street)\nI took a loss, but you still gon' get beat (You still gon' get beat)\nHow much it cost? It never been cheap (It never been)\nTurn your clique up, dog (Turn 'em up)\nTurn your bitch up, dog (Turn her up)\nTying these streets, can't cross it (Cross 'em up)\nAll these streets need bosses (Boss 'em up)\nTurn your clique up, dog (Turn 'em up)\nTurn your bitch up, dog (Turn her up)\nTying these streets, can't cross it (Cross 'em up)\nAll these streets need bosses (Boss 'em up)",
  "model_response":"[Intro]\nYeah, Pi'erre, you wanna come out here?\nOh, you wanna come out here?\nYeah\n[Chorus]\nYou're either on my dick or on my nip\nYou ain't in the middle, it's quit or I trip\nI fuck with my gang, I fuck with my clique\nFuck with me, on God\nIt cost to be me, on God\nIt cost to be me, on God\nIt cost to be me\n[Verse]\nTurn my swag on, I got your girl on tap\nMoney on my mind, Pi'erre, where my bricks at?\nDon't wanna walk around, keep my nina at bay\nFuckin' with my reup, nigga, I'm a hustler\nGet your bitch, get your bitch, get your bitch, get your bitch\nFuck with my reup, nigga, I'm a hustler\nGet your bitch, get your bitch, get your bitch, get your bitch\nIt cost to be me, on God\nIt cost to be me, on God\nIt cost to be me, on God\n[Bridge]\nYeah, yeah, yeah\nBridge: Pi'erre, Pi'erre, where your bricks at?\nWhere your bricks, where your bricks, where your bricks at?\nPi'erre, Pi'erre, where your bricks at?\nWhere your bricks, where your bricks, where your bricks at? [Outro]\nFuck with my reup, nigga, I'm a hustler\nGet your bitch, get your bitch, get your bitch, get your bitch\nFuck with my reup, nigga, I'm a hustler\nGet your bitch, get your bitch, get your bitch, get your bitch\nIt cost to be me, on God\nIt cost to be me, on God\nIt cost to be me, on God",
  "pred_scores":{
- "diversity":-0.20801491640383313,
- "syllable":0,
- "meter":0,
- "semantics":0,
- "semantics_internal":0.6910500407218934,
- "string_similarity":0,
- "tail_similarity":0,
- "head_similarity":0,
- "phonetics":0
+ "diversity":-0.18003495076667622,
+ "syllable":0.875,
+ "meter":9.666666666666666,
+ "semantics":1.245263934135437,
+ "semantics_internal":0.5422162661949793,
+ "string_similarity":1.9375,
+ "tail_similarity":1.0,
+ "head_similarity":1.0909090909090908,
+ "phonetics":4.0
  },
  "target_scores":{
  "diversity":-0.40755369878007836,

data/metrics/lyre-chat-small-batch-checkpoint-150-test-outputs_scores.json

@@ -1097,11 +1097,11 @@
  "target_response":"[Intro]\nIn God's hands\n \n(\nConductor\n)\nBe\n grateful\nThat He was there\nGlory\n (Yeah)\nI'm out here on the road\nYou can hear it in the voice \n(\nGlory\n)\nStill get this shit off, though\nLook\n[Verse 1]\nThe money speakin' for itself, I call it fortune-tell\nFire top from a bitch that work at corporate sales\nChinchilla ushanka, we skiin' out in Courchevel\nBreakin' news, they tried to kill him, but the boy prevails\nI leave for tour and my niggas fuckin' go to jail\nPreachin' to the dogs 'bout wantin' more for themselves\nIt's weighin' heavy on my moral scale\nKnowin' they gon' sell another citizen 'caine, they think they Orson Welles\nWalk in Chanel, they like, \"How the fuck you need more Chanel?\"\nI got these cats tuckin' tails on fourth-quarter sales\nI'm used to seein' tears drop over enormous meals\nThe restaurant clears out, faint echoes of\n \nLauryn Hill\nI say, \"We gotta talk about us,\" I feel like Jordan Peele\nCould tell I'm gettin' under your skin like a orange peel\n'Cause your words don't match your actions like a foreign film\nAnd now it's silence in the Lamb' like the horror film\nThings get quiet after me statin' the obvious\nThings get kinky after fifteen years of dominance\nThat October sky is lookin' ominous\nThe money is autonomous\nShout' to Oliver North, he out in Rome doin' Toronto shit\nAnd Jeremiah the watchdog, you niggas know what time it is\nI'm in and out of Houston Hobby so much, I'm a hobbyist\nHoes waitin' on Cench in the lobby, that boy a lobbyist\nSavage got a green card straight out of the consulate\nWhere I go, you go, brother, we Yugoslavian\nFormal is the dress code, dawg, so many checks owed\nI feel Czechoslovakian, nigga, what the fuck? [Interlude]\nNah, I'm movin' different right now, for real, like\nI feel like if Mike switched out the glove for the pen, like\nThis shit just too enticing right now, you know?\nLook\n[Verse 2]\nDiamonds do the silly dance, I raise up the wine glass\nMetal detectors beepin' and security bypass\nThe numbers goin' up, someone pull up the line graph\nThe days are goin' by, it's like I'm livin' in time-lapse\nBeen talkin' to Adel like he majored in finance\nShania Twain, notepad, I'm makin' it line-dance\nYou tryna rob me, and it's gon' feel like you sittin' at your favorite restaurant 'cause, nigga, that's where you dyin' at\nMob ties, I swear we like a bitch with fine sisters and fine cousins, the family all bad\nI'm preachin' to the dawgs about cleanin' they images\nI swear I'm like a young T.D. Jakes to my menaces\nLong-kiss goodnight, PDA for my nemesis\nThree hunnid acres, PGA on the premises\nThat's what's really brackin' like this verse in parentheses\nI'm givin' hits to niggas on some, don't even mention it\n[Interlude]\nLike, don't even worry about it, like\nYou can hit me back whenever, or\nOr don't, you know?\nIt is what it is, I guess\nYeah, hm\nLook [Verse 3]\nYou young boys take some of that money and set it aside\nNot havin' enough to pay your tax is a federal crime\nYou niggas obsessed with me, and it's not on no hetero vibe\nHandle beef so quiet, you think that I'm lettin' it slide\nNext thing you know, we tip-toein' past enemy lines\nDiss me so long ago, we making your memories fly\nConspiracy theories start floatin' 'round like the Kennedy guy\nI'll prolly hold a grudge against you guys 'til I'm seventy-five\nAyy, niggas lyin' for a livin', I couldn't relate\nWe all gotta lay in the bed we make, but that couldn't be Drake\nYou forced a lot of fake love when real ones stood in your face\nThat's why you got deserted by your niggas like puddin' and cake\nI got you on camera bowin' down, but the footage is safe\nThank God, another USB to put in the safe\nThank God, at the crib, dippin' my foot in the lake\nI swear that y'all turned me into the villain, I couldn't escape\nNot sayin' I'm the best at what I do\nI'm just sayin' that it's me versus whoever wanna lose\nPick any one of the Who's Whos, I got .22s for new crews\nR.I.P. to the DJ from Houston, we loose screws\nHelicopters, cop lights, and news crews\nNiggas steady cryin' to my daddy, well, boo-hoo\nYou prolly heard a lot about the boy, well, true, true, haha\n[Outro]\n(\nIn God's hands\n) Yeah\n(\nBe grateful\n)\n(\nThat He was there\n)",
  "model_response":"[Intro]\nYeah, running out of characters, but I'm still writing\nOh, yeah, yeah, yeah, yeah, yeah, yeah, yeah\n[Verse 1]\nNever question my flow for the life of me\nI'd give it back if I knew how to give it\nAnd you could have it if you knew how to take it\nIt's not about the size of the nina\n \n(Haha, yeah)\nIt's about how you move, yeah\nAnd right now my tune is on replay\nI think it's safe to say that I'm the number one spitter\nOut of all the Drake haters, I outsold all of 'em\nRappers will say that they are the greatest\nBut you know that the greatest is yet to come\nAnd when that day comes, I'ma still be here\nWhen all the smoke has cleared, I'ma still be clear\nYou see I've been preparing for this moment\nIn the off-season of my career\nAnd it's not a problem, I'll outlast all of 'em\nI'll outfuck, outlast, outparty, outblaze\nOutro: \"Outlast\" by Drake\n[Produced by Noah \"October Firm\" Fisher, Pierre \"Pierre Bourne\" Burns, and Frank \"The Butcher\" Dukes]",
  "pred_scores":{
- "diversity":-0.4486166781325567,
+ "diversity":-0.2911615172028717,
  "syllable":0,
  "meter":0,
  "semantics":0,
- "semantics_internal":0.7539340853691101,
+ "semantics_internal":0.5023893117904663,
  "string_similarity":0,
  "tail_similarity":0,
  "head_similarity":0,