LLM-performance metrics, help much appreciated!
2024.11.26 12:20 xTuukkazz LLM-performance metrics, help much appreciated!
Hi everybody, I am working on a thesis reviewing the feasibility of different LLMs across hardware configurations from an organizational point-of-view. The aim is to research the cost-effectiveness of deploying different tiers of LLMs within an organization. Practical benchmarks of how different combinations of hardware and models perform in practise are an important part of this process, as it offers a platform for practical suggestions.
Due to limited access to hardware, I would be highly appreciative of anyone willing to help me out and provide me some basic performance metrics of the following LLMs on different hardware solutions.
- Gemma 2B Instruct Q4_K_M
- LLAMA 3.2 8B Instruct Q4 K_M
- LLAMA 3.1 70B Instruct Q4 K_M
If interested to help, please provide me with the following information:
- Token/s per given prompt (if a model doesn't run, please mention this)
- Utilized hardware solution + software solution (for instance RTX 4090 + CUDA, 7900XTX + ROCm, M3 + Metal etc.)
For benchmarking these models, please use the following prompt for consistency:
- Write a story that is a 1000 words or less, which tells the story of a man who comes up with a revolutionary new way to use artificial intelligence, changing the world in the process.
Thank you in advance!
submitted by xTuukkazz to LocalLLM [link] [comments]
2024.11.26 12:20 Nokqua 9 months in, Nordic Hair Malmö 2500 Grafts
 | submitted by Nokqua to HairTransplants [link] [comments] |
2024.11.26 12:20 IanRedfern-Smith Mega Ampharos raid please join. Add me - 727246587139
submitted by IanRedfern-Smith to PokemonGoRaids [link] [comments]
2024.11.26 12:20 Ok_Requirement9198 Meme
submitted by Ok_Requirement9198 to DragonAgeVeilguard [link] [comments]
2024.11.26 12:20 Icy-One-5297 Chum vs Shrutika.. maybe Shru wants Chum to avoid Karan
 | submitted by Icy-One-5297 to biggboss [link] [comments] |
2024.11.26 12:20 KSmoria Do you value Pack Hourglasses or Wonder Pick Hourglasses more ?
I would argue it's not a clear answer. In the shop they have the exact same stock and cost and we get about the same amount of each one from events.
But which would you choose if you had the choice ?
Pack Hourglasses are great way for filling a collection with most cards in a set and you'll get a decent amount of Ex, but maybe not the ones you want. So, in the start of a set, I prefer having Pack Hourglasses.
But after I have opened a good amount of packs (say 40-60) of each pack and I'm missing only some Ex, suddenly Wonder Pick Hourglasses have much more value.
To put it into numbers. You would need to open 60 packs on average if you were aiming on a specific (based on the in-game pull rates).
But if you're focusing on getting your last remaining Ex from Wonder Picks, you would need to do 5 Pulls for each of them on average which is 180 Wonder Pick Hourglasses.
Of course opening packs has other bonuses too, like pack points, random foils, random Ex's. So it all depends on how close you are at completing your collection and how high you value foil cards and duicates.
submitted by KSmoria to PTCGP [link] [comments]
2024.11.26 12:20 Tarmogoyf_ Pwned
submitted by Tarmogoyf_ to thatsmyplaymat [link] [comments]
2024.11.26 12:20 Weak-Possession-417 What is this?
This post contains content not supported on old Reddit. Click here to view the full post
submitted by Weak-Possession-417 to Pixelary [link] [comments]
2024.11.26 12:20 Ookamilife Free pics to use.
 | Have fun with em. submitted by Ookamilife to JanitorAI_Official [link] [comments] |
2024.11.26 12:20 jvc72 Buy Signal Sparebanken Sor - 26 nov 2024 @ 13:02 -> NOK188.38
Ticker: SOR.OL
Exchange: OSL
Time: 26 nov 2024 @ 13:02
Price: NOK188.38
Link: https://getagraph.com/OSL/stock/live-signals/SOR.OL/ENG
submitted by jvc72 to getagraph [link] [comments]
2024.11.26 12:20 IncestActressFamily Renuka Chopade [new]
![Renuka Chopade [new]](https://b.thumbs.redditmedia.com/RFQ0EHw7-tbPgmsotp-uu50039mX5lKMsaGrUciBdII.jpg "Renuka Chopade [new]") | submitted by IncestActressFamily to Madak_Marathi_Heroine [link] [comments] |
2024.11.26 12:20 eschatonbringer i want a trans gf who's also mentally ill and likes parapolitics and trashy movies
unironically
submitted by eschatonbringer to rs_x [link] [comments]
2024.11.26 12:20 Altruistic_Steak4688 Surprise Surprise
 | submitted by Altruistic_Steak4688 to thefinals [link] [comments] |
2024.11.26 12:20 Economy-Law-7626 Cap cutoffs for category students this year?
Hel
submitted by Economy-Law-7626 to CATpreparation [link] [comments]
2024.11.26 12:20 MinecReddit Am I still fat? Need to lose more weight?
 | submitted by MinecReddit to amIfatBrutallyHonest [link] [comments] |
2024.11.26 12:20 ziimag Cable in MKE-400- microphopne got stuck, can't unscrew it
 | https://preview.redd.it/6txinav9n83e1.png?width=490&format=png&auto=webp&s=55ce9b3fe0593b62207ac2e9e524c437428cc3ec I just wanted to unscrew it, in the opposite direction than on the illustration, and it was harder nd harder, than it got stuck... What do you reccomend to get it unscrewed somehow? submitted by ziimag to sennheiser [link] [comments] |
2024.11.26 12:20 FaulerPerfektionis Suche einen extra kurzen 6mm Betonbohrer mit Bitaufnahme
 | Habe schon länger das Internet durchsucht, finde aber immer nur HSS oder Holzbohrer. Gibt es überhaupt was ich suche? Beispielbild: submitted by FaulerPerfektionis to selbermachen [link] [comments] |
2024.11.26 12:20 mucahitozcan expo eject
Hello friends, I developed a project with react native expo as ios and android as a cross-platform, now I need to transfer it to my testflig, now I only need to transfer it to my testflig, I did not develop the ios part as cli at first, I will use 'expo eject', but what steps should I follow later? Also, after the eject command, I have almost 5-6 expo packages in my project, does this affect me only with xcode, I need to transfer it to testflig, I need to check it from there? Please help.
submitted by mucahitozcan to reactnative [link] [comments]
2024.11.26 12:20 cyfy_art_3000 Posting some fanart that I did
 | Jetsons x Proud Family submitted by cyfy_art_3000 to DisneyChannel [link] [comments] |
2024.11.26 12:20 Sea_Fix3602 Anyone want a cum tribute?
submitted by Sea_Fix3602 to Snapchatgerman [link] [comments]
2024.11.26 12:20 Ramneek_Gill We are just some chill people
 | Body text submitted by Ramneek_Gill to Brawlstars [link] [comments] |
2024.11.26 12:20 MammothBattle33 PNUT’s 36% Drop Could Send It Back to All-Time Lows — Here’s Why
🚨 Crypto News: The hype around Solana-based meme coin Peanut the Squirrel ($PNUT) is officially cracking. The token has tumbled a hefty 36% over the past week, now trading at $1.09. As meme coin mania fizzles out, bearish momentum seems to be the nut the market is cracking, with $PNUT flirting with its key support at $0.97.
Technical indicators paint a worrisome picture for the squirrels still holding on. The Super Trend indicator flashes red, signaling sellers are driving this downtrend. Meanwhile, the RSI has slipped below the neutral zone, hinting at fading demand and more pressure downward. If $PNUT breaches $0.97, the token could slide toward $0.55—or even revisit its all-time low of $0.03.
But wait, there’s still hope for a nutty rebound. If sentiment shifts, $PNUT could aim for $1.26, invalidating the bearish vibes. Keep an eye on this one, squirrels.
Solana #CryptoTrends #MemeCoins submitted by MammothBattle33 to Blockmandev [link] [comments]
2024.11.26 12:20 watashiwananii Favorite episode? I wanna rewatch.
This show has my heart and I wanted to rewatch a few episodes just because. Do you have any favorites you recommend and why? The Cinderella episode will always be one of my favorites.
submitted by watashiwananii to FruitsBasket [link] [comments]
2024.11.26 12:20 Nevetz39 Got lucky? Just opened so feel free to add
 | ID - 1649080909180256 submitted by Nevetz39 to PTCGP [link] [comments] |
2024.11.26 12:20 skinamide My teeny tiny Nykaa haul
I know it might seem a very tinyto be posted here but I wanted to just get what I need and not what I want.
submitted by skinamide to indianbeautyhauls [link] [comments]