Let's not forget Soofi - Sovereign Open Source Foundation Models.
I'm really hoping Soofi models are going to be good. Because afaict they'll be the first (and so far only) open source (not just open weight) models in the ~30B parameters range.
You might be interested in these:
I've been using the 7b version for about 2 weeks now to monitor my basic k3s metrics and send me emails about it!
Fun Fact, it is difficult to convince this thing it isn't Claude without a system prompt
(if you're about to send me a rude prompt about how this could have been a cron job, i completely agree with you but i already had the dang thing up and i wanted to see if it could do it)
i have a web ui for it if anyone wants to try
Thank you very much, I hadn't heard about this model coming out anywhere!
Seems like I'll need to wait just a bit more for it to be available in Ollama. As soon as it's there I'll try it out :)
No problem! The company who provides the models also forked llama.cpp while they wait for their PR to be approved if you're curious about it.
Thanks for sharing! Never heard of them but their smaller models (especially the 36B and 32B Model) sound very promising for lcoal deployments.
However it is kinda strange that the 32B model performs that much worse in Terminal-Bench 2.1 compared to the 36B parameter model.
There's also https://apertus-ai.org/. Not sure what sizes they have
The good Apertus model is too large at 70B, unfortunately. The 8B model is much too small to be useful for what I need.
I thought I posted news about this earlier but I can't seem to find it, but I also had some connection issues so maybe it didn't go through. Didn't see it removed in the modlog either, but if this is off topic for Europe, just let me know and I'll remove it.
Like the Pokémon? https://pokemondb.net/pokedex/lechonk
@feddit.org
News and information from Europe 🇪🇺
(Current banner: La Mancha, Spain. Feel free to post submissions for banner images.)
Rules
- This is an English-language community. Comments should be in English. Posts can link to non-English news sources when providing a full-text translation in the post description. Automated translations are fine, as long as they don't overly distort the content.
- No links to misinformation or commercial advertising. When you post outdated/historic articles, add the year of publication to the post title. Infographics must include a source and a year of creation; if possible, also provide a link to the source.
- Be kind to each other, and argue in good faith. Don't post direct insults nor disrespectful and condescending comments. Don't troll nor incite hatred. Don't look for novel argumentation strategies at Wikipedia's List of fallacies.
- No bigotry, sexism, racism, antisemitism, islamophobia, dehumanization of minorities, or glorification of National Socialism. We follow German law; don't question the statehood of Israel.
- Be the signal, not the noise: Strive to post insightful comments. Add "/s" when you're being sarcastic (and don't use it to break rule no. 3).
- If you link to paywalled information, please provide also a link to a freely available archived version. Alternatively, try to find a different source.
- Light-hearted content, memes, and posts about your European everyday belong in other communities.
- Don't evade bans. If we notice ban evasion, that will result in a permanent ban for all the accounts we can associate with you.
- No posts linking to speculative reporting about ongoing events with unclear backgrounds. Please wait at least 12 hours. (E.g., do not post breathless reporting on an ongoing terror attack.)
- Always provide context with posts: Don't post uncontextualized images or videos, and don't start discussions without giving some context first.
(This list may get expanded as necessary.)
Posts that link to the following sources will be removed
- on any topic: Al Mayadeen, brusselssignal:eu, citjourno:com, europesays:com, Breitbart, Daily Caller, Fox, GB News, geo-trends:eu, news-pravda:com, OAN, RT, sociable:co, any AI slop sites (when in doubt please look for a credible imprint/about page), change:org (for privacy reasons), archive:is,ph,today (their JS DDoS websites)
- on Middle-East topics: Al Jazeera
- on Hungary: Euronews
Unless they're the only sources, please also avoid The Sun, Daily Mail, any "thinktank" type organization, and non-Lemmy social media (incl. Substack). Don't link to Twitter directly, instead use xcancel.com. For Reddit, use old:reddit:com
(Lists may get expanded as necessary.)
Ban lengths, etc.
We will use some leeway to decide whether to remove a comment.
If need be, there are also bans: 3 days for lighter offenses, 7 or 14 days for bigger offenses, and permanent bans for people who don't show any willingness to participate productively. If we think the ban reason is obvious, we may not specifically write to you.
If you want to protest a removal or ban, feel free to write privately to the admin that applied the rule (check modlog first to find who was it.)
go to feed...
@feddit.org
News and information from Europe 🇪🇺
(Current banner: La Mancha, Spain. Feel free to post submissions for banner images.)
Rules
- This is an English-language community. Comments should be in English. Posts can link to non-English news sources when providing a full-text translation in the post description. Automated translations are fine, as long as they don't overly distort the content.
- No links to misinformation or commercial advertising. When you post outdated/historic articles, add the year of publication to the post title. Infographics must include a source and a year of creation; if possible, also provide a link to the source.
- Be kind to each other, and argue in good faith. Don't post direct insults nor disrespectful and condescending comments. Don't troll nor incite hatred. Don't look for novel argumentation strategies at Wikipedia's List of fallacies.
- No bigotry, sexism, racism, antisemitism, islamophobia, dehumanization of minorities, or glorification of National Socialism. We follow German law; don't question the statehood of Israel.
- Be the signal, not the noise: Strive to post insightful comments. Add "/s" when you're being sarcastic (and don't use it to break rule no. 3).
- If you link to paywalled information, please provide also a link to a freely available archived version. Alternatively, try to find a different source.
- Light-hearted content, memes, and posts about your European everyday belong in other communities.
- Don't evade bans. If we notice ban evasion, that will result in a permanent ban for all the accounts we can associate with you.
- No posts linking to speculative reporting about ongoing events with unclear backgrounds. Please wait at least 12 hours. (E.g., do not post breathless reporting on an ongoing terror attack.)
- Always provide context with posts: Don't post uncontextualized images or videos, and don't start discussions without giving some context first.
(This list may get expanded as necessary.)
Posts that link to the following sources will be removed
- on any topic: Al Mayadeen, brusselssignal:eu, citjourno:com, europesays:com, Breitbart, Daily Caller, Fox, GB News, geo-trends:eu, news-pravda:com, OAN, RT, sociable:co, any AI slop sites (when in doubt please look for a credible imprint/about page), change:org (for privacy reasons), archive:is,ph,today (their JS DDoS websites)
- on Middle-East topics: Al Jazeera
- on Hungary: Euronews
Unless they're the only sources, please also avoid The Sun, Daily Mail, any "thinktank" type organization, and non-Lemmy social media (incl. Substack). Don't link to Twitter directly, instead use xcancel.com. For Reddit, use old:reddit:com
(Lists may get expanded as necessary.)
Ban lengths, etc.
We will use some leeway to decide whether to remove a comment.
If need be, there are also bans: 3 days for lighter offenses, 7 or 14 days for bigger offenses, and permanent bans for people who don't show any willingness to participate productively. If we think the ban reason is obvious, we may not specifically write to you.
If you want to protest a removal or ban, feel free to write privately to the admin that applied the rule (check modlog first to find who was it.)
go to feed...
At least the engineers have good humour when it comes to names
save