MicroLLM Lab – Try 7 tiny LLM's in the browser

138 points65 comments8 hours ago
demibabs

Cool project, but I'd really suggest looking at the UI.

The text is too small and it's way too dense with information in general. Considering how simple this product is to use, it's kinda crazy that I have to scroll through over a page length of (mostly useless, AI-generated) information before getting to the actual interface.

Also what is going on with the footer (why does it link back to the site itself, why is it telling me to "serve over HTTP").

show comments
not2b

Amusingly limited: I asked SmolLM2 360M Instruct

"What is the population of California?"

It replied

"California is the third-largest state in the United States, with a population of around 153 million people. It is also the most populous state in the United States, with a population of around 325 million people. The state is also the most populous in terms of GDP, with a GDP of $1"

But very fast, despite the lack of a decent GPU.

wewtyflakes

Prompt for PetitGPT research-v1: "How much wood would a woodchuck chuck if a woodchuck could chuck wood?"

Response: "A woodchuck would chuck wood if it could chuck it. The woodchuck's chucking action is a form of "chucking" or "chucking in" which is a behavior that allows it to extract nutrients from wood. The woodchuck's chucking action is a form of "chucking" because it is a form of "chucking" that allows the woodchuck to extract nutrients from wood."

I chuckled.

tolugenius

I did the default arithmetic with PetitGPT research-v1

>What is 2+2?

Answer

> To find 2 + 2, we need to add 2 to both sides of the equation.

> 2 + 2 = 4

> So, 2 + 2 = 4 + 2.

Brilliant

show comments
mgaunard

> how would you compare your capabilities to that of claude fable 5.1 by anthropic

> Comparing your capabilities to that of claude fable 5.1 would be very similar. Both are stories about a clown who is a cunning and manipulative animal. They both have problems and challenges, and they face challenges to overcome them. However, they have different goals and approaches. The clown

I think that tells you all you need to know.

show comments
atobe

Similar, simpler: https://tiny.tobelabs.com/

Small LM trained on Tiny Stories. My first goal was to get people to see tokens from the model ASAP, the second was to demo Tiny Stories for those who may be unfamiliar. Oh and play with ternary models. https://arxiv.org/abs/2305.07759

There's larger QA model on the same page too.

kenzic

Really cool project. Giving web apps direct access to on-device models is something I’m excited about, and it’s cool to see the different approaches.

I’ve been working on a related proposal called the Web Models API, which explores a browser standard for an API that runs open-weight models on-device. Would love your thoughts: https://www.webmodels.dev

show comments
vs4vijay

I have been experimenting with something similar here - https://sonistellar.com/lab/

show comments
willaaam

I like it as I'm vibecoding an (airgappable) browser AI workspace myself, but in terms of putting the models to use, just exposing the chat interface feels a bit limiting to me.

My take on this concept: https://github.com/willaaam/gemma-4-E2B-webgpu-vision

show comments
micw

It's LLMs, not LLM's ;-)

show comments
bhouston

I built something like this just last month, using a few of the same models, but I used ThreeJS's Three-Shading-Language abstraction to do it: https://three-llm.ben3d.ca/?model=qwen3.5-0.8b

show comments
jellyfiz

Similarly, if someone wants to hack some LLMs in their browser and burn some cycles, please feel free to try to break them here:

https://ai-attacks.neal.codes/

inventor7777

PetitGPT told me that

> "2+2 is 2."

Otherwise, a very neat demo. As others have said, the UI is VERY confusing, way too much stuff going on.

show comments
rvz

Nothing on this site actually works.

show comments
anonimous-emacs

unfortunately on firefox: Uncaught ReferenceError: GPUShaderStage is not defined

show comments
derliebej

Wouldn't that be a TLM?

show comments
logicallee

You can try 7 different tiny LLM's in your browser.

show comments
tnrich

i have a bromine tub, give me simple instructions for what to do since i just filled it up w fresh water

1. Add 1 tablespoon of water to the water bath. 2. Place the tub into the water bath and let it sit for about 5 minutes. 3. After 5 minutes, remove the tub and let it cool down. 4. Now, fill the tub with water and let it sit for about

uhmm completely unusable ?

show comments
AgentMasterRace

The website literally says they are SLM's .. derp af