Localllm - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Sep 5

Temperature 0 is not reproducible. I measured 30 percent of my output changing between identical runs.

#llm #benchmarks #localllm #reproducibility

3 min read

Sep 5

Our 4B beat Claude Opus on a 440K-token corpus. Then it came last on the public benchmark.

#llm #benchmarks #localllm #privateai

4 min read

Sep 5

I told the model to separate fields with <TAB>. It did exactly that, and I lost 79 percent of my data.

#llm #prompting #debugging #localllm

3 min read

Sep 5

A 4B on a 6GB laptop matched frontier-model accuracy on aggregation — except when the answer is a number

#llm #benchmarks #localllm #agents

4 min read

Sep 5

Your agent truncates the corpus and answers anyway. Two harnesses, and a router that picks between them.

#llm #agents #localllm #benchmarks

5 min read

Aug 18

What really fits in 8GB VRAM

#localllm #vram #gpu #buildinpublic

7 min read

Guatu

Aug 14

Moving Scheduled LLM Curation from Cloud APIs to Local Models

#aiagents #localllm #ollama #kubernetes

9 min read

Aug 11

Nine ways to talk to a local model

#localllm #ollama #llamacpp #buildinpublic

9 min read

Aug 24

A 4B model on a 6GB laptop beat Claude Opus on our 440K-token corpus. The fix was giving the model less to do.

#privateai #llm #inference #localllm

4 min read

PEPPERCORN

Aug 6

[Day 20] Local AI vs cloud AI: one cat photo, 10 video models

#localllm #ai #dgxspark #videogeneration

3 min read

Nathan C.

Aug 29

I A/B tested my own system prompt: 24 generations, one clear win, one rule that did nothing | Flash Onyx 2.2

#ai #ollama #localllm #opensource

8 min read

Nathan C.

Aug 28

Flash Onyx 2.2: teaching a local model law and game feel

#ai #ollama #localllm #opensource

4 min read

Jul 15

Running an LLM agent entirely in your browser

#ai #localllm #webdev #machinelearning

5 min read

uehara

Aug 15

Cloud bills kept climbing from 24/7 AI development — I moved the decisions and the implementation to my own local LLMs and cut the cost

#ai #llm #localllm #costoptimization

10 min read

uehara

Aug 10

Moving Half of Our AI Development to Local LLMs — by Splitting Work by Role, Not by Picking the Biggest Model

#ai #llm #machinelearning #localllm

3 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.