Started using LM Studio and it’s been great so far. The most important feature is that it’s local, which also means that it works offline.

Previously I used Mistral because I lost any trust in huge LLM providers and I doubt they will not morally corrupt down the road. Even with Mistral it feels like it’s too easy to profile users now and sell them ads.

Using a small language model and running it on your own hardware feels better somehow. If I manage to connect it to some documentation MCP, Wikipedia, some online search, it will easily cover 95% of cases for me.

I don’t need a model to do everything for me, I just need it to be a super generalist that can point me in the right direction.