Blog

As large language models (LLMs) become essential for work and personal projects, many users are seeking local solutions instead of relying on cloud-based optionsThanks to advancements in open-source tools, setting up a local GPT-like experience is now easier than ever, offering freedom from internet connectivity and subscription fees. Today, we’ll explore two tools, Anything LLM and Ollama, that allow you to create a private, customizable LLM setup for enhanced privacy and control.

Wouldn’t it be cool sending HTTP requests to a LLM model on your own infrastructure, and turning it an API to use on any desired purpose?

I got curious about this and made a Chrome Extension named InstaFollowup that shows you who stopped following you on Instagram.

Like many developers out there I too have applications ready to be tested in a production-like environment and for this purpose I was using cloud providers like GCP or AWSEven though cloud providers are easy to set up and use, I realized they are not that great especially for testing purposes. Because even if I don’t use the servers, I am still charged and I just didn’t want to pay for something I rarely use. So I decided to install my own k8s server and expose it to the internet.