Monthly Archives: March 2024

Europe GPU prices update – March 28 2024

With all the buzz about AI these days, let’s have a look at the GPU prices in Europe and check which one gives the best “bang for the buck” as YouTubers like to say. YouTube is filled with people telling … Continue reading

Posted in artificial intelligence, Computer, Generative AI, Hardware, Large Language Models, Stable Diffusion | Leave a comment

Ollama, open-webui, mitmproxy in a docker compose stack, behind traefik

Reading Ollama discord channel, I notice many people want to self-host their chatGPT with Docker and don’t know how to do it. Here’s how to host the whole stack with docker compose.

Posted in artificial intelligence, Computer, Docker, Generative AI, Large Language Models, Linux, Networking, Software | Leave a comment

Troubleshoot HTTP API requests with mitmproxy

Sometimes you connect a new tool to one of your servers and it doesn’t work as expected. You are sure you follow the documentation or tutorials but you don’t get the expected results. Before you throw away everything, you should … Continue reading

Posted in Computer, Docker, Linux, Networking, Security, Software | Leave a comment

Ollama system prompt

I have recently started to use Ollama and I was unimpressed by some models as they did not follow instructions, especially in their output format. I knew about model system prompt but I thought it was fixed in the model. … Continue reading

Posted in artificial intelligence, Computer, Generative AI, Large Language Models, Linux | Leave a comment

Intel N100 CPU performance review

I have just bought a mini PC based on Intel N100 CPU. Initially, I was going to buy another Raspberry PI or a used “TinyMiniMicro” PC, but I decided to have a look at the current mini PC offering. I … Continue reading

Posted in Computer, Hardware, Linux, Software | Leave a comment

Restrict docker container resource usage with docker compose

By default, resources available to containers are not limited. However, sometimes, you want to make sure a container is not going to use too much processing power or memory. To achieve such a thing, in the docker-compose.yml file, add the … Continue reading

Posted in Computer, Docker, Linux, Software | Leave a comment