Category Archives: Linux

Securing large language models with a reverse proxy

Posted on April 5, 2024 by blogger

In a previous post, I explained how to host a private ChatGPT using Docker and Traefik. I didn’t spend a lot of time on the security aspect of the project. I see many people asking how to expose their large … Continue reading →

Posted in artificial intelligence, Computer, Generative AI, Large Language Models, Linux, Networking, Security | Leave a comment

Self-hosted coding assistant with llamafile, continue.dev and docker

Posted on April 1, 2024 by blogger

There was a recent dramatic improvement on the speed of LLM’s on CPU thanks to llamafile‘s author. She goes on extensively about it on her blog but the short version is: expect 7-billion parameters to be usable on consumer-grade CPU … Continue reading →

Posted in artificial intelligence, Computer, Docker, Generative AI, Large Language Models, Linux | Leave a comment

Ollama, open-webui, mitmproxy in a docker compose stack, behind traefik

Posted on March 23, 2024 by blogger

Reading Ollama discord channel, I notice many people want to self-host their chatGPT with Docker and don’t know how to do it. Here’s how to host the whole stack with docker compose.

Posted in artificial intelligence, Computer, Docker, Generative AI, Large Language Models, Linux, Networking, Software | Leave a comment

Troubleshoot HTTP API requests with mitmproxy

Posted on March 19, 2024 by blogger

Sometimes you connect a new tool to one of your servers and it doesn’t work as expected. You are sure you follow the documentation or tutorials but you don’t get the expected results. Before you throw away everything, you should … Continue reading →

Posted in Computer, Docker, Linux, Networking, Security, Software | Leave a comment

Ollama system prompt

Posted on March 18, 2024 by blogger

I have recently started to use Ollama and I was unimpressed by some models as they did not follow instructions, especially in their output format. I knew about model system prompt but I thought it was fixed in the model. … Continue reading →

Posted in artificial intelligence, Computer, Generative AI, Large Language Models, Linux | Leave a comment

Intel N100 CPU performance review

Posted on March 2, 2024 by blogger

I have just bought a mini PC based on Intel N100 CPU. Initially, I was going to buy another Raspberry PI or a used “TinyMiniMicro” PC, but I decided to have a look at the current mini PC offering. I … Continue reading →

Posted in Computer, Hardware, Linux, Software | Leave a comment

Restrict docker container resource usage with docker compose

Posted on March 1, 2024 by blogger

By default, resources available to containers are not limited. However, sometimes, you want to make sure a container is not going to use too much processing power or memory. To achieve such a thing, in the docker-compose.yml file, add the … Continue reading →

Posted in Computer, Docker, Linux, Software | Leave a comment

OpenSSH CVE-2023-48795 mitigation

Posted on December 21, 2023 by blogger

If you cannot upgrade your OpenSSH client and/or server to fix CVE-2023-48795, also known as the Terrapin attack, the way to mitigate it is to disable the vulnerable ciphers as Red Hat explains very well. If you have a recent … Continue reading →

Posted in Computer, Linux, Networking, Security, Software | Leave a comment

Contabo: A great cloud for personal use

Posted on October 30, 2023 by blogger

I’m a personal user of Contabo’s cloud services, and I’ve been delighted with them. They offer a wide range of services to choose from, including VPS, dedicated servers, and cloud storage. I’m currently using a VPS to host my personal … Continue reading →

Posted in Computer, Linux, Networking, Storage, Virtualization | Leave a comment

ComfyUI: remove metadata from image files

Posted on July 23, 2023 by blogger

When you generate a file using ComfyUI, metadata are added to the image automatically. Amongst the metadata, there is the full workflow including the prompt. If you want to remove those data, you can use ImageMagick convert with the –strip … Continue reading →

Posted in artificial intelligence, Computer, Linux | Tagged , | Leave a comment