-
Archives
- April 2024
- March 2024
- December 2023
- November 2023
- October 2023
- July 2023
- April 2023
- March 2023
- February 2023
- October 2022
- February 2022
- January 2022
- December 2021
- September 2021
- August 2021
- July 2021
- March 2021
- January 2020
- May 2018
- May 2017
- April 2017
- March 2016
- February 2016
- December 2015
- September 2015
- March 2015
- January 2015
- October 2014
- June 2014
- March 2014
- February 2014
- December 2013
- November 2013
- August 2013
- July 2013
- June 2013
- May 2013
- February 2013
- October 2012
- July 2012
- May 2012
- April 2012
- March 2012
- February 2012
- January 2012
- November 2011
- October 2011
- June 2011
- May 2011
- April 2011
- December 2010
- November 2010
-
Meta
Category Archives: Computer
Securing large language models with a reverse proxy
In a previous post, I explained how to host a private ChatGPT using Docker and Traefik. I didn’t spend a lot of time on the security aspect of the project. I see many people asking how to expose their large … Continue reading
Self-hosted coding assistant with llamafile, continue.dev and docker
There was a recent dramatic improvement on the speed of LLM’s on CPU thanks to llamafile‘s author. She goes on extensively about it on her blog but the short version is: expect 7-billion parameters to be usable on consumer-grade CPU … Continue reading
Europe GPU prices update – March 28 2024
With all the buzz about AI these days, let’s have a look at the GPU prices in Europe and check which one gives the best “bang for the buck” as YouTubers like to say. YouTube is filled with people telling … Continue reading
Ollama, open-webui, mitmproxy in a docker compose stack, behind traefik
Reading Ollama discord channel, I notice many people want to self-host their chatGPT with Docker and don’t know how to do it. Here’s how to host the whole stack with docker compose.
Troubleshoot HTTP API requests with mitmproxy
Sometimes you connect a new tool to one of your servers and it doesn’t work as expected. You are sure you follow the documentation or tutorials but you don’t get the expected results. Before you throw away everything, you should … Continue reading
Posted in Computer, Docker, Linux, Networking, Security, Software
Leave a comment
Ollama system prompt
I have recently started to use Ollama and I was unimpressed by some models as they did not follow instructions, especially in their output format. I knew about model system prompt but I thought it was fixed in the model. … Continue reading
Intel N100 CPU performance review
I have just bought a mini PC based on Intel N100 CPU. Initially, I was going to buy another Raspberry PI or a used “TinyMiniMicro” PC, but I decided to have a look at the current mini PC offering. I … Continue reading
Posted in Computer, Hardware, Linux, Software
Leave a comment
Restrict docker container resource usage with docker compose
By default, resources available to containers are not limited. However, sometimes, you want to make sure a container is not going to use too much processing power or memory. To achieve such a thing, in the docker-compose.yml file, add the … Continue reading
Posted in Computer, Docker, Linux, Software
Leave a comment
OpenSSH CVE-2023-48795 mitigation
If you cannot upgrade your OpenSSH client and/or server to fix CVE-2023-48795, also known as the Terrapin attack, the way to mitigate it is to disable the vulnerable ciphers as Red Hat explains very well. If you have a recent … Continue reading
Posted in Computer, Linux, Networking, Security, Software
Leave a comment
Using generative AI to learn vocabulary
I wanted to help a friend learning English who has trouble learning new vocabulary. She often gets new list of words at school and it’s difficult for her to know how to use them, or remember what they mean. She … Continue reading
Posted in artificial intelligence, Computer, Generative AI, Software
Leave a comment