Category Archives: artificial intelligence

Securing large language models with a reverse proxy

In a previous post, I explained how to host a private ChatGPT using Docker and Traefik. I didn’t spend a lot of time on the security aspect of the project. I see many people asking how to expose their large … Continue reading

Posted in artificial intelligence, Computer, Generative AI, Large Language Models, Linux, Networking, Security | Leave a comment

Self-hosted coding assistant with llamafile, continue.dev and docker

There was a recent dramatic improvement on the speed of LLM’s on CPU thanks to llamafile‘s author. She goes on extensively about it on her blog but the short version is: expect 7-billion parameters to be usable on consumer-grade CPU … Continue reading

Posted in artificial intelligence, Computer, Docker, Generative AI, Large Language Models, Linux | Leave a comment

Europe GPU prices update – March 28 2024

With all the buzz about AI these days, let’s have a look at the GPU prices in Europe and check which one gives the best “bang for the buck” as YouTubers like to say. YouTube is filled with people telling … Continue reading

Posted in artificial intelligence, Computer, Generative AI, Hardware, Large Language Models, Stable Diffusion | Leave a comment

Ollama, open-webui, mitmproxy in a docker compose stack, behind traefik

Reading Ollama discord channel, I notice many people want to self-host their chatGPT with Docker and don’t know how to do it. Here’s how to host the whole stack with docker compose.

Posted in artificial intelligence, Computer, Docker, Generative AI, Large Language Models, Linux, Networking, Software | Leave a comment

Ollama system prompt

I have recently started to use Ollama and I was unimpressed by some models as they did not follow instructions, especially in their output format. I knew about model system prompt but I thought it was fixed in the model. … Continue reading

Posted in artificial intelligence, Computer, Generative AI, Large Language Models, Linux | Leave a comment

Using generative AI to learn vocabulary

I wanted to help a friend learning English who has trouble learning new vocabulary. She often gets new list of words at school and it’s difficult for her to know how to use them, or remember what they mean. She … Continue reading

Posted in artificial intelligence, Computer, Generative AI, Software | Leave a comment

Stable Diffusion: samplers comparison

I ran the same prompt using many samplers at different steps counts to evaluate which one(s) give a decent quality at a low step count. I have not used the “restore faces” option. Here are my observations related to image … Continue reading

Posted in artificial intelligence, Generative AI, Stable Diffusion | Tagged , , , | Leave a comment

SDXL 1.0 is out!

And voilĂ ! SDXL 1.0 is out. After tinkering a bit, I think it’s working pretty well. As with SDXL 0.9, I must use both base and refiner models to get good pictures, but they are of excellent quality. Use the … Continue reading

Posted in artificial intelligence, Computer | Tagged , , | Leave a comment

ComfyUI: remove metadata from image files

When you generate a file using ComfyUI, metadata are added to the image automatically. Amongst the metadata, there is the full workflow including the prompt. If you want to remove those data, you can use ImageMagick convert with the –strip … Continue reading

Posted in artificial intelligence, Computer, Linux | Tagged , | Leave a comment

ComfyUI: batch run from command line with API

While AUTOMATIC1111 can generate images based on prompt variations, I haven’t found the same possibility in ComfyUI. However, you can achieve the same result thanks to ComfyUI API and curl.

Posted in artificial intelligence, Computer | Tagged , , , , | 2 Comments