Category: Uncategorized

Who is not dreaming of a virtually unlimited token budget to spend?

Unfortunately, most credit cards have rather hard limits.

So why not make use of that gaming computer sitting at home and turn it into your own AI inference server?

In this post, we will configure a Linux machine with an NVIDIA GPU to run vLLM and expose an OpenAI compatible API. We will then connect Visual Studio Code and GitHub Copilot to it, allowing Copilot Agent to use a model running entirely on our own hardware.

There are a few interesting lessons along the way, particularly around GPU memory, context windows and why a model that technically fits into VRAM might still not be a particularly good fit.

Continue reading Let your remote GPU power VSCode Copilot

I recently tracked down a Python packaging issue on macOS that may also explain several development problems I had written off in the past as mistakes in my own setup.

The surprising part was that the problem was not really Python, pip, the virtual environment, or my pyproject.toml.

It was iCloud Drive.

Continue reading Python Development in iCloud Drive on macOS: Why pip install -e Can Break

Over Easter break, I did what probably counts as a very specific kind of relaxation: I disappeared into philosophy, AI, Docker logs, and GPU temperatures, and came back with something called PhiloGPT.

The question.

The original idea was not “let me build a platform.” It was much smaller and more personal than that. I wanted to explore a question that has been sitting in the back of my mind for a while: what happens when you treat dialogue itself as the interface for thinking? Continue reading Mr. Spock meets Pythagoras

If I just had that perfect keyboard. It would make my workflow just so much better. Certainly I can invest some time to find the perfect one. (BTW, if you know me for a while, I had at least 20 keyboards in the last ten years)

Oh, and if I just had the perfect Headphones. It would make my workflow just so much more enjoyable.

Oh, and if I just had that perfect pen…

I think you got the point? There are two mechanisms working here:

• Procrastination
• Wanting mind

The procrastination part is certainly hitting very close to home for me. I am learning math, which to some part seems boring, and to some part is quite challenging. It is also a area of past struggles for me, which I try to evade.

And then there is the Wanting Mind. “If I just had” is a good indicator for this. There is a deep belonging inside me, to be recognized as a nerd. By having stuff. Also, there is a side which tells me “I deserve it”. Well, all of this, of course, is just some distraction from my fear of not being enough. Of me being an imposter.

Good thing, if I notice that. In that case, I can be aware and focus back on my math learning. However, sometimes that can consume several hours.
Then it’s worth writing a blog post about it.
To avoid going back to work.