Video of GPT-OSS 20B running on a phone by Simon Willison

The latest iPhone 17 Pro Max is still stuck at 12GB of RAM, presumably not enough to run this same model.

We are getting closer to the dream I have of on-device smart enough AI.

This means two things - my next Mac needs to have maybe 32GB memory. And Apple needs to add more than 16GB to the iPhone Pros. I know they need to manage power - RAM eats power.

Or, we get an even better model which runs on even less memory. Less likely though.

We’re getting closer though.