You won’t need any additional driver, since, as you already said, it is already included in the kernel.

However, as owner of a RX6600, I can tell you that the GPU will be quite loud sometimes. I can recommend you to check out LACT, which let’s you define fan curves, which makes it A LOT less noisy.

Your case sounds like a perfect fit for Bazzite or Aurora.

• Both come already set up ootb, with all quality of life tweaks you want and need.
• They are image based distros (“immutable”), so you mainly work in your /var/ and /home/ directory, and all the other stuff is untouched and clean.
• They are very modern, getting the same updates at the same time as upstream Fedora.
• Running Ollama is just one ujust command away, many complex things are made easier with those commands
• You probably won’t get a lot more performance I believe. At least when I switched from regular Fedora/ Silverblue to Bazzite, I didn’t notice many more FPS in games for example.