I upgraded my PC, I have just upped the RAM to 64GB and got a Radeon 9700xt 16GB GPU.

I want to do some personal programming projects and was wondering what is the best model that would fit my HW?

I mostly use python, but dabble a little in go, and am interested in looking at rust.

I am running this on my desktop, the processor is a AMD 3700X (8c/16t).

  • absGeekNZ@lemmy.nzOPEnglish
    3·
    5 days ago

    I’m running ollama 0.6.3 (pre-release) and rocm v6.10.5 on linux 6.11.0-21

    Still getting

    level=INFO source=gpu.go:377 msg=“no compatible GPUs were discovered”

    • Fisch@discuss.tchncs.deEnglish
      2·
      5 days ago

      I have an RX 6700 XT and I needed to change an environment variable to make it work. Maybe something similar is needed for you GPU. I’d try googling something like “RX 9700 XT ROCM” or “RX 9700 XT ROCM no compatible GPUs were discovered” if you haven’t done that already.

    • SmokeyDope@lemmy.worldMEnglish
      1·
      5 days ago

      When I had my AMD GPU going the best way to get models running was kobold.cpp and using vulcan. The flag is like --usevulcan or something. Its way easier than getting a rocm fork working from source.