AI navigator not utilizing the GPU

Getting Started Getting Started Information
1

Hey everyone, I am a bit new to anaconda and I wanted to test out the new AI Navigator however I encountered a problem where the models seem to utilize the CPU and ram and not the GPU. I am in the cuda environment auto generated by AI Navigator and I did not find a setting or working command that can switch to GPU acceleration. Any help is greatly appreciated.

For reference the system I am using is
CPU: intel 13600k
Memory: 32 GB RAM
GPU: 4070 super with 12 GB VRAM

2

@mkon , welcome to Anaconda!

I am sorry to hear your experience about AI Navigator not leveraging your GPU.

We have a new version v1.0.2 released on Sep 27, can you update to that version and see if you still experience the same issue?

Also if you can share (either here or my work email: lzhou@anaconda.com):

  • Your OS version
  • The model that you are having problem with
  • Portion of your main.log that related to the issue you were experiencing ā€“ you can use the timestamp in the log to determine which portion is relevant

We love to use this information to troubleshoot and improve your experience.

Thank you!

ā€” Leon Zhou

1 Like
3

Hello! I encountered the same question using anaconda AI navigator, the model seems using my CPU and not the GPU. Could you tell me are there any methods to solve this question? thanks!

CPU: intel 12600kf
RAM: 32GB
GPU: 4060ti 16GB
OS: win11 professional 24H2 26100.2605
the model iā€™m using is: Meta-Llama-3-8B-Instruct