Love your post and ambitions, very inspiring. Looking to do similar, with family engaging assistant connecting to home automation and private data. Look forward to seeing more on what you build, anywhere in particular you share aside from here?

Sounds like you are executing that with CPU. when you do nvidia-smi, do you see memory and GPU consumption?