To be honest, I doubt that a typical device based on UmbrelOS would be capable of running even small AI models, but it would be great for standard home automation (not machine learning-based stuff that is).
What you are referring to, though, is quite interesting. At *some* point we'll all have access to NUC-like PCs with decent NPUs built-in, so then UmbrelOS and other such systems should be able to leverage AI effectively. Based on current roadmaps I'd say that such small and efficient PCs incorporating proper NPUs could be 2 or 3 years out. Other UmbrelOS-like platforms might be released in the meantime so we'd be pretty much set.