As a programmer with no ML/GPU experience, this reminds me of the Spiral language: https://github.com/mrakgr/The-Spiral-Language

I wonder if Nx will succeed due being "just" a library for a popular language (Elixir) instead of being a separate language entirely.

"Don't make a new language if your idea could be implemented as a library" is good advice indeed.