Well, we won't be feeding it internet - we'll be using RL to learn from interaction with the real world.

LLMs are just one very specific application of deep learning, doing next-word-prediction of internet text. It's not LLMs specifically that's exciting, it's deep learning as a whole.