My findings after 3 years on AIs playing games is that they’re just generally bad at it. They’re just good enough to string you along, hoping they’ll get good.
Their lack of new ideas and inability to take action gives you a sort of “it’s just about to be good” feel that keeps you playing. Like that feeling that the next pull of the slot machine will be the jackpot.
Also, the memory required for ongoing RPG is vast, the AIs can’t take it.
AI’s can act like an advanced DM’s screen - a bunch of tools - but I’m starting to doubt that they’re any good at the role playing part of DM’ing.
I’ve been optimistic for awhile, and done a lot of work to get the AI good at playing D&D. I need to think on all this more.