What problems of LLM’s were you referring to here:’The hype has been huge so problems and weaknesses of the current LLMs have been found quickly and I think many are disappointed.’

Off the top of my head I can think of contextual issues, memory, and integration issues into current applications. All of which are being actively worked on and improved by companies.

You are correct in saying the hype is died down a bit though.