LLMs are usually Transformers with billions of parameters, first pretrained on web-scale text and then tuned to follow instructions and preferences. Chatbots such as ChatGPT, Claude and Gemini are built on them.

They are versatile but can hallucinate, reflect biases in their data and only know what they were trained on unless connected to search or documents.