Language models generate plausible text from patterns rather than looking facts up, so they can produce fluent statements that are wrong. A well-known example is lawyers who submitted court filings citing cases invented by a chatbot.
Grounding answers in retrieved sources, asking for citations and verifying important claims reduce the risk.