'tis how LLM chatbots work. LLMs by design are autocomplete on steroids, so they can predict what the next word should be in a sequence. If you give it something like:

Here is a conversation between the user and a chatbot. <insert description of chatbot>

<insert chat history here>

User: <insert user message here>

Chatbot:

Then it’ll fill in a sentence to best fit that prompt, much like a creative writing exercise