An update to Google’s privacy policy suggests that the entire public internet is fair game for it’s AI projects. If Google can read your words, assume they belong to the company now, and expect that they’re nesting somewhere in the bowels of a chatbot.
There was an article recently about this (too lazy to search it). It’s already starting to happen. If most of the content they train on is the internet and more internet content is created by LLMs without being tagged as AI generated content (can’t be guaranteed by all actors), then it’s inevitable. High signal training data is out the window.
likely they would limit training data to only include pre-2020 or earlier to avoid this
Then you run into the problem of having outdated information. As more AI generated content pollutes the internet and more time passes the problem will only become more severe.