Andy Reid@lemmy.world to Technology@lemmy.worldEnglish · 5 months agoAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comexternal-linkmessage-square200fedilinkarrow-up11.09Karrow-down115cross-posted to: technology@beehaw.orgwolnyinternet@szmer.infotechnology@lemmy.zip
arrow-up11.08Karrow-down1external-linkAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comAndy Reid@lemmy.world to Technology@lemmy.worldEnglish · 5 months agomessage-square200fedilinkcross-posted to: technology@beehaw.orgwolnyinternet@szmer.infotechnology@lemmy.zip
minus-squareKairuByte@lemmy.dbzer0.comlinkfedilinkEnglisharrow-up9·5 months agoI’m the idiot human that digs through robots.txt and the site map to see things that aren’t normally accessible by an end user.
I’m the idiot human that digs through robots.txt and the site map to see things that aren’t normally accessible by an end user.