Luu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 13 hours agoTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comexternal-linkmessage-square63fedilinkarrow-up1351arrow-down14cross-posted to: hackernews@lemmy.bestiver.se
arrow-up1347arrow-down1external-linkTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comLuu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 13 hours agomessage-square63fedilinkcross-posted to: hackernews@lemmy.bestiver.se
minus-squareSomething Burger 🍔@jlai.lulinkfedilinkEnglisharrow-up6·4 hours agohttps://github.com/iamtraction/ZOD 42kB ZIP file which decompresses into 4.5 PB.
https://github.com/iamtraction/ZOD
42kB ZIP file which decompresses into 4.5 PB.