Luu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 1 month agoTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comexternal-linkmessage-square131fedilinkarrow-up1573arrow-down17cross-posted to: technik@feddit.orghackernews@lemmy.bestiver.se
arrow-up1566arrow-down1external-linkTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comLuu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 1 month agomessage-square131fedilinkcross-posted to: technik@feddit.orghackernews@lemmy.bestiver.se
minus-squarejagged_circlelinkfedilinkEnglisharrow-up1arrow-down1·1 month agoCaches can be configured locally to use near-zero processing power. Or moved to the last mile to use zero processing power (by your hardware)
minus-squareOlgratin_Magmatoe@lemmy.worldlinkfedilinkEnglisharrow-up3·edit-21 month agoNear zero isn’t zero though. And not everyone is using caching.
minus-squarejagged_circlelinkfedilinkEnglisharrow-up1arrow-down1·1 month agoRight, thats why I said you should fire your sysadmin if they aren’t caching or can’t manage to get the cache down to zero load for static content served to simple GET requests
minus-squareOlgratin_Magmatoe@lemmy.worldlinkfedilinkEnglisharrow-up1·1 month agoNot every GET request is simple enough to cache, and not everyone is running something big enough to need a sysadmin.
Caches can be configured locally to use near-zero processing power. Or moved to the last mile to use zero processing power (by your hardware)
Near zero isn’t zero though. And not everyone is using caching.
Right, thats why I said you should fire your sysadmin if they aren’t caching or can’t manage to get the cache down to zero load for static content served to simple GET requests
Not every GET request is simple enough to cache, and not everyone is running something big enough to need a sysadmin.