Luu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 1 day agoTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comexternal-linkmessage-square102fedilinkarrow-up1499arrow-down16
arrow-up1493arrow-down1external-linkTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comLuu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 1 day agomessage-square102fedilink
minus-squaretee9000@lemmy.worldlinkfedilinkEnglisharrow-up2arrow-down7·4 hours agoDo you even know what robots.txt is?
minus-squareWhyJiffie@sh.itjust.workslinkfedilinkEnglisharrow-up5·2 hours agothe scraper bots surely don’t
Do you even know what robots.txt is?
the scraper bots surely don’t