☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to technology@hexbear.netEnglish · 7 months agoReddit will block the Internet Archivewww.theverge.comexternal-linkmessage-square6linkfedilinkarrow-up132arrow-down10cross-posted to: reddit@lemmy.worldreddit@lemdro.idreddit@lemmy.mlredditwasfun@lemmy.worldfuck_bigtech@europe.pubnews@lemmy.worldtechnology@lemmy.worldfedibridge@lemmy.dbzer0.comtechnology@piefed.social
arrow-up132arrow-down1external-linkReddit will block the Internet Archivewww.theverge.com☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to technology@hexbear.netEnglish · 7 months agomessage-square6linkfedilinkcross-posted to: reddit@lemmy.worldreddit@lemdro.idreddit@lemmy.mlredditwasfun@lemmy.worldfuck_bigtech@europe.pubnews@lemmy.worldtechnology@lemmy.worldfedibridge@lemmy.dbzer0.comtechnology@piefed.social
minus-squareThermonuclearEgg@hexbear.netlinkfedilinkEnglisharrow-up2·7 months agoMaybe I’m mistaken but I have heard the Internet Archive applies robots.txt retroactively
Maybe I’m mistaken but I have heard the Internet Archive applies robots.txt retroactively