☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to technology@hexbear.netEnglish · 7 months agoReddit will block the Internet Archivewww.theverge.comexternal-linkmessage-square6linkfedilinkarrow-up132arrow-down10cross-posted to: reddit@lemmy.worldreddit@lemdro.idreddit@lemmy.mlredditwasfun@lemmy.worldfuck_bigtech@europe.pubnews@lemmy.worldtechnology@lemmy.worldfedibridge@lemmy.dbzer0.comtechnology@piefed.social
arrow-up132arrow-down1external-linkReddit will block the Internet Archivewww.theverge.com☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to technology@hexbear.netEnglish · 7 months agomessage-square6linkfedilinkcross-posted to: reddit@lemmy.worldreddit@lemdro.idreddit@lemmy.mlredditwasfun@lemmy.worldfuck_bigtech@europe.pubnews@lemmy.worldtechnology@lemmy.worldfedibridge@lemmy.dbzer0.comtechnology@piefed.social
minus-squareThermonuclearEgg@hexbear.netlinkfedilinkEnglisharrow-up14·7 months agoThis could potentially destroy existing archived data
minus-squareLargeAdultRedBook [none/use name]@hexbear.netlinkfedilinkEnglisharrow-up1·7 months agoHow so? Do archive services not also archive content from linked CDNs?
minus-squareThermonuclearEgg@hexbear.netlinkfedilinkEnglisharrow-up2·7 months agoMaybe I’m mistaken but I have heard the Internet Archive applies robots.txt retroactively
This could potentially destroy existing archived data
How so? Do archive services not also archive content from linked CDNs?
Maybe I’m mistaken but I have heard the Internet Archive applies robots.txt retroactively