lemmyreader@lemmy.ml to Security@lemmy.mlEnglish · 2 years agoAmazon storing classified US government documents improperlylemmy.mlexternal-linkmessage-square72linkfedilinkarrow-up11arrow-down10file-text
arrow-up11arrow-down1external-linkAmazon storing classified US government documents improperlylemmy.mllemmyreader@lemmy.ml to Security@lemmy.mlEnglish · 2 years agomessage-square72linkfedilinkfile-text
minus-squareAmbiguousProps@lemmy.todaylinkfedilinkEnglisharrow-up0·2 years agorobots.txt doesn’t have to be followed. It doesn’t block crawling.
robots.txt doesn’t have to be followed. It doesn’t block crawling.