Sorry to say, archive.org is under a ddos attack. The data is not affected, but most services are unavailable.
We are working on it & will post updates in comments.
Brought to you by the Department of Erasing History.
Then it still makes no sense, as you being unable to take down the content means you also very likely can’t edit the content. I can’t think of a situation where you:
Need content to not be scraped
Need time to remove/edit that content
Have access to do the above
Don’t have access to pull the content immediately
Have control of a large enough botnet to take down Internet Archive
Don’t have a big enough botnet to take down the aforementioned content
Well they made a bad job of it because you can’t do that with a DDOS attack. Basically it’s the same as picketing the entrance to a building. All you need is a lot of people anyone can do it at any time.
Actually entering the building and manipulating contents it holds is much more difficult, as then you actually have to engage with the building security.
Someone wanted to erase history.
Luckily non of the data was deleted
It might be that someone wanted to change something that was on a website before the archive could get to it too.
That’s a ridiculous amount of effort to go through to slow down a scraper for one site, especially when that site could just be… turned off.
If you own the domain you can disable the crawler on it. And remove previous scrapes.
Then it still makes no sense, as you being unable to take down the content means you also very likely can’t edit the content. I can’t think of a situation where you:
Well that’s my point… It doesn’t make sense because you can just go after the fact and make the request to take it all down.
You have to be stupidly paranoid and obscenely stupid to believe that a DDOS is the correct answer if this is the case.
Well they made a bad job of it because you can’t do that with a DDOS attack. Basically it’s the same as picketing the entrance to a building. All you need is a lot of people anyone can do it at any time.
Actually entering the building and manipulating contents it holds is much more difficult, as then you actually have to engage with the building security.
A DDOS attack can never delete data.