Full title: I hid a link on my website that only bots can see and told them not to follow it. They broke the rules and in 4 days they went 124,414 levels deep into an endless maze. One bot opened 782,580 doors. I thought this was super interesting, this is how the internet is these days. Thought I’d share.
As some other users have already mentioned it, have a look at this project anyway: https://iocaine.madhouse-project.org/
It gives much more bloated information for a crawler than I expected. But sounds quite fun to host.