Re: "Ha, somebody's crawler is very confused by redirects: […"

In: u/skyjake

we should collect IP addresses and habits of crawlers, when there's nothing better to do.

🚀 stack

Apr 21 · 3 weeks ago

1 Later Comment

👻 ps · Apr 22 at 18:30:

Just crabs; sometimes they similarly get stuck on audio streams.

🌆 skyjake [...]

Ha, somebody's crawler is very confused by redirects: [preformatted] Getting a couple of these per second at the moment.

💬 3 comments · Apr 21 · 3 weeks ago