30·
1 day agothe scrapers ignore robots.txt. It doesn’t really ban them - it just asks them not to access things, but they are programmed by assholes.
- 0 Posts
- 2 Comments
Joined 2 years ago
Cake day: July 31st, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
Taco tuesday 🌮🌮