maxlaumeister.com
robots.txt

Robots Exclusion Standard data for maxlaumeister.com

Resource Scan

Scan Details

Site Domain maxlaumeister.com
Base Domain maxlaumeister.com
Scan Status Ok
Last Scan2025-10-30T19:01:26+00:00
Next Scan 2025-11-06T19:01:26+00:00

Last Scan

Scanned2025-10-30T19:01:26+00:00
URL https://maxlaumeister.com/robots.txt
Redirect https://www.maxlaumeister.com/robots.txt
Redirect Domain www.maxlaumeister.com
Redirect Base maxlaumeister.com
Domain IPs 104.21.39.226, 172.67.149.98, 2606:4700:3032::6815:27e2, 2606:4700:3037::ac43:9562
Redirect IPs 172.66.44.193, 172.66.47.63, 2606:4700:310c::ac42:2cc1, 2606:4700:310c::ac42:2f3f
Response IP 172.66.44.193
Found Yes
Hash e97e760aa189f0b7b1b49446b114aefbd2ac8315770e04c587b9928f107f8054
SimHash 7804eb10caf8

Groups

*

Rule Path
Allow /search/results/?q=github$
Allow /search/results/?q=bitcoin$
Allow /search/results/?q=css$
Disallow /search/results/
Disallow /api/
Disallow /nodeinfo/
Disallow /main/
Disallow /*wlwmanifest.xml
Allow /.well-known/openpgpkey/
Disallow /.well-known/

Comments

  • Disallows aimed at Google. Keep it from running search queries, except for a few.
  • Disallows aimed at Mastodon/GNUSocial. My experimental node shuttered in 2018, please stop hitting me, thanks.
  • Disallows aimed at other bots
  • Allow only specific .well-known locations, block the rest