Log In Sign Up

brutalgays.net
robots.txt

Robots Exclusion Standard data for brutalgays.net

Resource Scan

Scan Details

Site Domain brutalgays.net
Base Domain brutalgays.net
Scan Status Ok
Last Scan2025-10-14T08:55:17+00:00
Next Scan 2025-11-13T08:55:17+00:00

Last Scan

Scanned2025-10-14T08:55:17+00:00
URL https://brutalgays.net/robots.txt
Redirect https://www.brutalgays.net/robots.txt
Redirect Domain www.brutalgays.net
Redirect Base brutalgays.net
Domain IPs 104.21.21.170, 172.67.199.164, 2606:4700:3033::6815:15aa, 2606:4700:3036::ac43:c7a4
Redirect IPs 104.21.21.170, 172.67.199.164, 2606:4700:3033::6815:15aa, 2606:4700:3036::ac43:c7a4
Response IP 104.21.21.170
Found Yes
Hash 5b3dc020bd4333080f665e4c37c82dcfe0f41b167addf9e5a035221a540730c2
SimHash 2b149c06cb10

Groups

*

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.brutalgays.net/sitemap.xml
Back to top

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
Back to top

Warnings

  • `host` is not a known field.
Back to top