mcp.thebash.com
robots.txt

Robots Exclusion Standard data for mcp.thebash.com

Resource Scan

Scan Details

Site Domain mcp.thebash.com
Base Domain thebash.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-20T19:24:41+00:00
Next Scan 2026-02-18T19:24:41+00:00

Last Successful Scan

Scanned2025-07-01T18:11:22+00:00
URL https://mcp.thebash.com/robots.txt
Domain IPs 23.32.29.17, 96.17.180.46
Response IP 96.17.180.131
Found Yes
Hash 83422828f97451ead7a831478000e9676029d58d205ea62c8e6208d0e5e77e42
SimHash 42a75e40e192

Groups

*

Rule Path
Disallow /

roverbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.thebash.com/sitemap/sitemap.xml

Comments

  • robots.txt for https://www.thebash.com
  • contact info@thebash.com for edits/issues
  • 80legs - custom crawling service - basically DDOSed us on a Saturday morning
  • got this from yahoo, this is an email name crawler

Warnings

  • 2 invalid lines.