mindsetbits.com
robots.txt

Robots Exclusion Standard data for mindsetbits.com

Resource Scan

Scan Details

Site Domain mindsetbits.com
Base Domain mindsetbits.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-20T01:52:34+00:00
Next Scan 2025-11-18T01:52:34+00:00

Last Successful Scan

Scanned2024-01-05T21:05:12+00:00
URL https://mindsetbits.com/robots.txt
Domain IPs 185.111.89.131
Response IP 185.111.89.131
Found Yes
Hash db7ce561c4929f40ea6476dd500de3c895cb45ea73b65b2d6e992f516b366dd8
SimHash 49488ad0f513

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://mindsetbits.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK