Log In Sign Up

domainsdata.org
robots.txt

Robots Exclusion Standard data for domainsdata.org

Resource Scan

Scan Details

Site Domain domainsdata.org
Base Domain domainsdata.org
Scan Status Ok
Last Scan2025-03-13T07:39:05+00:00
Next Scan 2025-03-20T07:39:05+00:00

Last Scan

Scanned2025-03-13T07:39:05+00:00
URL https://domainsdata.org/robots.txt
Domain IPs 104.21.6.53, 172.67.154.243, 2606:4700:3030::6815:635, 2606:4700:3031::ac43:9af3
Response IP 104.21.6.53
Found Yes
Hash a0753d21eae68f766f73b7983ad8628567b11d5b7d61ec0a799e98a9b430656b
SimHash 67149853e7b4

Groups

*

Rule Path
Disallow /

bingbot

Rule Path
Allow /
Disallow

googlebot

Rule Path
Allow /
Disallow

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://domainsdata.org/sitemap
Back to top

Comments

  • BEGIN XML Sitemap
  • END XML Sitemap
Back to top