relevantsitecontent.com
robots.txt

Robots Exclusion Standard data for relevantsitecontent.com

Resource Scan

Scan Details

Site Domain relevantsitecontent.com
Base Domain relevantsitecontent.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-09T09:22:13+00:00
Next Scan 2026-01-07T09:22:13+00:00

Last Successful Scan

Scanned2022-12-01T18:16:21+00:00
URL https://relevantsitecontent.com/robots.txt
Domain IPs 104.21.40.233, 172.67.157.149
Response IP 104.21.40.233
Found Yes
Hash 1fd8898f12099421f55ecbcd459a5aa5eaa8eef912e08ce0a6ee9d5ec992c841
SimHash 6059d93153b3

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

slurp

Rule Path
Allow /

*

Rule Path
Disallow /
Disallow /js/*
Disallow /wz/*
Disallow /index.php?*
Disallow /?*

Other Records

Field Value
sitemap http://relevantsitecontent.com/sitemap.xml