marketshost.com
robots.txt

Robots Exclusion Standard data for marketshost.com

Resource Scan

Scan Details

Site Domain marketshost.com
Base Domain marketshost.com
Scan Status Ok
Last Scan2024-11-09T21:04:14+00:00
Next Scan 2024-11-16T21:04:14+00:00

Last Scan

Scanned2024-11-09T21:04:14+00:00
URL https://marketshost.com/robots.txt
Redirect https://www.marketshost.com/robots.txt
Redirect Domain www.marketshost.com
Redirect Base marketshost.com
Domain IPs 104.21.80.136, 172.67.183.127, 2606:4700:3031::6815:5088, 2606:4700:3033::ac43:b77f
Redirect IPs 104.21.80.136, 172.67.183.127, 2606:4700:3031::6815:5088, 2606:4700:3033::ac43:b77f
Response IP 172.67.183.127
Found Yes
Hash f30a6faf5c2779dab5da3160f75cb3cd8b96d41c3ac90bb1b3057e4005ab1040
SimHash 0828d176d6a3

Groups

*

Rule Path
Allow /
Disallow /controlpanel/
Disallow /cgi-bin/

googlebot

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /controlpanel/

googlebot-news

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /controlpanel/

chatgpt-user

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.marketshost.com/sitemap-index.xml
sitemap https://www.marketshost.com/sitemap-category.xml
sitemap https://www.marketshost.com/sitemap-news-recent.xml
sitemap https://www.marketshost.com/news-sitemap.xml