zonasulfmilheus.com.br
robots.txt

Robots Exclusion Standard data for zonasulfmilheus.com.br

Resource Scan

Scan Details

Site Domain zonasulfmilheus.com.br
Base Domain zonasulfmilheus.com.br
Scan Status Ok
Last Scan2024-11-14T14:53:42+00:00
Next Scan 2024-11-21T14:53:42+00:00

Last Scan

Scanned2024-11-14T14:53:42+00:00
URL https://zonasulfmilheus.com.br/robots.txt
Domain IPs 104.243.35.201
Response IP 104.243.35.201
Found Yes
Hash 26457535c5cd92024b2f820c858c8155e5400df6a1e6ee34cb21e7a5352528f3
SimHash 6c7d18088fc3

Groups

psbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

googlebot

Rule Path
Disallow /cgi-bin/

*

Rule Path
Disallow /cgi-bin/

Other Records

Field Value
sitemap http://www.zonasulfmilheus.com.br/sitemap.xml