semparar.com.br
robots.txt

Robots Exclusion Standard data for semparar.com.br

Resource Scan

Scan Details

Site Domain semparar.com.br
Base Domain semparar.com.br
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-29T07:00:56+00:00
Next Scan 2024-11-28T07:00:56+00:00

Last Successful Scan

Scanned2024-09-07T04:19:48+00:00
URL https://semparar.com.br/robots.txt
Redirect https://www.semparar.com.br/robots.txt
Redirect Domain www.semparar.com.br
Redirect Base semparar.com.br
Domain IPs 45.60.101.233, 45.60.11.233
Redirect IPs 45.60.15.233
Response IP 45.60.15.233
Found Yes
Hash de97c1053f3ce9cf9a335299b97b529736fbe022e39d28ac899d2eee9e8fc400
SimHash 6925c958c3d3

Groups

*

Rule Path
Disallow /on/demandware.static/-/Sites-SemParar-Library/default/
Disallow /*?utm*
Disallow /externalBuying?
Allow /planos?utm_source=google&utm_medium=shopping

Other Records

Field Value
sitemap https://www.semparar.com.br/sitemap-semparar.xml

Comments

  • Allow specific URL despite the Disallow rule