gladiusbr.com
robots.txt

Robots Exclusion Standard data for gladiusbr.com

Resource Scan

Scan Details

Site Domain gladiusbr.com
Base Domain gladiusbr.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-08-30T16:32:22+00:00
Next Scan 2024-10-29T16:32:22+00:00

Last Successful Scan

Scanned2024-06-09T16:31:05+00:00
URL https://www.gladiusbr.com/robots.txt
Domain IPs 108.156.133.103, 108.156.133.122, 108.156.133.46, 108.156.133.72, 2600:9000:2755:2600:1f:3a76:9500:93a1, 2600:9000:2755:3a00:1f:3a76:9500:93a1, 2600:9000:2755:6000:1f:3a76:9500:93a1, 2600:9000:2755:800:1f:3a76:9500:93a1, 2600:9000:2755:9c00:1f:3a76:9500:93a1, 2600:9000:2755:ae00:1f:3a76:9500:93a1, 2600:9000:2755:d200:1f:3a76:9500:93a1, 2600:9000:2755:d800:1f:3a76:9500:93a1
Response IP 108.156.133.72
Found Yes
Hash 324624623eb5418f9bf8745e1eab750527e70d87a7bb46bcf5cd06364654fa24
SimHash f010cd074dd0

Groups

*

Rule Path
Disallow /img/*
Disallow /account/*
Disallow /login/*
Disallow /checkout/*
Disallow /busca/*
Disallow /quick-view/*
Disallow /espiar/*

Other Records

Field Value
sitemap https://www.gladiusbr.com/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.

Warnings

  • `noindex` is not a known field.