Log In Sign Up

qustodio.com
robots.txt

Robots Exclusion Standard data for qustodio.com

Resource Scan

Scan Details

Site Domain qustodio.com
Base Domain qustodio.com
Scan Status Ok
Last Scan2024-11-15T14:17:00+00:00
Next Scan 2024-11-22T14:17:00+00:00

Last Scan

Scanned2024-11-15T14:17:00+00:00
URL https://qustodio.com/robots.txt
Redirect https://www.qustodio.com:443/robots.txt
Redirect Domain www.qustodio.com
Redirect Base qustodio.com
Domain IPs 100.28.177.197, 52.6.4.27, 54.88.56.188
Redirect IPs 216.137.52.26, 216.137.52.35, 216.137.52.37, 216.137.52.63, 2600:9000:2181:1800:2:2aa7:4000:93a1, 2600:9000:2181:2400:2:2aa7:4000:93a1, 2600:9000:2181:2c00:2:2aa7:4000:93a1, 2600:9000:2181:6c00:2:2aa7:4000:93a1, 2600:9000:2181:7600:2:2aa7:4000:93a1, 2600:9000:2181:8400:2:2aa7:4000:93a1, 2600:9000:2181:be00:2:2aa7:4000:93a1, 2600:9000:2181:f200:2:2aa7:4000:93a1
Response IP 108.156.22.32
Found Yes
Hash 049ac537358f14118ae077422a13e81f960350b670da626fda9506eed24d5de1
SimHash 19189505c910

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.qustodio.com/sitemap_index.xml
Back to top