cosmotienda.com
robots.txt

Robots Exclusion Standard data for cosmotienda.com

Resource Scan

Scan Details

Site Domain cosmotienda.com
Base Domain cosmotienda.com
Scan Status Ok
Last Scan2024-09-20T17:43:52+00:00
Next Scan 2024-10-20T17:43:52+00:00

Last Scan

Scanned2024-09-20T17:43:52+00:00
URL https://cosmotienda.com/robots.txt
Domain IPs 23.22.77.153
Response IP 23.22.77.153
Found Yes
Hash a899cf9411b13336e513e8a413f825aceeab941b63ca6dbda0e452077c420429
SimHash d1145370ee83

Groups

*

Rule Path
Allow /tienda/
Disallow /new/
Disallow /facturas/
Disallow /TCApssphpMyAdmin/
Disallow /intercambio/

amazonbot

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

Other Records

Field Value
sitemap http://cosmotienda.com/tienda/sitemaps.xml