latamcompra.com
robots.txt

Robots Exclusion Standard data for latamcompra.com

Resource Scan

Scan Details

Site Domain latamcompra.com
Base Domain latamcompra.com
Scan Status Ok
Last Scan2024-09-13T12:06:12+00:00
Next Scan 2024-10-13T12:06:12+00:00

Last Scan

Scanned2024-09-13T12:06:12+00:00
URL https://latamcompra.com/robots.txt
Redirect https://www.latamcompra.com/robots.txt
Redirect Domain www.latamcompra.com
Redirect Base latamcompra.com
Domain IPs 212.232.31.66
Redirect IPs 212.232.31.70
Response IP 212.232.31.70
Found Yes
Hash d9ce6ed3c4f9ceee2ec1bc26218f9fc9f435dc8a73a40bdfa646578d6ec87956
SimHash 4e1ee8507c90

Groups

*

Rule Path
Disallow /api/

dotbot
mj12bot
bubing
semrushbot
semrushbot-sa
megaindex.ru
megaindex.com
ahrefsbot
qwantify
yandexbot
domaincrawler
mappydata.net
alphabot
zoominfobot
istellabot
seokicks
blexbot
serpstatbot
job roboter spider
cliqzbot
baiduspider
mediatoolkitbot
ccbot
adscanner
barkrowler
omgilibot
omgili
buck
hexometer
petalbot
cyberscan.io
gptbot
*

Rule Path
Disallow /

googlebot
bingbot
msnbot

Rule Path
Disallow /api/
Disallow /html2pdf
Allow /

bingbot
msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.latamcompra.com/sitemap.xml