asadventure.com
robots.txt

Robots Exclusion Standard data for asadventure.com

Resource Scan

Scan Details

Site Domain asadventure.com
Base Domain asadventure.com
Scan Status Ok
Last Scan2024-05-03T17:21:54+00:00
Next Scan 2024-06-02T17:21:54+00:00

Last Scan

Scanned2024-05-03T17:21:54+00:00
URL https://asadventure.com/robots.txt
Redirect https://www.asadventure.com/robots.txt
Redirect Domain www.asadventure.com
Redirect Base asadventure.com
Domain IPs 18.154.144.113, 18.154.144.67, 18.154.144.73, 18.154.144.99
Redirect IPs 2600:9000:2366:2600:1:e6ec:5e80:93a1, 2600:9000:2366:2e00:1:e6ec:5e80:93a1, 2600:9000:2366:3200:1:e6ec:5e80:93a1, 2600:9000:2366:4a00:1:e6ec:5e80:93a1, 2600:9000:2366:4e00:1:e6ec:5e80:93a1, 2600:9000:2366:5600:1:e6ec:5e80:93a1, 2600:9000:2366:6e00:1:e6ec:5e80:93a1, 2600:9000:2366:9000:1:e6ec:5e80:93a1, 65.9.112.124, 65.9.112.30, 65.9.112.71, 65.9.112.87
Response IP 18.165.171.93
Found Yes
Hash b6c096053d4583ec1b156b9990cafa4f6eb48dcabf61753b5a1512e4f41f54d1
SimHash e02eb043e7a3

Groups

*

Rule Path
Disallow /api*
Allow /api/aem/search*
Disallow /nl/checkout*
Disallow /nl/account*
Disallow /nl/lister.html*
Disallow /nl.html/*
Disallow /en/checkout*
Disallow /en/account*
Disallow /en/lister.html*
Disallow /en.html/*
Disallow /fr/checkout*
Disallow /fr/account*
Disallow /fr/lister.html*
Disallow /fr.html/*
Disallow /cache/productmanual*
Disallow /content/platform-blueprints/*
Disallow /content/experience-fragments/*
Disallow /content/dam/content-fragments/*
Disallow /nl/buy*
Disallow /fr/buy*
Disallow /en/buy*
Disallow /en/p/*

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.asadventure.com/sitemap/index.xml
sitemap https://www.asadventure.com/brand-as-category.xml