athlon.com
robots.txt

Robots Exclusion Standard data for athlon.com

Resource Scan

Scan Details

Site Domain athlon.com
Base Domain athlon.com
Scan Status Ok
Last Scan2024-05-21T15:28:39+00:00
Next Scan 2024-06-20T15:28:39+00:00

Last Scan

Scanned2024-05-21T15:28:39+00:00
URL https://athlon.com/robots.txt
Redirect https://www.athlon.com:443/robots.txt
Redirect Domain www.athlon.com
Redirect Base athlon.com
Domain IPs 35.156.58.50
Redirect IPs 13.226.228.106, 13.226.228.34, 13.226.228.62, 13.226.228.77
Response IP 108.157.60.14
Found Yes
Hash 8c5e20e6b60d91ab434ca825c8f9e80a3f4c1c0b6705644b007bfb0477bb4f3c
SimHash 52185a40ea07

Groups

*

Rule Path
Allow /
Disallow /app_browsers/
Disallow /app_data/
Disallow /app_plugins/
Disallow /app_start/
Disallow /aspnet_client/
Disallow /bin/
Disallow /code/
Disallow /config/
Disallow /controllers/
Disallow /data/
Disallow /masterpages/
Disallow /macroscripts/
Disallow /media/forms/
Disallow /models/
Disallow /umbraco/
Disallow /umbraco_client/
Disallow /views/
Disallow /usync/
Disallow /es/*/*licenseplate%3D$

claudebot
compatible; "claudebot/1.0; +claudebot\@anthropic.com"
compatible; "claudebot/1.0; ++claudebot\@anthropic.com"

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.athlon.com/sitemap.xml
sitemap https://www.athlon.com/uk/sitemap.xml
sitemap https://www.athlon.com/se/sitemap.xml
sitemap https://www.athlon.com/pl/sitemap.xml
sitemap https://www.athlon.com/es/sitemap.xml
sitemap https://www.athlon.com/pt/sitemap.xml
sitemap https://www.athlon.com/it/sitemap.xml
sitemap https://www.athlon.com/be/sitemap.xml
sitemap https://www.athlon.com/de/sitemap.xml
sitemap https://www.athlon.com/nl/sitemap.xml
sitemap https://www.athlon.com/fr/sitemap.xml
sitemap https://www.athlon.com/lu/sitemap.xml
sitemap https://www.athloncaroutlet.nl/sitemap.xml
sitemap https://www.athloncaroutlet.es/sitemap.xml
sitemap https://www.athloncaroutlet.it/sitemap.xml

Comments

  • Sitemap