ageofcraft.com
robots.txt

Robots Exclusion Standard data for ageofcraft.com

Resource Scan

Scan Details

Site Domain ageofcraft.com
Base Domain ageofcraft.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-14T10:01:46+00:00
Next Scan 2026-02-12T10:01:46+00:00

Last Successful Scan

Scanned2025-02-14T21:47:40+00:00
URL https://ageofcraft.com/robots.txt
Domain IPs 104.21.66.76, 172.67.157.128, 2606:4700:3035::ac43:9d80, 2606:4700:3037::6815:424c
Response IP 172.67.157.128
Found Yes
Hash ea2a6b951f856eca35304856e75cf9f785c69e556f915f0962c304ae317af90f
SimHash 0e288942ad91

Groups

*

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js
Disallow /*route%3Daccount/
Disallow /*route%3Daffiliate/
Disallow /*route%3Dcheckout/
Disallow /*route%3Dproduct/search
Disallow /fr/*route%3Dproduct/search
Disallow /index.php?route=product%2Fproduct*&manufacturer_id=
Disallow /admin
Disallow /catalog
Disallow /download
Disallow /search
Disallow /fr/search
Disallow /system
Disallow /*?sort=
Disallow /*%26sort%3D
Disallow /*?order=
Disallow /*%26order%3D
Disallow /*?limit=
Disallow /*%26limit%3D
Disallow /*?filter_name=
Disallow /*%26filter_name%3D
Disallow /*?filter_sub_category=
Disallow /*%26filter_sub_category%3D
Disallow /*?filter_description=
Disallow /*%26filter_description%3D
Disallow /*?tracking=
Disallow /*%26tracking%3D
Disallow /*/*/related
Disallow /fr/*/*/related
Disallow /page*?route=information%2Fnews
Disallow /fr/page*?route=information%2Fnews
Disallow /blog/page*
Disallow /fr/blog/page*
Disallow /*/page*
Disallow /fr/*/page*

yandex

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js
Disallow /*route%3Daccount/
Disallow /*route%3Daffiliate/
Disallow /*route%3Dcheckout/
Disallow /*route%3Dproduct/search
Disallow /index.php?route=product%2Fproduct*&manufacturer_id=
Disallow /admin
Disallow /catalog
Disallow /download
Disallow /search
Disallow /system
Disallow /*?sort=
Disallow /*%26sort%3D
Disallow /*?order=
Disallow /*%26order%3D
Disallow /*?limit=
Disallow /*%26limit%3D
Disallow /*?filter_name=
Disallow /*%26filter_name%3D
Disallow /*?filter_sub_category=
Disallow /*%26filter_sub_category%3D
Disallow /*?filter_description=
Disallow /*%26filter_description%3D

Warnings

  • `host` is not a known field.