travelnotes.org
robots.txt

Robots Exclusion Standard data for travelnotes.org

Resource Scan

Scan Details

Site Domain travelnotes.org
Base Domain travelnotes.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-03T00:02:18+00:00
Next Scan 2025-06-17T00:02:18+00:00

Last Successful Scan

Scanned2025-05-18T18:27:49+00:00
URL https://travelnotes.org/robots.txt
Domain IPs 2a02:4780:15:45b1:3b12:6dbf:8590:94f3, 84.32.84.196
Response IP 93.127.201.160
Found Yes
Hash ce1c9b1e72587cece474a068846663eb293273839b5f4c2ee922fa6684c66464
SimHash 220cc704ffa0

Groups

*

Rule Path
Disallow /Test/
Disallow /_vti_bin/
Disallow /_vti_log/
Disallow /_vti_inf.htm
Disallow /topsites/rate/

*

Rule Path
Allow /en/core/*.css$
Allow /en/core/*.css?
Allow /en/core/*.js$
Allow /en/core/*.js?
Allow /en/core/*.gif
Allow /en/core/*.jpg
Allow /en/core/*.jpeg
Allow /en/core/*.png
Allow /en/core/*.svg
Allow /en/profiles/*.css$
Allow /en/profiles/*.css?
Allow /en/profiles/*.js$
Allow /en/profiles/*.js?
Allow /en/profiles/*.gif
Allow /en/profiles/*.jpg
Allow /en/profiles/*.jpeg
Allow /en/profiles/*.png
Allow /en/profiles/*.svg
Disallow /en/core/
Disallow /en/profiles/
Disallow /en/README.txt
Disallow /en/composer/Metapackage/README.txt
Disallow /en/composer/Plugin/ProjectMessage/README.md
Disallow /en/composer/Plugin/Scaffold/README.md
Disallow /en/composer/Plugin/VendorHardening/README.txt
Disallow /en/composer/Template/README.txt
Disallow /en/modules/README.txt
Disallow /en/sites/README.txt
Disallow /en/themes/README.txt
Disallow /en/web.config
Disallow /en/admin/
Disallow /en/comment/reply/
Disallow /en/filter/tips
Disallow /en/node/add/
Disallow /en/search/
Disallow /en/user/register
Disallow /en/user/password
Disallow /en/user/login
Disallow /en/user/logout
Disallow /en/media/oembed
Disallow /en/*/media/oembed
Disallow /en/index.php/admin/
Disallow /en/index.php/comment/reply/
Disallow /en/index.php/filter/tips
Disallow /en/index.php/node/add/
Disallow /en/index.php/search/
Disallow /en/index.php/user/password
Disallow /en/index.php/user/register
Disallow /en/index.php/user/login
Disallow /en/index.php/user/logout
Disallow /en/index.php/media/oembed
Disallow /en/index.php/*/media/oembed

Other Records

Field Value
sitemap https://travelnotes.org/sitemap.xml
sitemap https://travelnotes.org/en/sitemap.xml

Comments

  • Content
  • CSS, JS, Images
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)