goatwanderlust.com
robots.txt

Robots Exclusion Standard data for goatwanderlust.com

Resource Scan

Scan Details

Site Domain goatwanderlust.com
Base Domain goatwanderlust.com
Scan Status Ok
Last Scan2026-02-22T10:22:37+00:00
Next Scan 2026-03-01T10:22:37+00:00

Last Scan

Scanned2026-02-22T10:22:37+00:00
URL https://goatwanderlust.com/robots.txt
Domain IPs 192.250.229.32
Response IP 192.250.229.32
Found Yes
Hash d2786e789f0bec82c4d87ee37727d37d955161cab45b6a47a568500e4951d4ec
SimHash 92065882c9a2

Groups

bingbot

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /author/*
Disallow /feed/
Disallow /*/feed/
Disallow /tag/*/feed/
Allow /wp-admin/admin-ajax.php
Allow /css/
Allow /js/
Disallow /?s=
Disallow /search/

Other Records

Field Value
sitemap https://www.goatwanderlust.com/sitemap_index.xml
sitemap https://www.goatwanderlust.com/post-sitemap.xml

Comments

  • Allow search engines to access CSS and JS
  • Block search pages