Log In Sign Up

ourwanders.com
robots.txt

Robots Exclusion Standard data for ourwanders.com

Resource Scan

Scan Details

Site Domain ourwanders.com
Base Domain ourwanders.com
Scan Status Ok
Last Scan2025-10-29T08:39:32+00:00
Next Scan 2025-11-05T08:39:32+00:00

Last Scan

Scanned2025-10-29T08:39:32+00:00
URL https://ourwanders.com/robots.txt
Domain IPs 104.21.6.195, 172.67.135.56, 2606:4700:3035::6815:6c3, 2606:4700:3037::ac43:8738
Response IP 104.21.6.195
Found Yes
Hash 0320d9eba61e8eada269e08cb38d3568a33d0fa569a23af733a6541e3cc1d43a
SimHash 4db4d7e2c7f0

Groups

bingbot

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

adidxbot

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

bingpreview

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

ia_archiver

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

duckduckbot

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

applebot

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

googlebot

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

apis-google

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

adsbot-google-mobile

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

adsbot-google

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

googlebot-news

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

googlebot-video

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

mediapartners-google

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

adsbot-google-mobile-apps

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

feedfetcher-google

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

google-read-aloud

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

duplexweb-google

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

google favicon

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

googleweblight

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

storebot-google

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

googlebot smartphone

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

sulrp

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

facebot

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

pinterestbot

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

pinterest/0.2 (+https://www.pinterest.com/bot.html)

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

mozilla/5.0 (compatible; pinterestbot/1.0; +https://www.pinterest.com/bot.html)

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

mozilla/5.0 (linux; android 6.0.1; nexus 5x build/mmb29p) applewebkit/537.36 (khtml, like gecko) chrome/41.0.2272.96 mobile safari/537.36 (compatible; pinterestbot/1.0; +https://www.pinterest.com/bot.html)

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

mozilla/5.0 (linux; android 8.0; pixel 2 build/opd3.170816.012) applewebkit/537.36 (khtml, like gecko) chrome/72.0.3626.121 mobile safari/537.36 (compatible; ezlynx/0.1; +http://www.ezoic.com/bot.html)

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /refer/
Allow /

*
*

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://ourwanders.com/wp-sitemap.xml
Back to top

Comments

  • Original content begin
  • User-agent: *
  • Allow: /wp-content/uploads/
  • Allow: /wp-admin/admin-ajax.php
  • Disallow: /wp-admin/
  • Disallow: /readme.html
  • Disallow: /refer/
  • Allow: /
  • Original content ends
  • Crawlers for microsoft according to https://www.bing.com/webmasters/help/which-crawlers-does-bing-use-8c184ec0
  • Internet archiver bot
  • DuckDuckGo bot
  • Apple bot
  • All the bots used by Google
  • Yahoo bot
  • Facebook bots
  • User agents for PInterest bots https://help.pinterest.com/en/business/article/pinterest-crawler
  • Sitemap link
Back to top