wildsnow.com
robots.txt

Robots Exclusion Standard data for wildsnow.com

Resource Scan

Scan Details

Site Domain wildsnow.com
Base Domain wildsnow.com
Scan Status Ok
Last Scan2024-11-11T03:11:53+00:00
Next Scan 2024-11-18T03:11:53+00:00

Last Scan

Scanned2024-11-11T03:11:53+00:00
URL https://wildsnow.com/robots.txt
Domain IPs 141.193.213.10, 141.193.213.11
Response IP 141.193.213.10
Found Yes
Hash 3281aec23ad5680eef8756e69a3a7fb82ca5be0c976a543cf16bd9943bf04952
SimHash 1b567841d760

Groups

twitterbot

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow /articles/*
Disallow /articles/*/*
Disallow /blocked-ip-why/
Disallow /wp-admin/
Disallow /templates/
Disallow /cgi-bin/
Disallow /wptest
Disallow /addineyeV2.html
Disallow /eyeblaster/
Disallow /*preview%3Dtrue$
Disallow /passwords-list.html
Disallow /passwords-list-3.html
Disallow /passwords-list-2.html
Disallow /*passwords-list-2.html
Disallow /*passwords-list-3.html
Disallow /images-adswap/uploads/
Disallow /images-adswap/
Disallow /images/helpers/*/
Disallow /images/helpers2/
Disallow /country-blocked-info.html

googlebot

Rule Path Comment
Disallow /articles/* -
Disallow /articles/*/* -
Disallow /backcountry-ski-museum/* -
Disallow /backcountry-ski-museum/*/* -
Disallow /backcountry-ski-museum/*/*/* -
Disallow /blocked-ip-why/ -
Disallow /wp-admin/ -
Disallow /templates/ ditto
Disallow /cgi-bin/ -
Disallow /wptest -
Disallow /quiz/answers.html -
Disallow /ski-weights-chart.html -
Disallow /test.html -
Disallow /backcountry-skiing-search/ -
Disallow /wp-comments-post.php/ -
Disallow /wp-comments-post.php/* -
Disallow /about/wildsnow-media-kit/ -
Disallow /shop/wildsnow-payments/ -
Disallow /?attachment_id=* -
Disallow /comment-page/* -
Disallow /feed/ -
Disallow /*/*/feed/ -
Disallow /*/trackback/$ -
Disallow /page -
Disallow /page/ -
Disallow /page/* -
Disallow /page/*/?* -
Disallow /page/*/*/ -
Disallow /wp-signup.php -
Disallow /blocked-ip-why/ -
Disallow /*preview%3Dtrue$ -
Disallow /passwords-list.html -
Disallow /passwords-list-3.html -
Disallow /*passwords-list-3.html -
Disallow /passwords-list-2.html -
Disallow /*passwords-list-2.html -
Disallow /images-adswap/uploads/ -
Disallow /images-adswap/ -
Disallow /images/helpers/*/ -
Disallow /images/helpers2/ -
Disallow /country-blocked-info.html -
Disallow /country-blocked-help.html -

msnbot

Rule Path
Disallow /articles/*
Disallow /articles/*/*
Disallow /blocked-ip-why/
Disallow /wp-admin/
Disallow /templates/
Disallow /cgi-bin/
Disallow /wptest
Disallow /quiz/answers.html
Disallow /test.html
Disallow /images
Disallow /backcountry-skiing-search/
Disallow /about/copyright-legal-words/
Disallow /about/wildsnow-media-kit/
Disallow /shop/wildsnow-payments/
Disallow /?attachment_id=*
Disallow /comment-page/*
Disallow /feed/
Disallow /*/*/feed/
Disallow /*/trackback/$
Disallow /page
Disallow /page/
Disallow /page/*
Disallow /page/*/*/
Disallow /wp-signup.php
Disallow /blocked-ip-why/
Disallow /*preview%3Dtrue$
Disallow /passwords-list.html
Disallow /passwords-list-3.html
Disallow /*passwords-list-3.html
Disallow /passwords-list-2.html
Disallow /*passwords-list-2.html
Disallow /images-adswap/uploads/
Disallow /images-adswap/
Disallow /images/helpers/*/
Disallow /images/helpers2/
Disallow /country-blocked-info.html
Disallow /*/*/?wpmp_switcher=mobile

Other Records

Field Value
crawl-delay 20

bingbot

Rule Path Comment
Disallow /wp-admin/ -
Disallow /blocked-ip-why/ -
Disallow /templates/ ditto
Disallow /cgi-bin/ -
Disallow /wptest -
Disallow /quiz/answers.html -
Disallow /ski-weights-chart.html -
Disallow /test.html -
Disallow /backcountry-skiing-search/ -
Disallow /wp-comments-post.php/ -
Disallow /wp-comments-post.php/* -
Disallow /about/wildsnow-media-kit/ -
Disallow /shop/wildsnow-payments/ -
Disallow /?attachment_id=* -
Disallow /comment-page/* -
Disallow /feed/ -
Disallow /*/*/feed/ -
Disallow /*/trackback/$ -
Disallow /page -
Disallow /page/ -
Disallow /page/* -
Disallow /page/*/?* -
Disallow /page/*/*/ -
Disallow /wp-signup.php -
Disallow /blocked-ip-why/ -
Disallow /*preview%3Dtrue$ -
Disallow /passwords-list.html -
Disallow /passwords-list-3.html -
Disallow /*passwords-list-3.html -
Disallow /passwords-list-2.html -
Disallow /*passwords-list-2.html -
Disallow /images-adswap/uploads/ -
Disallow /images-adswap/ -
Disallow /images/helpers/*/ -
Disallow /images/helpers2/ -
Disallow /country-blocked-info.html -
Disallow /*/*/?wpmp_switcher=mobile -

Other Records

Field Value
crawl-delay 20

*

Rule Path
Disallow /articles/*
Disallow /blocked-ip-why/
Disallow /wp-admin/
Disallow /templates/
Disallow /cgi-bin/
Disallow /wptest
Disallow /quiz/answers.html
Disallow /test.html
Disallow /images
Disallow /backcountry-skiing-search/
Disallow /about/copyright-legal-words/
Disallow /about/wildsnow-media-kit/
Disallow /shop/wildsnow-payments/
Disallow /?attachment_id=*
Disallow /comment-page/*
Disallow /feed/
Disallow /*/*/feed/
Disallow /*/trackback/$
Disallow /page
Disallow /page/
Disallow /page/*
Disallow /page/*/*/
Disallow /wp-signup.php
Disallow /blocked-ip-why/
Disallow /*preview%3Dtrue$
Disallow /passwords-list.html
Disallow /passwords-list-3.html
Disallow /*passwords-list-3.html
Disallow /passwords-list-2.html
Disallow /*passwords-list-2.html
Disallow /images-adswap/uploads/
Disallow /images-adswap/
Disallow /images/helpers/*/
Disallow /images/helpers2/
Disallow /country-blocked-info.html

Other Records

Field Value
crawl-delay 20

screaming frog seo spider

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Comments

  • robots.txt for https://www.wildsnow.com/
  • mediapartners is the Adsense crawler
  • Disallow: /10548047/* #this is google DFP links, crawl errors shown in webmaster tools
  • Disallow: /10548047/* #this is google DFP links, crawl errors shown in webmaster tools
  • disallow WayBack archiving site
  • if below is invoked, it strips the site from the archive and blocks future archiving
  • invoked the deletion for now, perhaps need to turn back on for later

Warnings

  • 5 invalid lines.