Log In Sign Up

snowandmud.com
robots.txt

Robots Exclusion Standard data for snowandmud.com

Resource Scan

Scan Details

Site Domain snowandmud.com
Base Domain snowandmud.com
Scan Status Ok
Last Scan2025-10-16T23:47:50+00:00
Next Scan 2025-10-30T23:47:50+00:00

Last Scan

Scanned2025-10-16T23:47:50+00:00
URL https://www.snowandmud.com/robots.txt
Domain IPs 104.21.49.74, 172.67.160.167, 2606:4700:3031::ac43:a0a7, 2606:4700:3032::6815:314a
Response IP 172.67.160.167
Found Yes
Hash 7b419e8416224743feeeea66a6875a909af74da616d2abfc5597ad480a3f6feb
SimHash 2d3ecb52cf47

Groups

ia_archiver

Rule Path
Allow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow *.js
Disallow search.php
Disallow /includes/
Disallow /install/
Disallow /customavatars/
Disallow /referrers.php
Disallow /ajax_cron.php
Disallow /ajax.php
Disallow /attachment.php
Disallow /calendar.php
Disallow /cron.php
Disallow /editpost.php
Disallow /global.php
Disallow /image.php
Disallow /inlinemod.php
Disallow /joinrequests.php
Disallow /login.php
Disallow /member.php
Disallow /memberlist.php
Disallow /misc.php
Disallow /moderator.php
Disallow /newattachment.php
Disallow /newreply.php
Disallow /newthread.php
Disallow /online.php
Disallow /poll.php
Disallow /postings.php
Disallow /printthread.php
Disallow /private.php
Disallow /profile.php
Disallow /register.php
Disallow /report.php
Disallow /reputation.php
Disallow /search.php
Disallow /sendmessage.php
Disallow /showgroups.php
Disallow /subscription.php
Disallow /threadrate.php
Disallow /usercp.php
Disallow /usernote.php
Disallow /z
Disallow /xftest
Disallow /forum/armysystem.php
Disallow /archive/index.php
Back to top

Other Records

Field Value
sitemap http://snowandmud.com/forum/sitemap_index.xml.gz
Back to top

Comments

  • Allow Archive.org to save snapshots of everything
  • Tame yahoo... it tends to eat a ton of resources without a delay
  • list individual pages and files here that all bots should ignore, as well as group extentions.
  • If you re-write everything to .html, you can disallow *.php, but note that if you don't have a CRR for custom pages, those will be blocked.
  • Finally, list the path to your sitemap:
Back to top