tidefans.com
robots.txt
Robots Exclusion Standard data for tidefans.com
Resource Scan
Scan Details
| Site Domain | tidefans.com |
| Base Domain | tidefans.com |
| Scan Status | Ok |
| Last Scan | 2024-11-15T19:02:52+00:00 |
| Next Scan | 2024-11-22T19:02:52+00:00 |
Last Scan
| Scanned | 2024-11-15T19:02:52+00:00 |
| URL | https://tidefans.com/robots.txt |
| Domain IPs | 208.74.86.251 |
| Response IP | 208.74.86.251 |
| Found | Yes |
| Hash | 794422446b7f7af58efc63f7435392a8531ed34cfe4db6c47270c1f9b6627bc4 |
| SimHash | 2594d24b4ace |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax.php |
| Disallow | /attachment.php |
| Disallow | /calendar.php |
| Disallow | /cron.php |
| Disallow | /editpost.php |
| Disallow | /global.php |
| Disallow | /image.php |
| Disallow | /inlinemod.php |
| Disallow | /joinrequests.php |
| Disallow | /login.php |
| Disallow | /member.php |
| Disallow | /memberlist.php |
| Disallow | /misc.php |
| Disallow | /moderator.php |
| Disallow | /newattachment.php |
| Disallow | /newreply.php |
| Disallow | /newthread.php |
| Disallow | /online.php |
| Disallow | /poll.php |
| Disallow | /postings.php |
| Disallow | /printthread.php |
| Disallow | /private.php |
| Disallow | /profile.php |
| Disallow | /register.php |
| Disallow | /report.php |
| Disallow | /reputation.php |
| Disallow | /search.php |
| Disallow | /sendmessage.php |
| Disallow | /showgroups.php |
| Disallow | /subscription.php |
| Disallow | /threadrate.php |
| Disallow | /usercp.php |
| Disallow | /usernote.php |
| Disallow | /cgi-bin |
| Disallow | /ubb |
| Disallow | /basketball/sweepstakes |
| Disallow | /football/2002 |
| Disallow | /football/2003 |
| Disallow | /football/2004 |
| Disallow | /football/2005 |
| Disallow | /football/2006 |
| Disallow | /football/2007 |
| Disallow | /football/2008 |
| Disallow | /football/2009 |
| Disallow | /football/2010 |
| Disallow | /football/2011 |
| Disallow | /index.html |
| Disallow | /index.shtml |
| Disallow | /recruiting |
| Disallow | /search |
| Disallow | /topic |
| Disallow | /schedules |
| Disallow | *.cgi |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 45 |