scivillage.com
robots.txt
Robots Exclusion Standard data for scivillage.com
Resource Scan
Scan Details
| Site Domain | scivillage.com |
| Base Domain | scivillage.com |
| Scan Status | Ok |
| Last Scan | 2025-09-09T03:46:33+00:00 |
| Next Scan | 2025-10-09T03:46:33+00:00 |
Last Scan
| Scanned | 2025-09-09T03:46:33+00:00 |
| URL | https://scivillage.com/robots.txt |
| Redirect | https://www.scivillage.com/robots.txt |
| Redirect Domain | www.scivillage.com |
| Redirect Base | scivillage.com |
| Domain IPs | 2001:8d8:100f:f000::25b, 217.160.0.138 |
| Redirect IPs | 2001:8d8:100f:f000::2b3, 217.160.0.80 |
| Response IP | 217.160.0.80 |
| Found | Yes |
| Hash | a3c5f830fdf20dce2ea020f79c24d4903187941362bf76f182ebec1249f96dd3 |
| SimHash | 2d7dc978a60d |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /*.js |
| Allow | /images/ |
| Allow | /*.css |
| Disallow | /cgi-bin/ |
| Disallow | /*.cgi |
| Disallow | /*.log |
| Disallow | /captcha.php |
| Disallow | /calendar.php |
| Disallow | /contact.php |
| Disallow | /editpost.php |
| Disallow | /global.php |
| Disallow | /managegroup.php |
| Disallow | /member.php |
| Disallow | /misc.php |
| Disallow | /modcp.php |
| Disallow | /moderation.php |
| Disallow | /newreply.php |
| Disallow | /newthread.php |
| Disallow | /online.php |
| Disallow | /polls.php |
| Disallow | /printthread.php |
| Disallow | /private.php |
| Disallow | /ratethread.php |
| Disallow | /report.php |
| Disallow | /reputation.php |
| Disallow | /search.php |
| Disallow | /sendthread.php |
| Disallow | /usercp.php |
| Disallow | /usercp2.php |
| Disallow | /*nextoldest* |
| Disallow | /*nextnewest* |
| Disallow | /*datecut* |
| Disallow | /*markread* |
| Disallow | /*sortby* |
| Disallow | /*action%3Demailuser* |
| Disallow | /*action%3Dnextnewest* |
| Disallow | /*action%3Dnextoldest* |
| Disallow | /*year%3D* |
| Disallow | /*action%3Dweekview* |
| Disallow | /*sort%3D* |
| Disallow | /*order%3D* |
| Disallow | /*mode%3D* |
| Disallow | /*datecut%3D* |
| Disallow | /attachment.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 53 |