todayintheword.org
robots.txt
Robots Exclusion Standard data for todayintheword.org
Resource Scan
Scan Details
| Site Domain | todayintheword.org |
| Base Domain | todayintheword.org |
| Scan Status | Ok |
| Last Scan | 2024-09-03T00:50:48+00:00 |
| Next Scan | 2024-10-03T00:50:48+00:00 |
Last Scan
| Scanned | 2024-09-03T00:50:48+00:00 |
| URL | https://todayintheword.org/robots.txt |
| Redirect | https://www.todayintheword.org/robots.txt |
| Redirect Domain | www.todayintheword.org |
| Redirect Base | todayintheword.org |
| Domain IPs | 66.185.251.15 |
| Redirect IPs | 18.66.122.114, 18.66.122.119, 18.66.122.13, 18.66.122.37, 2600:9000:21f8:1600:5:133c:22c0:93a1, 2600:9000:21f8:600:5:133c:22c0:93a1, 2600:9000:21f8:7800:5:133c:22c0:93a1, 2600:9000:21f8:7c00:5:133c:22c0:93a1, 2600:9000:21f8:a400:5:133c:22c0:93a1, 2600:9000:21f8:da00:5:133c:22c0:93a1, 2600:9000:21f8:e800:5:133c:22c0:93a1, 2600:9000:21f8:f600:5:133c:22c0:93a1 |
| Response IP | 3.160.246.61 |
| Found | Yes |
| Hash | f93030576b2e81ea0fda3913b82ff9f461bda3da1db9b4833c14ad8fb74700f1 |
| SimHash | 9005d0a0d2b1 |
Groups
rogerbot
| Rule | Path |
|---|---|
| Disallow | /login/ |
| Disallow | /login-page/ |
| Disallow | /EPiServer/ |
| Disallow | /EPiServer/CMS/ |
| Disallow | /Util/ |
| Disallow | /unsorted/ |
| Disallow | /redirects/ |
| Disallow | /titwplayer.aspx |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
ahrefsbot
| Rule | Path |
|---|---|
| Disallow | /login/ |
| Disallow | /login-page/ |
| Disallow | /EPiServer/ |
| Disallow | /EPiServer/CMS/ |
| Disallow | /Util/ |
| Disallow | /unsorted/ |
| Disallow | /redirects/ |
| Disallow | /titwplayer.aspx |
| Disallow | /archive/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
*
| Rule | Path |
|---|---|
| Disallow | /login/ |
| Disallow | /login-page/ |
| Disallow | /EPiServer/ |
| Disallow | /EPiServer/CMS/ |
| Disallow | /Util/ |
| Disallow | /unsorted/ |
| Disallow | /redirects/ |
| Disallow | /titwplayer.aspx |