esefarad.com
robots.txt
Robots Exclusion Standard data for esefarad.com
Resource Scan
Scan Details
| Site Domain | esefarad.com |
| Base Domain | esefarad.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-07T04:57:58+00:00 |
| Next Scan | 2024-10-07T04:57:58+00:00 |
Last Successful Scan
| Scanned | 2024-08-09T04:51:28+00:00 |
| URL | https://esefarad.com/robots.txt |
| Domain IPs | 2a02:4780:84:529f:3800:484c:3bfa:b2a8, 93.127.201.101 |
| Response IP | 93.127.201.249 |
| Found | Yes |
| Hash | 27c7937ff05951a388cbef9f83c42026a6a3a2471929cf8a026beeb3a58ca766 |
| SimHash | 473c4ea0621a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /adn/ |
| Disallow | /adnfaq/ |
| Disallow | /amigosporisrael/ |
| Disallow | /cgi-bin/ |
| Disallow | /img/ |
| Disallow | /radio/ |
| Disallow | /tv/ |
| Disallow | /wp-login |
| Disallow | /wp-admin |
| Disallow | /*/feed/ |
| Disallow | /*/trackback/ |
| Disallow | /*/attachment/ |
| Disallow | /*/page/ |
| Disallow | /*/feed/ |
| Disallow | /tag/*/page/ |
| Disallow | /tag/*/feed/ |
| Disallow | /page/ |
| Disallow | /comments/ |
| Disallow | /xmlrpc.php |
| Disallow | /*?s= |
| Disallow | /*/*/*/feed.xml |
| Disallow | /?attachment_id* |
| Disallow | /tour/ |
| Disallow | /?p=44943 |
| Disallow | /?p=44979 |
| Disallow | /?p=44957 |
| Disallow | /?p=44976 |
| Disallow | /?p=82386 |
| Disallow | /?p=83948 |
| Disallow | /?p=82619 |
| Disallow | /?p=83388 |
| Disallow | /amigosporisrael |
| Disallow | /?p= |
| Disallow | /disertante* |
| Disallow | /*/*.pdf/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3600 |
Warnings
- 1 invalid line.