tikkun.org
robots.txt
Robots Exclusion Standard data for tikkun.org
Resource Scan
Scan Details
| Site Domain | tikkun.org |
| Base Domain | tikkun.org |
| Scan Status | Ok |
| Last Scan | 2024-06-21T21:05:27+00:00 |
| Next Scan | 2024-07-21T21:05:27+00:00 |
Last Scan
| Scanned | 2024-06-21T21:05:27+00:00 |
| URL | https://tikkun.org/robots.txt |
| Domain IPs | 209.182.192.56 |
| Response IP | 209.182.192.56 |
| Found | Yes |
| Hash | dca176379488fc3cd5e034b5812709dd036a80902f26f9a6a4d54c869c8b878a |
| SimHash | 6875c681d0b2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-login.php |
| Disallow | /nextgen |
| Disallow | /newsite |
| Disallow | /tag |
| Disallow | /submissions/ |
| Disallow | /tikkundaily/wp-admin/ |
| Disallow | /nextgen/wp-admin/ |
| Disallow | /nextgen/wp-login.php |
| Disallow | /tikkundaily/wp-login.php |
| Disallow | /tikkundaily/page/ |
| Disallow | /nextgen/page/ |
| Disallow | /staticpages |
| Disallow | /mediagallery |
| Disallow | /countproc.php |
| Disallow | /calendar.php |
| Disallow | /article.php/ |
| Disallow | /article.php |
| Disallow | /comment.php |
| Disallow | /docs |
| Disallow | /pingback.php |
| Disallow | /submit.php |
| Disallow | /trackback.php |
| Disallow | /tikkundaily/2009/ |
| Disallow | /tikkundaily/2010/ |
| Disallow | /tikkundaily/2011/ |
| Disallow | /tikkundaily/tag/ |
| Disallow | /tikkundaily/contributors/ |
| Disallow | /tikkundaily/art-gallery/ |
| Disallow | /tikkundaily/wp-admin/ |
| Disallow | /tikkundaily/wp-login.php |
scoutjet
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-login.php |
| Disallow | /nextgen |
| Disallow | /newsite |
| Disallow | /tag |
| Disallow | /tikkundaily/wp-admin/ |
| Disallow | /tikkundaily/wp-login.php |
| Disallow | /nextgen/wp-admin/ |
| Disallow | /nextgen/wp-login.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |
twitterbot
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-login.php |
| Disallow | /nextgen |
| Disallow | /newsite |
| Disallow | /tag |
| Disallow | /tikkundaily/wp-admin/ |
| Disallow | /tikkundaily/wp-login.php |
| Disallow | /nextgen/wp-admin/ |
| Disallow | /nextgen/wp-login.php |
vegebot
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-login.php |
| Disallow | /nextgen |
| Disallow | /newsite |
| Disallow | /tag |
| Disallow | /tikkundaily/wp-admin/ |
| Disallow | /tikkundaily/wp-login.php |
| Disallow | /nextgen/wp-admin/ |
| Disallow | /nextgen/wp-login.php |
| Disallow | /article.php |
| Disallow | /tikkundaily/2009/ |
| Disallow | /tikkundaily/2010/ |
| Disallow | /tikkundaily/2011/ |
| Disallow | /tikkundaily/tag/ |
| Disallow | /tikkundaily/contributors/ |
| Disallow | /tikkundaily/art-gallery/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |
mj12bot
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-login.php |
| Disallow | /nextgen |
| Disallow | /newsite |
| Disallow | /tag |
| Disallow | /article.php |
| Disallow | /tikkundaily/2009/ |
| Disallow | /tikkundaily/2010/ |
| Disallow | /tikkundaily/2011/ |
| Disallow | /tikkundaily/tag/ |
| Disallow | /tikkundaily/contributors/ |
| Disallow | /tikkundaily/art-gallery/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |
yandex
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-login.php |
| Disallow | /nextgen |
| Disallow | /newsite |
| Disallow | /tag |
| Disallow | /article.php |
| Disallow | /tikkundaily/2009/ |
| Disallow | /tikkundaily/2010/ |
| Disallow | /tikkundaily/2011/ |
| Disallow | /tikkundaily/tag/ |
| Disallow | /tikkundaily/contributors/ |
| Disallow | /tikkundaily/art-gallery/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
voyager
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-login.php |
| Disallow | /nextgen |
| Disallow | /newsite |
| Disallow | /tag |
| Disallow | /tikkundaily/2009/ |
| Disallow | /tikkundaily/2010/ |
| Disallow | /tikkundaily/2011/ |
| Disallow | /tikkundaily/tag/ |
| Disallow | /tikkundaily/contributors/ |
| Disallow | /tikkundaily/art-gallery/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |