anglocivic.club
robots.txt
Robots Exclusion Standard data for anglocivic.club
Resource Scan
Scan Details
| Site Domain | anglocivic.club |
| Base Domain | anglocivic.club |
| Scan Status | Ok |
| Last Scan | 2024-10-07T02:47:42+00:00 |
| Next Scan | 2024-10-14T02:47:42+00:00 |
Last Scan
| Scanned | 2024-10-07T02:47:42+00:00 |
| URL | https://anglocivic.club/robots.txt |
| Redirect | https://www.anglocivic.club/robots.txt |
| Redirect Domain | www.anglocivic.club |
| Redirect Base | anglocivic.club |
| Domain IPs | 77.222.56.43 |
| Redirect IPs | 77.222.56.43 |
| Response IP | 77.222.56.43 |
| Found | Yes |
| Hash | 2652db7366482c65616e07af730de7e93d938d75007953a5aba8602541485833 |
| SimHash | f6224ec10831 |
Groups
*
stackrambler
googlebot
bing
mail.ru
yandex
yadirectbot
| Rule | Path |
|---|---|
| Allow | /themes/default/menu/style.js |
| Allow | /themes/default/menu/style.css |
| Allow | /themes/default/css/style.css |
| Allow | /themes/default/css/style.css |
| Allow | /themes/default/css/lightstyle.css |
| Allow | /themes/default/images/logo.png |
| Allow | /themes/default/images/icons/joinnow.png |
| Allow | /themes/default/images/icons/facebook.png |
| Disallow | /themes/* |
| Disallow | /js/* |
| Disallow | /jscripts/* |
| Disallow | /*autocom%3D* |
| Disallow | /*prune_day%3D* |
| Disallow | /*topicfilter |
| Disallow | /*lofiversion |
| Disallow | /*text* |
| Disallow | /*mode%3D* |
| Disallow | /*act* |
| Disallow | /*showuser* |
| Disallow | /forum/chat/ |
| Disallow | /*pid%3D* |
| Disallow | /*%26p%3D* |
| Disallow | /*page__pid* |
| Disallow | /*hl%3D* |
| Disallow | /*start%3D* |
| Disallow | /*get-active* |
| Disallow | /*view* |
| Disallow | /*force* |
| Disallow | /s-p-a-m* |
| Disallow | /admin.php |
| Disallow | /*%26s%3D* |
| Disallow | /*s%3D* |
| Disallow | /gallery/index.php?cat=* |
| Disallow | /gallery/image.php?cat=* |
| Disallow | /vk* |
| Disallow | /facebook* |
| Disallow | /partsl/* |
| Disallow | /parts/* |
| Disallow | /poisk-po-rsa-reestru-operatorov-tehosmotra/* |
| Disallow | /rsa-reestr-operatorov-tehosmotra/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 40 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.anglocivic.club/sitemap.xml |
Warnings
- `host` is not a known field.
Comments