all.biz
robots.txt
Robots Exclusion Standard data for all.biz
Resource Scan
Scan Details
| Site Domain | all.biz |
| Base Domain | all.biz |
| Scan Status | Ok |
| Last Scan | 2024-11-16T00:40:18+00:00 |
| Next Scan | 2024-11-23T00:40:18+00:00 |
Last Scan
| Scanned | 2024-11-16T00:40:18+00:00 |
| URL | https://all.biz/robots.txt |
| Domain IPs | 104.21.44.124, 172.67.199.190, 2606:4700:3032::6815:2c7c, 2606:4700:3033::ac43:c7be |
| Response IP | 172.67.199.190 |
| Found | Yes |
| Hash | d6d9cead3d32dd2b48b69e62b78f0245dca0af46b4c79ced940f8ded122476a2 |
| SimHash | 41559097fed4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /click.php |
| Disallow | /click/ |
| Disallow | /*advertising/ |
| Disallow | /*about/ |
| Disallow | /*?cat_id=* |
| Disallow | /*export%3D |
| Disallow | /*mapview%3D |
| Disallow | /*utm_campaign%3D |
| Disallow | /*utm_source%3D |
| Disallow | /*utm_medium%3D |
| Disallow | /*gclid%3D |
| Disallow | */compare* |
| Disallow | /*utm_content%3D |
| Disallow | /*utm_term%3D |
| Disallow | /*_* |
| Disallow | /*teaser/importexport* |
| Disallow | /*lazyblocks/error_popup* |
| Disallow | /*ajax-reviews_mobile?tld=* |
| Disallow | /*ajax-reviews?tld=* |
| Disallow | /*leads/ajax?* |
| Disallow | /*leads/api* |
| Disallow | /*section_id%3D* |
| Disallow | /*rubric_id%3D* |
| Disallow | /*is_service%3D* |
| Disallow | /*country_code%3D* |
| Disallow | /*lng_code%3D* |
| Disallow | /*category_id%3D* |
| Disallow | /*text%3D* |
| Disallow | /*city%3D* |
| Disallow | /*region%3D* |
| Disallow | /*market%3D* |
| Disallow | /*rubric%3D* |
| Disallow | /out/ |
| Disallow | *-rgn* |
| Disallow | *-rsec* |
| Disallow | *-srd* |
| Disallow | /s/m* |
| Disallow | /m*/rub* |
| Disallow | /s/m*/rub* |
| Disallow | /settings |
| Disallow | /*mobile/* |
yandex
| Rule | Path |
|---|---|
| Disallow | /click.php |
| Disallow | /click/ |
| Disallow | /*advertising/ |
| Disallow | /*about/ |
| Disallow | /*?btn_search=* |
| Disallow | /*?cat_id=* |
| Disallow | /*export%3D |
| Disallow | /*mapview%3D |
| Disallow | /*utm_campaign%3D |
| Disallow | /*utm_source%3D |
| Disallow | /*utm_medium%3D |
| Disallow | /*gclid%3D |
| Disallow | */compare* |
| Disallow | /*utm_content%3D |
| Disallow | /*utm_term%3D |
| Disallow | /*_* |
| Disallow | /*teaser/importexport* |
| Disallow | /*lazyblocks/error_popup* |
| Disallow | /*ajax-reviews_mobile?tld=* |
| Disallow | /*ajax-reviews?tld=* |
| Disallow | /*leads/ajax?* |
| Disallow | /*leads/api* |
| Disallow | /*section_id%3D* |
| Disallow | /*rubric_id%3D* |
| Disallow | /*is_service%3D* |
| Disallow | /*country_code%3D* |
| Disallow | /*lng_code%3D* |
| Disallow | /*category_id%3D* |
| Disallow | /*text%3D* |
| Disallow | /*city%3D* |
| Disallow | /*region%3D* |
| Disallow | /*market%3D* |
| Disallow | /*rubric%3D* |
| Disallow | /out/ |
| Disallow | /s/m* |
| Disallow | /m*/rub* |
| Disallow | /s/m*/rub* |
| Disallow | /settings |
| Disallow | /*mobile/* |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /img/*/small/* |
| Disallow | /img/*/middle/* |
| Disallow | /img/*/tmp/* |
| Disallow | /img/*/preview/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://all.biz/sitemap.xml |
Warnings
- `host` is not a known field.