nicelocal.com
robots.txt
Robots Exclusion Standard data for nicelocal.com
Resource Scan
Scan Details
| Site Domain | nicelocal.com |
| Base Domain | nicelocal.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-14T04:43:14+00:00 |
| Next Scan | 2024-12-13T04:43:14+00:00 |
Last Successful Scan
| Scanned | 2023-05-18T10:44:01+00:00 |
| URL | https://nicelocal.com/robots.txt |
| Domain IPs | 104.21.52.67, 172.67.196.83, 2606:4700:3030::6815:3443, 2606:4700:3031::ac43:c453 |
| Response IP | 172.67.196.83 |
| Found | Yes |
| Hash | 210cf8c9e16342323ecaf5e21db45ebb7ce6f06d955b69e0cdafce69d1a550bd |
| SimHash | 6489dd418313 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wg/ |
| Disallow | /auth/ |
| Disallow | /admin/ |
| Disallow | /js.php |
| Disallow | /stat.php |
| Disallow | /mobile.php |
| Disallow | /health.php |
| Disallow | /es.php |
| Disallow | /search/ |
| Disallow | /corp/ |
| Disallow | /splash/* |
| Disallow | /*action%3D |
| Disallow | /cardbanner/ |
| Disallow | /*search_query_form |
| Disallow | /*page%3D |
| Disallow | /*/network/*/reviews/ |
| Disallow | /spb/ |
| Disallow | /redirect/ |
| Disallow | /park_items/ |
| Disallow | /*/park_items/ |
| Disallow | /user_orders/ |
| Disallow | /jobs/* |
| Disallow | /s/ |
| Disallow | /book/ |
| Disallow | /service/* |
| Disallow | */addreview/* |
| Disallow | /pages/create_great_offer/ |
| Disallow | /pages/privacy_policy/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 0.2 |
yandex
| Rule | Path |
|---|---|
| Disallow | /wg/ |
| Disallow | /auth/ |
| Disallow | /admin/ |
| Disallow | /js.php |
| Disallow | /stat.php |
| Disallow | /mobile.php |
| Disallow | /health.php |
| Disallow | /es.php |
| Disallow | /search/ |
| Disallow | /corp/ |
| Disallow | /splash/* |
| Disallow | /*action%3D |
| Disallow | /cardbanner/ |
| Disallow | /*search_query_form |
| Disallow | /*page%3D |
| Disallow | /*/network/*/reviews/ |
| Disallow | /spb/ |
| Disallow | /redirect/ |
| Disallow | /park_items/ |
| Disallow | /*/park_items/ |
| Disallow | /user_orders/ |
| Disallow | /jobs/* |
| Disallow | /s/ |
| Disallow | /book/ |
| Disallow | /service/* |
| Disallow | */addreview/* |
googlebot
| Rule | Path |
|---|---|
| Disallow | /wg/ |
| Disallow | /auth/ |
| Disallow | /admin/ |
| Disallow | /js.php |
| Disallow | /stat.php |
| Disallow | /mobile.php |
| Disallow | /health.php |
| Disallow | /es.php |
| Disallow | /search/ |
| Disallow | /corp/ |
| Disallow | /splash/* |
| Disallow | /*action%3D |
| Disallow | /cardbanner/ |
| Disallow | /*search_query_form |
| Disallow | /*page%3D |
| Disallow | /*/network/*/reviews/ |
| Disallow | /spb/ |
| Disallow | /redirect/ |
| Disallow | /park_items/ |
| Disallow | /*/park_items/ |
| Disallow | /user_orders/ |
| Disallow | /jobs/* |
| Disallow | /s/ |
| Disallow | /book/ |
| Disallow | /service/* |
| Disallow | */addreview/* |
| Disallow | /*/social/ |
yahoo! slurp
| Rule | Path |
|---|---|
| Disallow | /wg/ |
| Disallow | /auth/ |
| Disallow | /admin/ |
| Disallow | /js.php |
| Disallow | /stat.php |
| Disallow | /mobile.php |
| Disallow | /health.php |
| Disallow | /es.php |
| Disallow | /search/ |
| Disallow | /corp/ |
| Disallow | /splash/* |
| Disallow | /*action%3D |
| Disallow | /cardbanner/ |
| Disallow | /*search_query_form |
| Disallow | /*page%3D |
| Disallow | /*/network/*/reviews/ |
| Disallow | /spb/ |
| Disallow | /redirect/ |
| Disallow | /park_items/ |
| Disallow | /*/park_items/ |
| Disallow | /user_orders/ |
| Disallow | /jobs/* |
| Disallow | /s/ |
| Disallow | /book/ |
| Disallow | /service/* |
| Disallow | */addreview/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://nicelocal.com/sitemap.xml |
| sitemap | https://nicelocal.com/sitemap.xml |
| sitemap | https://nicelocal.com/sitemap.xml |
| sitemap | https://nicelocal.com/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.