nicelocal.id
robots.txt
Robots Exclusion Standard data for nicelocal.id
Resource Scan
Scan Details
| Site Domain | nicelocal.id |
| Base Domain | nicelocal.id |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-19T16:39:27+00:00 |
| Next Scan | 2024-11-17T16:39:27+00:00 |
Last Successful Scan
| Scanned | 2023-01-24T06:32:18+00:00 |
| URL | https://nicelocal.id/robots.txt |
| Domain IPs | 148.251.196.18 |
| Response IP | 148.251.196.18 |
| Found | Yes |
| Hash | 7c80d4fc42b3d781161cc2dffd7c85d4d8017037e8f4bd18835ec06f5710816c |
| SimHash | e889dc418313 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wg/ |
| Disallow | /auth/ |
| Disallow | /admin/ |
| Disallow | /js.php |
| Disallow | /stat.php |
| Disallow | /mobile.php |
| Disallow | /health.php |
| Disallow | /es.php |
| Disallow | /search/ |
| Disallow | /corp/ |
| Disallow | /splash/* |
| Disallow | /*action%3D |
| Disallow | /cardbanner/ |
| Disallow | /*search_query_form |
| Disallow | /*page%3D |
| Disallow | /*/network/*/reviews/ |
| Disallow | /spb/ |
| Disallow | /redirect/ |
| Disallow | /park_items/ |
| Disallow | /*/park_items/ |
| Disallow | /user_orders/ |
| Disallow | /jobs/* |
| Disallow | /s/ |
| Disallow | /book/ |
| Disallow | /service/* |
| Disallow | /pages/create_great_offer/ |
| Disallow | /pages/privacy_policy/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 0.2 |
yandex
| Rule | Path |
|---|---|
| Disallow | /wg/ |
| Disallow | /auth/ |
| Disallow | /admin/ |
| Disallow | /js.php |
| Disallow | /stat.php |
| Disallow | /mobile.php |
| Disallow | /health.php |
| Disallow | /es.php |
| Disallow | /search/ |
| Disallow | /corp/ |
| Disallow | /splash/* |
| Disallow | /*action%3D |
| Disallow | /cardbanner/ |
| Disallow | /*search_query_form |
| Disallow | /*page%3D |
| Disallow | /*/network/*/reviews/ |
| Disallow | /spb/ |
| Disallow | /redirect/ |
| Disallow | /park_items/ |
| Disallow | /*/park_items/ |
| Disallow | /user_orders/ |
| Disallow | /jobs/* |
| Disallow | /s/ |
| Disallow | /book/ |
| Disallow | /service/* |
googlebot
| Rule | Path |
|---|---|
| Disallow | /wg/ |
| Disallow | /auth/ |
| Disallow | /admin/ |
| Disallow | /js.php |
| Disallow | /stat.php |
| Disallow | /mobile.php |
| Disallow | /health.php |
| Disallow | /es.php |
| Disallow | /search/ |
| Disallow | /corp/ |
| Disallow | /splash/* |
| Disallow | /*action%3D |
| Disallow | /cardbanner/ |
| Disallow | /*search_query_form |
| Disallow | /*page%3D |
| Disallow | /*/network/*/reviews/ |
| Disallow | /spb/ |
| Disallow | /redirect/ |
| Disallow | /park_items/ |
| Disallow | /*/park_items/ |
| Disallow | /user_orders/ |
| Disallow | /jobs/* |
| Disallow | /s/ |
| Disallow | /book/ |
| Disallow | /service/* |
| Disallow | /*/social/ |
yahoo! slurp
| Rule | Path |
|---|---|
| Disallow | /wg/ |
| Disallow | /auth/ |
| Disallow | /admin/ |
| Disallow | /js.php |
| Disallow | /stat.php |
| Disallow | /mobile.php |
| Disallow | /health.php |
| Disallow | /es.php |
| Disallow | /search/ |
| Disallow | /corp/ |
| Disallow | /splash/* |
| Disallow | /*action%3D |
| Disallow | /cardbanner/ |
| Disallow | /*search_query_form |
| Disallow | /*page%3D |
| Disallow | /*/network/*/reviews/ |
| Disallow | /spb/ |
| Disallow | /redirect/ |
| Disallow | /park_items/ |
| Disallow | /*/park_items/ |
| Disallow | /user_orders/ |
| Disallow | /jobs/* |
| Disallow | /s/ |
| Disallow | /book/ |
| Disallow | /service/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://nicelocal.id/sitemap.xml |
| sitemap | https://nicelocal.id/sitemap.xml |
| sitemap | https://nicelocal.id/sitemap.xml |
| sitemap | https://nicelocal.id/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.