rtrp.jp
robots.txt
Robots Exclusion Standard data for rtrp.jp
Resource Scan
Scan Details
Site Domain | rtrp.jp |
Base Domain | rtrp.jp |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-12T10:17:31+00:00 |
Next Scan | 2024-12-11T10:17:31+00:00 |
Last Successful Scan
Scanned | 2024-08-13T23:48:11+00:00 |
URL | https://rtrp.jp/robots.txt |
Domain IPs | 108.157.254.110, 108.157.254.111, 108.157.254.117, 108.157.254.19 |
Response IP | 108.157.254.110 |
Found | Yes |
Hash | b106f899e3144d24e4fb0818ac4b2afe457177baffe86605435c7b1dbecee13b |
SimHash | a804b504cd52 |
Groups
*
Rule | Path |
---|---|
Disallow | /*?$ |
Disallow | /*%26$ |
Disallow | /*q%3D* |
Disallow | /*order%3D* |
Disallow | /*prev_location%3D* |
Disallow | /*prev_category%3D* |
Disallow | /redirect_app/* |
Disallow | /redirect_store/* |
Disallow | /articles/*/%5B%5B* |
Disallow | /articles/*/favorites* |
Disallow | /articles/*/landing* |
Disallow | /spots/*/images* |
Disallow | /spots/*/reviews* |
Disallow | /items/* |
Other Records
Field | Value |
---|---|
sitemap | https://retrip.jp/sitemap.xml |