travel.mdpr.jp
robots.txt
Robots Exclusion Standard data for travel.mdpr.jp
Resource Scan
Scan Details
| Site Domain | travel.mdpr.jp |
| Base Domain | mdpr.jp |
| Scan Status | Ok |
| Last Scan | 2024-06-25T00:10:36+00:00 |
| Next Scan | 2024-07-25T00:10:36+00:00 |
Last Scan
| Scanned | 2024-06-25T00:10:36+00:00 |
| URL | https://travel.mdpr.jp/robots.txt |
| Domain IPs | 18.180.186.136, 52.194.21.254, 54.250.32.66 |
| Response IP | 54.250.32.66 |
| Found | Yes |
| Hash | bc2fa756e710e6ab1df8526fc57cf74158ef62dae098ba0e2f59c0d6ffb1e2a2 |
| SimHash | f234c7510f9b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /topics/check/ |
| Disallow | /url/link/ |
| Disallow | /url/outside/ |
| Disallow | /api/ |
| Disallow | /async/ |
| Disallow | /search |
| Disallow | /spot/hotel_list |
| Disallow | /spot/hotel_pickup |
| Disallow | /spot/nearby_spot |
| Disallow | /spot/related_topic |
Comments