travel.jp
robots.txt
Robots Exclusion Standard data for travel.jp
Resource Scan
Scan Details
| Site Domain | travel.jp |
| Base Domain | travel.jp |
| Scan Status | Ok |
| Last Scan | 2024-09-16T04:56:24+00:00 |
| Next Scan | 2024-09-23T04:56:24+00:00 |
Last Scan
| Scanned | 2024-09-16T04:56:24+00:00 |
| URL | http://travel.jp/robots.txt |
| Redirect | https://www.travel.co.jp/robots.txt |
| Redirect Domain | www.travel.co.jp |
| Redirect Base | travel.co.jp |
| Domain IPs | 14.128.27.182 |
| Redirect IPs | 108.157.254.127, 108.157.254.53, 108.157.254.79, 108.157.254.93 |
| Response IP | 108.157.254.79 |
| Found | Yes |
| Hash | ccc5e7972ea26a9a5122f7954c667d4ad99f45acfad2378f7b0de9fb50d76e51 |
| SimHash | 66279072ab9f |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /00500/ |
| Disallow | /campaign/ |
| Disallow | /db/comm/ |
| Disallow | /00300/db/comm/ |
| Disallow | /00600/db/comm/ |
| Disallow | /00700/db/user/ |
| Disallow | /00700/db2/user/ |
| Disallow | /db2/comm/ |
| Disallow | /error/ |
| Disallow | /gds/ |
| Disallow | /link/ |
| Disallow | /mozi_senmonten/ |
| Disallow | /img/ |
| Disallow | /00300/img/ |
| Disallow | /00600/img/ |
| Disallow | /img000/ |
| Disallow | /inc/ |
| Disallow | /include/ |
| Disallow | /log/ |
| Disallow | /p/ |
| Disallow | /pamphlet/ |
| Disallow | /tour_j/ |
| Disallow | /tour_ins/ |
| Disallow | /tourcount2.asp |
| Disallow | /tourcount3.asp |
| Disallow | /clkcnt.asp |
| Disallow | /send.asp |
| Disallow | /send2.asp |
| Disallow | /js/common/footer.js |
| Disallow | /js/common/top.js |
| Disallow | /db2/user/dom_air_date.js |
| Disallow | /t/ |
| Disallow | /smart/pc.asp |
| Disallow | /smart/sp.asp |
| Disallow | /domtour/pricelist/ |
| Disallow | /tour/pricelist/ |
| Disallow | /yair/pricelist/ |
| Disallow | /db/user/detail_it.asp |
| Disallow | /db2/user/detail_dt.asp |
| Disallow | /db2/user/detail_da.asp |
| Disallow | /db/user/detail_ia.asp |
| Disallow | /it/ |
| Disallow | /ia/ |
| Disallow | /dt/ |
| Disallow | /da/ |
| Disallow | /magcamp/ |
| Disallow | /point/d/ |
| Disallow | /js/point/dt.js |
| Disallow | /js/point/it.js |
| Disallow | /domtour/pop_cal.asp |
| Disallow | /db2/user/search_tour_htlinfo.html |
| Disallow | /tourcount/ |
| Disallow | /tk/travel.asp |
| Disallow | /world/link/send/ |
| Disallow | /guide/api/ |
| Allow | /guide/api/common/ |
| Disallow | /guide/analysis/ |
| Disallow | /guide/maintenance/ |
bingbot
| Rule | Path |
|---|---|
| Disallow | /tourcount2.asp |
| Disallow | /clkcnt.asp |
| Disallow | /send.asp |
| Disallow | /ads.asp |
| Disallow | /src/dtk/ |
| Disallow | /src/dt/ |
| Disallow | /src/it/ |
| Disallow | /src/ia/ |
| Disallow | /src/da/ |
| Disallow | /it/ |
| Disallow | /ia/ |
| Disallow | /dt/ |
| Disallow | /da/ |
| Disallow | /db2/user/ |
| Disallow | /db/user/ |
| Disallow | /prlst/da/searchprice* |
| Disallow | /tourcount/ |
| Disallow | /tourcount3.asp |
| Disallow | /send2.asp |
ahrefsbot
| Rule | Path |
|---|---|
| Disallow | /tourcount2.asp |
| Disallow | /clkcnt.asp |
| Disallow | /send.asp |
| Disallow | /ads.asp |
| Disallow | /src/dtk/ |
| Disallow | /src/dt/ |
| Disallow | /src/it/ |
| Disallow | /src/ia/ |
| Disallow | /src/da/ |
| Disallow | /it/ |
| Disallow | /ia/ |
| Disallow | /dt/ |
| Disallow | /da/ |
| Disallow | /db2/user/ |
| Disallow | /db/user/ |
| Disallow | /prlst/da/searchprice* |
| Disallow | /tourcount/ |
| Disallow | /tourcount3.asp |
| Disallow | /send2.asp |
baiduspider
| Rule | Path |
|---|---|
| Disallow | /tourcount2.asp |
| Disallow | /clkcnt.asp |
| Disallow | /send.asp |
| Disallow | /ads.asp |
| Disallow | /src/dtk/ |
| Disallow | /src/dt/ |
| Disallow | /src/it/ |
| Disallow | /src/ia/ |
| Disallow | /src/da/ |
| Disallow | /it/ |
| Disallow | /ia/ |
| Disallow | /dt/ |
| Disallow | /da/ |
| Disallow | /db2/user/ |
| Disallow | /db/user/ |
| Disallow | /prlst/da/searchprice* |
| Disallow | /tourcount/ |
| Disallow | /tourcount3.asp |
| Disallow | /send2.asp |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
baiduspider+
| Rule | Path |
|---|---|
| Disallow | /tourcount2.asp |
| Disallow | /clkcnt.asp |
| Disallow | /ads.asp |
| Disallow | /send.asp |
| Disallow | /src/dtk/ |
| Disallow | /src/dt/ |
| Disallow | /src/it/ |
| Disallow | /src/ia/ |
| Disallow | /src/da/ |
| Disallow | /it/ |
| Disallow | /ia/ |
| Disallow | /dt/ |
| Disallow | /da/ |
| Disallow | /db2/user/ |
| Disallow | /db/user/ |
| Disallow | /prlst/da/searchprice* |
| Disallow | /tourcount/ |
| Disallow | /tourcount3.asp |
| Disallow | /send2.asp |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
dotbot
| Rule | Path |
|---|---|
| Disallow | /tourcount2.asp |
| Disallow | /clkcnt.asp |
| Disallow | /ads.asp |
| Disallow | /send.asp |
| Disallow | /src/dtk/ |
| Disallow | /src/dt/ |
| Disallow | /src/it/ |
| Disallow | /src/ia/ |
| Disallow | /src/da/ |
| Disallow | /db/ |
| Disallow | /db2/ |
| Disallow | /tourcount/ |
| Disallow | /tourcount3.asp |
| Disallow | /send2.asp |
ask jeeves
| Rule | Path |
|---|---|
| Disallow | /00500/ |
| Disallow | /campaign/ |
| Disallow | /db/comm/ |
| Disallow | /00300/db/comm/ |
| Disallow | /00600/db/comm/ |
| Disallow | /00700/db/user/ |
| Disallow | /00700/db2/user/ |
| Disallow | /db2/comm/ |
| Disallow | /error/ |
| Disallow | /gds/ |
| Disallow | /link/ |
| Disallow | /mozi_senmonten/ |
| Disallow | /img/ |
| Disallow | /00300/img/ |
| Disallow | /00600/img/ |
| Disallow | /img000/ |
| Disallow | /inc/ |
| Disallow | /include/ |
| Disallow | /log/ |
| Disallow | /p/ |
| Disallow | /pamphlet/ |
| Disallow | /tour_j/ |
| Disallow | /tour_ins/ |
| Disallow | /magcamp/ |
| Disallow | /magazine/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.travel.co.jp/guide/sitemap.xml |
Comments