Log In Sign Up

tower.jp
robots.txt

Robots Exclusion Standard data for tower.jp

Resource Scan

Scan Details

Site Domain tower.jp
Base Domain tower.jp
Scan Status Ok
Last Scan2024-11-12T21:19:07+00:00
Next Scan 2024-11-19T21:19:07+00:00

Last Scan

Scanned2024-11-12T21:19:07+00:00
URL https://tower.jp/robots.txt
Domain IPs 202.238.233.84, 202.238.233.87
Response IP 202.238.233.87
Found Yes
Hash bc6ad120e030eb292e8ff30b95f9736369a3847fd0ec535fde8f264728180a88
SimHash 0d3985434d31

Groups

*

Rule Path
Disallow /ec/shoppingbag/
Disallow /test/
Disallow /site/test/
Disallow /site/sc/
Disallow /site/campaign/md/
Disallow /site/campaign/sp/
Disallow /artist/discography/*?

towerrecords-crawler

Rule Path
Disallow /ec/
Disallow /artist/
Disallow /item/
Disallow /search/
Disallow /feeds/
Disallow /ich/d/
Disallow /news/d/
Back to top

Other Records

Field Value
sitemap https://tower.jp/sitemap.xml
Back to top

Warnings

  • 1 invalid line.
Back to top