Log In Sign Up

nftrs.or.jp
robots.txt

Robots Exclusion Standard data for nftrs.or.jp

Resource Scan

Scan Details

Site Domain nftrs.or.jp
Base Domain nftrs.or.jp
Scan Status Ok
Last Scan2024-09-25T06:06:50+00:00
Next Scan 2024-10-25T06:06:50+00:00

Last Scan

Scanned2024-09-25T06:06:50+00:00
URL https://nftrs.or.jp/robots.txt
Redirect https://www.nftrs.or.jp:443/robots.txt
Redirect Domain www.nftrs.or.jp
Redirect Base nftrs.or.jp
Domain IPs 15.197.204.36, 3.33.226.169
Redirect IPs 18.155.68.116, 18.155.68.24, 18.155.68.64, 18.155.68.94, 2600:9000:23d2:3400:1a:da8b:3e00:93a1, 2600:9000:23d2:7e00:1a:da8b:3e00:93a1, 2600:9000:23d2:8200:1a:da8b:3e00:93a1, 2600:9000:23d2:a600:1a:da8b:3e00:93a1, 2600:9000:23d2:aa00:1a:da8b:3e00:93a1, 2600:9000:23d2:ac00:1a:da8b:3e00:93a1, 2600:9000:23d2:f200:1a:da8b:3e00:93a1, 2600:9000:23d2:fc00:1a:da8b:3e00:93a1
Response IP 18.155.68.116
Found Yes
Hash 05cb0afa8a3a14c8768989ebda5ebbec0b946458ada956f39e6b0f96cacd7726
SimHash 2d548b474d60

Groups

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.nftrs.or.jp/sitemap.xml.gz
Back to top

Comments

  • Define access-restrictions for robots/spiders
  • http://www.robotstxt.org/wc/norobots.html
  • By default we allow robots to access all areas of our site
  • already accessible to anonymous users
Back to top