Log In Sign Up

nftrs.or.jp
robots.txt

Robots Exclusion Standard data for nftrs.or.jp

Resource Scan

Scan Details

Site Domain nftrs.or.jp
Base Domain nftrs.or.jp
Scan Status Ok
Last Scan2024-10-25T06:07:09+00:00
Next Scan 2024-11-24T06:07:09+00:00

Last Scan

Scanned2024-10-25T06:07:09+00:00
URL https://nftrs.or.jp/robots.txt
Redirect https://www.nftrs.or.jp:443/robots.txt
Redirect Domain www.nftrs.or.jp
Redirect Base nftrs.or.jp
Domain IPs 15.197.204.36, 3.33.226.169
Redirect IPs 18.155.68.116, 18.155.68.24, 18.155.68.64, 18.155.68.94, 2600:9000:23d2:1000:1a:da8b:3e00:93a1, 2600:9000:23d2:2c00:1a:da8b:3e00:93a1, 2600:9000:23d2:4a00:1a:da8b:3e00:93a1, 2600:9000:23d2:7a00:1a:da8b:3e00:93a1, 2600:9000:23d2:7e00:1a:da8b:3e00:93a1, 2600:9000:23d2:a600:1a:da8b:3e00:93a1, 2600:9000:23d2:c00:1a:da8b:3e00:93a1, 2600:9000:23d2:d200:1a:da8b:3e00:93a1
Response IP 18.155.68.24
Found Yes
Hash 05cb0afa8a3a14c8768989ebda5ebbec0b946458ada956f39e6b0f96cacd7726
SimHash 2d548b474d60

Groups

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.nftrs.or.jp/sitemap.xml.gz
Back to top

Comments

  • Define access-restrictions for robots/spiders
  • http://www.robotstxt.org/wc/norobots.html
  • By default we allow robots to access all areas of our site
  • already accessible to anonymous users
Back to top