Log In Sign Up

nuri-kae.jp
robots.txt

Robots Exclusion Standard data for nuri-kae.jp

Resource Scan

Scan Details

Site Domain nuri-kae.jp
Base Domain nuri-kae.jp
Scan Status Ok
Last Scan2024-05-01T20:20:49+00:00
Next Scan 2024-05-31T20:20:49+00:00

Last Scan

Scanned2024-05-01T20:20:49+00:00
URL https://nuri-kae.jp/robots.txt
Redirect https://www.nuri-kae.jp/robots.txt
Redirect Domain www.nuri-kae.jp
Redirect Base nuri-kae.jp
Domain IPs 18.155.68.113, 18.155.68.47, 18.155.68.78, 18.155.68.79
Redirect IPs 13.33.30.114, 13.33.30.123, 13.33.30.8, 13.33.30.96
Response IP 13.33.30.8
Found Yes
Hash 9278b64244d4856efd0218032f51d9c12ebb3c962aa963298847b9753994d836
SimHash 9aad4b856045

Groups

anthill

Rule Path
Disallow /

*

Rule Path
Disallow /order
Disallow /order/
Disallow /partner
Disallow /partner/
Disallow /subsidies/area/*/*/part/
Disallow /subsidies/country/
Disallow /subsidies/prefecture/
Disallow /subsidies/major_city/
Disallow /subsidies/city/
Back to top

Other Records

Field Value
sitemap https://www.nuri-kae.jp/sitemap/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top