ichi-up.net
robots.txt

Robots Exclusion Standard data for ichi-up.net

Resource Scan

Scan Details

Site Domain ichi-up.net
Base Domain ichi-up.net
Scan Status Ok
Last Scan2024-11-11T11:47:49+00:00
Next Scan 2024-11-18T11:47:49+00:00

Last Scan

Scanned2024-11-11T11:47:49+00:00
URL https://ichi-up.net/robots.txt
Domain IPs 18.155.68.110, 18.155.68.118, 18.155.68.25, 18.155.68.91
Response IP 18.155.68.25
Found Yes
Hash 88a826837c356cfe6329bc266a2b2de651e1f173974ebeb864d33e773176c366
SimHash a2852d0d6450

Groups

*

Rule Path
Disallow /users/confirmation
Disallow /users/password/new

Other Records

Field Value
sitemap https://ichi-up.net/sitemap.xml.gz

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines: