ichi-up.net
robots.txt

Robots Exclusion Standard data for ichi-up.net

Resource Scan

Scan Details

Site Domain ichi-up.net
Base Domain ichi-up.net
Scan Status Ok
Last Scan2024-07-01T02:35:32+00:00
Next Scan 2024-07-08T02:35:32+00:00

Last Scan

Scanned2024-07-01T02:35:32+00:00
URL https://ichi-up.net/robots.txt
Domain IPs 13.33.183.105, 13.33.183.22, 13.33.183.58, 13.33.183.9
Response IP 18.155.68.118
Found Yes
Hash 88a826837c356cfe6329bc266a2b2de651e1f173974ebeb864d33e773176c366
SimHash a2852d0d6450

Groups

*

Rule Path
Disallow /users/confirmation
Disallow /users/password/new

Other Records

Field Value
sitemap https://ichi-up.net/sitemap.xml.gz

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines: