Log In Sign Up

unilink.io
robots.txt

Robots Exclusion Standard data for unilink.io

Resource Scan

Scan Details

Site Domain unilink.io
Base Domain unilink.io
Scan Status Ok
Last Scan2024-05-19T08:30:18+00:00
Next Scan 2024-06-18T08:30:18+00:00

Last Scan

Scanned2024-05-19T08:30:18+00:00
URL https://unilink.io/robots.txt
Domain IPs 18.155.68.105, 18.155.68.110, 18.155.68.21, 18.155.68.25, 2600:9000:23d2:4e00:1e:af42:c880:93a1, 2600:9000:23d2:6000:1e:af42:c880:93a1, 2600:9000:23d2:7600:1e:af42:c880:93a1, 2600:9000:23d2:7800:1e:af42:c880:93a1, 2600:9000:23d2:ba00:1e:af42:c880:93a1, 2600:9000:23d2:da00:1e:af42:c880:93a1, 2600:9000:23d2:e400:1e:af42:c880:93a1, 2600:9000:23d2:f600:1e:af42:c880:93a1
Response IP 18.155.68.25
Found Yes
Hash d8c24af8b084e6ed3111c91fd5866f4bb2adb9c8773ced88d8d89bd6ce7c4975
SimHash b2850d8d7550

Groups

*

Rule Path
Disallow
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top