Log In Sign Up

webadmit.org
robots.txt

Robots Exclusion Standard data for webadmit.org

Resource Scan

Scan Details

Site Domain webadmit.org
Base Domain webadmit.org
Scan Status Ok
Last Scan2025-10-28T13:16:58+00:00
Next Scan 2025-11-27T13:16:58+00:00

Last Scan

Scanned2025-10-28T13:16:58+00:00
URL https://webadmit.org/robots.txt
Domain IPs 3.234.18.38, 34.192.221.185, 52.4.43.238
Response IP 34.192.221.185
Found Yes
Hash c5ba22d88c006ae3fec8945d96fc713af01d1ac8db87f274245a38a01de8bec1
SimHash b2852d8d6450

Groups

*

Rule Path
Disallow /advisor/requests/new
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top