lawyers.law.cornell.edu
robots.txt

Robots Exclusion Standard data for lawyers.law.cornell.edu

Resource Scan

Scan Details

Site Domain lawyers.law.cornell.edu
Base Domain cornell.edu
Scan Status Ok
Last Scan2024-05-25T19:31:28+00:00
Next Scan 2024-06-24T19:31:28+00:00

Last Scan

Scanned2024-05-25T19:31:28+00:00
URL https://lawyers.law.cornell.edu/robots.txt
Domain IPs 3.225.214.239, 44.208.206.166
Response IP 44.208.206.166
Found Yes
Hash cc87770309556e4a1cbb037cf91719274fe5023b9f5068aa52f9b093f74803a0
SimHash a808d120ef12

Groups

piplbot

Rule Path
Disallow /search*

*

Rule Path
Disallow /claim/
Disallow /image_captcha/*
Disallow /image_captcha
Disallow /web*
Allow /