collegevine.com
robots.txt
Robots Exclusion Standard data for collegevine.com
Resource Scan
Scan Details
Site Domain | collegevine.com |
Base Domain | collegevine.com |
Scan Status | Ok |
Last Scan | 4/14/2025, 5:38:27 AM |
Next Scan | 4/28/2025, 5:38:27 AM |
Last Scan
Scanned | 4/14/2025, 5:38:27 AM |
URL | https://www.collegevine.com/robots.txt |
Domain IPs | 104.18.10.31, 104.18.11.31, 2606:4700::6812:a1f, 2606:4700::6812:b1f |
Response IP | 104.18.11.31 |
Found | Yes |
Hash | 79493c8dadc0df15eb0f19d4c77b7852658558095bd1ab820d39b40a661b861e |
SimHash | 290d9ca0cd83 |
Groups
*
Rule | Path |
---|---|
Disallow | /users/auth/* |
Disallow | /conferences/edit/* |
Disallow | /livestreams/report/* |
Disallow | /flag/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.collegevine.com/sitemap.xml.gz |