otech.edu
robots.txt
Robots Exclusion Standard data for otech.edu
Resource Scan
Scan Details
Site Domain | otech.edu |
Base Domain | otech.edu |
Scan Status | Ok |
Last Scan | 2024-09-08T18:25:34+00:00 |
Next Scan | 2024-10-08T18:25:34+00:00 |
Last Scan
Scanned | 2024-09-08T18:25:34+00:00 |
URL | https://otech.edu/robots.txt |
Domain IPs | 67.225.255.208 |
Response IP | 67.225.255.208 |
Found | Yes |
Hash | 8d614d2296c5a7ff9beb7f31f691869b4b5bd831c7cfa7a316064952801abb15 |
SimHash | 539e714a8383 |
Groups
*
Rule | Path |
---|---|
Disallow | /main/wp-admin |
Disallow | /main/wp-includes |
Disallow | /main/wp-content/plugins |
Disallow | /main/wp-content/cache |
Disallow | /main/wp-content/themes |
Disallow | /main/trackback |
Disallow | /main/tag |
Disallow | /main/author |
Disallow | /main/wget/ |
Disallow | /main/httpd/ |
Disallow | /main/cgi-bin |
Disallow | /main/images/%3C/pre%3E |
Disallow | /main/search |
Disallow | /main/feed |
Disallow | /main/feed/ |
Disallow | /main/trackback |
Disallow | /main/trackback/ |
Disallow | /main/rss |
Disallow | /main/comments/feed |
Disallow | /main/feed/$ |
Disallow | /main/*/feed/$ |
Disallow | /main/*/feed/rss/$ |
Disallow | /main/*/trackback/$ |
Disallow | /files |
Disallow | /v3flashslideshow |
Disallow | /temp |
Disallow | /forms |
Disallow | /formtools |
Disallow | /formtools2 |
Disallow | /includes |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
Other Records
Field | Value |
---|---|
sitemap | https://www.otech.edu/sitemap.xml |
Warnings
- 4 invalid lines.
Comments