scholarshipowl.com
robots.txt
Robots Exclusion Standard data for scholarshipowl.com
Resource Scan
Scan Details
| Site Domain | scholarshipowl.com |
| Base Domain | scholarshipowl.com |
| Scan Status | Ok |
| Last Scan | 2024-06-01T20:00:11+00:00 |
| Next Scan | 2024-06-08T20:00:11+00:00 |
Last Scan
| Scanned | 2024-06-01T20:00:11+00:00 |
| URL | https://scholarshipowl.com/robots.txt |
| Domain IPs | 104.22.56.183, 104.22.57.183, 172.67.6.206, 2606:4700:10::6816:38b7, 2606:4700:10::6816:39b7, 2606:4700:10::ac43:6ce |
| Response IP | 172.67.6.206 |
| Found | Yes |
| Hash | 988f375bd0109f45d7bd481e904f6867b868faad6f7e459f6402797cd33baf0b |
| SimHash | 850c581462b0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /backup/ |
| Disallow | /bootstrap/ |
| Disallow | /public/_assets/ |
| Disallow | /public/packages/ |
| Disallow | /vendor/ |
| Disallow | /.git/ |
| Disallow | /composer.json |
| Disallow | /composer.lock |
| Disallow | /CONTRIBUTING.mg |
| Disallow | /drops.sql |
| Disallow | /mysql |
| Disallow | /phpunit.xml |
| Disallow | /readme.md |
| Disallow | /server.php |
| Disallow | /upgrade.md |
| Disallow | /.gitattributes |
| Disallow | /.gitignore |
| Disallow | /my-account/ |
| Disallow | /?q=admin%2F |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://scholarshipowl.com/sitemap.xml |
Comments