findaphd.com
robots.txt
Robots Exclusion Standard data for findaphd.com
Resource Scan
Scan Details
| Site Domain | findaphd.com |
| Base Domain | findaphd.com |
| Scan Status | Ok |
| Last Scan | 2024-05-22T12:09:18+00:00 |
| Next Scan | 2024-06-21T12:09:18+00:00 |
Last Scan
| Scanned | 2024-05-22T12:09:18+00:00 |
| URL | https://findaphd.com/robots.txt |
| Redirect | https://www.findaphd.com/robots.txt |
| Redirect Domain | www.findaphd.com |
| Redirect Base | findaphd.com |
| Domain IPs | 104.26.12.156, 104.26.13.156, 172.67.69.165, 2606:4700:20::681a:c9c, 2606:4700:20::681a:d9c, 2606:4700:20::ac43:45a5 |
| Redirect IPs | 104.26.12.156, 104.26.13.156, 172.67.69.165, 2606:4700:20::681a:c9c, 2606:4700:20::681a:d9c, 2606:4700:20::ac43:45a5 |
| Response IP | 104.26.13.156 |
| Found | Yes |
| Hash | a7e4d2a6d0b0b5dea3eb2ae4e04986c036d9634eb0c2d12d1a0ea9209ad04769 |
| SimHash | df51f4991951 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /uploads/ |
| Disallow | /common/clickcount.aspx* |
| Disallow | /search/phd.aspx?*%2C |
| Disallow | /search/?*%2C |
| Disallow | /search?*%2C |
| Disallow | /phds/?*%2C |
| Disallow | /phds?*%2C |
| Disallow | /phds/*cross-discipline |
| Disallow | /phds*/cross-subject |
| Disallow | /search_beta/ |
| Disallow | *InstName* |
| Disallow | *Sort%3D* |
| Disallow | *DIS%3D* |
| Disallow | */filters/* |
| Disallow | /landing/* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.findaphd.com/sitemap.ashx?sitemap-events-0.xml.gz |
| sitemap | https://www.findaphd.com/sitemap.ashx?sitemap-hurl-0.xml.gz |
| sitemap | https://www.findaphd.com/sitemap.ashx?sitemap-authors-0.xml.gz |
| sitemap | https://www.findaphd.com/sitemap.ashx?sitemap-projects-0.xml.gz |
| sitemap | https://www.findaphd.com/sitemap.ashx?sitemap-custads-0.xml.gz |
| sitemap | https://www.findaphd.com/sitemap.ashx?sitemap-keyword-0.xml.gz |
| sitemap | https://www.findaphd.com/sitemap.ashx?sitemap-search-0.xml.gz |
| sitemap | https://www.findaphd.com/sitemap.ashx?sitemap-static-0.xml.gz |
| sitemap | https://www.findaphd.com/sitemap.ashx?sitemap-opendays-0.xml.gz |
| sitemap | https://www.findaphd.com/sitemap.ashx?sitemap-ref2021-0.xml.gz |
Warnings
- 2 invalid lines.