scholargps.com
robots.txt
Robots Exclusion Standard data for scholargps.com
Resource Scan
Scan Details
| Site Domain | scholargps.com |
| Base Domain | scholargps.com |
| Scan Status | Ok |
| Last Scan | 2025-12-23T03:38:04+00:00 |
| Next Scan | 2026-01-22T03:38:04+00:00 |
Last Scan
| Scanned | 2025-12-23T03:38:04+00:00 |
| URL | https://scholargps.com/robots.txt |
| Domain IPs | 2600:9000:28c2:1a00:17:a184:fc0:93a1, 2600:9000:28c2:6000:17:a184:fc0:93a1, 2600:9000:28c2:6c00:17:a184:fc0:93a1, 2600:9000:28c2:6e00:17:a184:fc0:93a1, 2600:9000:28c2:7400:17:a184:fc0:93a1, 2600:9000:28c2:8600:17:a184:fc0:93a1, 2600:9000:28c2:9a00:17:a184:fc0:93a1, 2600:9000:28c2:e400:17:a184:fc0:93a1, 3.171.198.117, 3.171.198.37, 3.171.198.45, 3.171.198.61 |
| Response IP | 3.171.198.61 |
| Found | Yes |
| Hash | df024d940574e7c886e68952e7b2f66a10f7902c9bc988280510ac088e217241 |
| SimHash | 731910c16514 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search.php |
| Disallow | /claim_profile.php |
| Disallow | /citations.php |
| Disallow | /captcha.php |
| Disallow | /report_profile.php |
amazonbot
applebot
baiduspider
bingbot
bytespider
facebookbot
google-extended
googleother
gptbot
petalbot
semrushbot
sogou web spider
yandex
| Rule | Path |
|---|---|
| Disallow | /search.php |
| Disallow | /claim_profile.php |
| Disallow | /citations.php |
| Disallow | /captcha.php |
| Disallow | /limited.php |
| Disallow | /report_profile.php |
| Disallow | /*/ |
| Disallow | /scholars/ |
| Disallow | /highly-ranked-scholars? |
| Disallow | /institutional-rankings? |
| Disallow | /highly-cited-publications? |
| Disallow | /top-scholars? |
Other Records
| Field | Value |
|---|---|
| sitemap | https://scholargps.com/sitemap_index.xml |