scinapse.io
robots.txt
Robots Exclusion Standard data for scinapse.io
Resource Scan
Scan Details
| Site Domain | scinapse.io |
| Base Domain | scinapse.io |
| Scan Status | Ok |
| Last Scan | 2024-10-31T19:14:24+00:00 |
| Next Scan | 2024-11-30T19:14:24+00:00 |
Last Scan
| Scanned | 2024-10-31T19:14:24+00:00 |
| URL | https://scinapse.io/robots.txt |
| Redirect | https://www.scinapse.io/robots.txt |
| Redirect Domain | www.scinapse.io |
| Redirect Base | scinapse.io |
| Domain IPs | 76.76.21.21 |
| Redirect IPs | 76.76.21.123, 76.76.21.22 |
| Response IP | 76.76.21.142 |
| Found | Yes |
| Hash | 19776b764fd7da1a1c285b92fc7a32688578ef54f49c183e1affe69cfb8eb4ed |
| SimHash | 6b069cf0a191 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search/ |
| Disallow | /papers/*/cited |
| Disallow | /papers/*/ref |
| Disallow | /admin/ |
| Disallow | /collections/ |
| Disallow | /history/ |
| Disallow | /favorites/ |
| Disallow | /user/ |
| Disallow | /users/ |
| Disallow | /book |
| Disallow | /keyword-settings |
| Disallow | /success |
| Disallow | /failure |
| Disallow | /settings |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.scinapse.io/sitemap.xml |