shbonweb.com
robots.txt
Robots Exclusion Standard data for shbonweb.com
Resource Scan
Scan Details
| Site Domain | shbonweb.com |
| Base Domain | shbonweb.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2025-11-15T12:35:48+00:00 |
| Next Scan | 2026-02-13T12:35:48+00:00 |
Last Successful Scan
| Scanned | 2024-04-02T11:44:58+00:00 |
| URL | https://www.shbonweb.com/robots.txt |
| Domain IPs | 104.21.50.172, 172.67.164.106, 2606:4700:3033::6815:32ac, 2606:4700:3037::ac43:a46a |
| Response IP | 172.67.164.106 |
| Found | Yes |
| Hash | 2201ada59a94d7e371bdd6eb4887a7f9b27749e7710f5bab1639da4340a3572a |
| SimHash | 4efcf0f8a573 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /printarticle.asp |
| Disallow | /imageresult.asp |
| Disallow | /medlineresult.asp |
| Disallow | /citeman.asp |
| Disallow | /citation.asp |
| Disallow | /favorites.asp |
| Disallow | /notifyme.asp |
| Disallow | /addremark.asp |
| Disallow | /getarticleimages.asp |
| Disallow | /_aagraph.asp |
| Disallow | /adminlogin.asp |
| Disallow | /emailarticle.asp |
| Disallow | /readercomments.asp |
| Disallow | /getarticleimages.asp |
| Disallow | /temp/*.pdf$ |
| Disallow | /searchresult.asp |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 50 |
msnbot
| Rule | Path |
|---|---|
| Disallow | /printarticle.asp |
| Disallow | /imageresult.asp |
| Disallow | /medlineresult.asp |
| Disallow | /citeman.asp |
| Disallow | /citation.asp |
| Disallow | /favorites.asp |
| Disallow | /notifyme.asp |
| Disallow | /addremark.asp |
| Disallow | /getarticleimages.asp |
| Disallow | /_aagraph.asp |
| Disallow | /adminlogin.asp |
| Disallow | /emailarticle.asp |
| Disallow | /readercomments.asp |
| Disallow | /getarticleimages.asp |
| Disallow | /temp/*.pdf$ |
| Disallow | /searchresult.asp |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 40 |
slurp
| Rule | Path |
|---|---|
| Disallow | /printarticle.asp |
| Disallow | /imageresult.asp |
| Disallow | /medlineresult.asp |
| Disallow | /citeman.asp |
| Disallow | /citation.asp |
| Disallow | /favorites.asp |
| Disallow | /notifyme.asp |
| Disallow | /addremark.asp |
| Disallow | /getarticleimages.asp |
| Disallow | /_aagraph.asp |
| Disallow | /adminlogin.asp |
| Disallow | /emailarticle.asp |
| Disallow | /readercomments.asp |
| Disallow | /getarticleimages.asp |
| Disallow | /temp/*.pdf$ |
| Disallow | /searchresult.asp |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 40 |
Warnings
- `acap-crawler` is not a known field.
- `acap-disallow-crawl` is not a known field.
- `noarchive` is not a known field.
- `nofollow` is not a known field.
Comments