karger.com
robots.txt
Robots Exclusion Standard data for karger.com
Resource Scan
Scan Details
| Site Domain | karger.com |
| Base Domain | karger.com |
| Scan Status | Ok |
| Last Scan | 2024-09-21T19:56:02+00:00 |
| Next Scan | 2024-09-28T19:56:02+00:00 |
Last Scan
| Scanned | 2024-09-21T19:56:02+00:00 |
| URL | https://karger.com/robots.txt |
| Domain IPs | 20.246.173.94 |
| Response IP | 20.246.173.94 |
| Found | Yes |
| Hash | 9de2b08f32c951eb56fb0515ce64d365015161fd625d59ad02a9ebcae410bace |
| SimHash | 48011d34a633 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bin/ |
| Disallow | /config/ |
| Disallow | /app_data/ |
| Disallow | /dlls/ |
| Disallow | /App_Themes/ |
| Disallow | /signin.aspx |
| Disallow | /searchresults.aspx |
| Disallow | /advancedsearch.aspx |
| Disallow | /DownloadFile/ |
| Disallow | /downloadimage.aspx |
| Disallow | /Citation/Download |
| Disallow | /Shibboleth.sso/ |
| Disallow | /SignInShibboleth.aspx |
| Disallow | /lookup/external-ref |
| Disallow | /user/logout |
| Disallow | /cgi/pmidlookup |
| Disallow | /Themes/Client/app/img/favicons/manifest.json |
| Disallow | /lookup/google-scholar |
| Disallow | /store/* |
| Allow | /cassette.axd/stylesheet/ |
| Allow | /cassette.axd/script/ |
| Allow | /cassette.axd/manifest.xml |
| Disallow | /*.axd |
| Disallow | /specificToClient1/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://karger.com/data/sitemap/sitemap.xml |
Warnings
- 2 invalid lines.