bartelby.net
robots.txt
Robots Exclusion Standard data for bartelby.net
Resource Scan
Scan Details
| Site Domain | bartelby.net |
| Base Domain | bartelby.net |
| Scan Status | Ok |
| Last Scan | 2024-11-15T16:30:17+00:00 |
| Next Scan | 2024-11-22T16:30:17+00:00 |
Last Scan
| Scanned | 2024-11-15T16:30:17+00:00 |
| URL | http://bartelby.net/robots.txt |
| Redirect | https://www.bartleby.com:443/robots.txt |
| Redirect Domain | www.bartleby.com |
| Redirect Base | bartleby.com |
| Domain IPs | 18.235.145.90, 52.86.198.250 |
| Redirect IPs | 108.157.254.111, 108.157.254.36, 108.157.254.38, 108.157.254.58 |
| Response IP | 108.157.254.58 |
| Found | Yes |
| Hash | ce1b84b3bdf4bec0491440cbd51413cdf3060c3fc4d04578d445215d8366209f |
| SimHash | 2ea97f611bc2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /_next/ |
| Disallow | /auth/ |
| Disallow | /backstoschoolsweepstakes |
| Disallow | /cgi-bin/ |
| Disallow | /config.js |
| Disallow | /content/access |
| Disallow | /contestrules |
| Disallow | /dashboard |
| Disallow | /document/ |
| Disallow | /doubleclick/adx_iframe.html |
| Disallow | /exponential/buster.html |
| Disallow | /homework-help/ |
| Disallow | /lti/ |
| Disallow | /retain |
| Disallow | /payment |
| Disallow | /scripts/ |
| Disallow | /search |
| Disallow | /sign-out |
| Disallow | /unlock-request |
| Disallow | /uploads |
| Disallow | /welcomeback |
| Disallow | /s/ |
| Disallow | /file/ |
| Disallow | /virtual/ |
| Disallow | /essay-snapshot/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bartleby.com/sitemap_index.xml |
| sitemap | https://www.bartleby.com/static/sitemap.xml |