bartleby.com
robots.txt
Robots Exclusion Standard data for bartleby.com
Resource Scan
Scan Details
| Site Domain | bartleby.com |
| Base Domain | bartleby.com |
| Scan Status | Ok |
| Last Scan | 2024-05-03T23:43:55+00:00 |
| Next Scan | 2024-05-10T23:43:55+00:00 |
Last Scan
| Scanned | 2024-05-03T23:43:55+00:00 |
| URL | https://bartleby.com/robots.txt |
| Domain IPs | 108.157.254.111, 108.157.254.36, 108.157.254.38, 108.157.254.58 |
| Response IP | 108.157.254.38 |
| Found | Yes |
| Hash | a391557f6996787894fe95b3329e1c0085e7733ca83a0b3fc585e03f4e60a8d2 |
| SimHash | 2ea17f4559d2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /_next/ |
| Disallow | /auth/ |
| Disallow | /backstoschoolsweepstakes |
| Disallow | /cgi-bin/ |
| Disallow | /config.js |
| Disallow | /content/access |
| Disallow | /contestrules |
| Disallow | /dashboard |
| Disallow | /document/ |
| Disallow | /doubleclick/adx_iframe.html |
| Disallow | /exponential/buster.html |
| Disallow | /homework-help/ |
| Disallow | /lti/ |
| Disallow | /retain |
| Disallow | /payment |
| Disallow | /scripts/ |
| Disallow | /search |
| Disallow | /sign-out |
| Disallow | /unlock-request |
| Disallow | /uploads |
| Disallow | /welcomeback |
| Disallow | /s/ |
| Disallow | /file/ |
| Disallow | /virtual/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bartleby.com/sitemap_index.xml |
| sitemap | https://www.bartleby.com/static/sitemap.xml |