bartlebysnopes.com
robots.txt
Robots Exclusion Standard data for bartlebysnopes.com
Resource Scan
Scan Details
Site Domain | bartlebysnopes.com |
Base Domain | bartlebysnopes.com |
Scan Status | Ok |
Last Scan | 2025-06-18T05:46:47+00:00 |
Next Scan | 2025-06-25T05:46:47+00:00 |
Last Scan
Scanned | 2025-06-18T05:46:47+00:00 |
URL | https://bartlebysnopes.com/robots.txt |
Domain IPs | 162.241.230.65 |
Response IP | 162.241.230.65 |
Found | Yes |
Hash | 291e0518ef87b8a726156d903523c766bf0dcaa6a52242251091f49a0ff56b77 |
SimHash | a018780ce9d5 |
Groups
*
Rule | Path |
---|---|
Disallow | /blocks |
Disallow | /concrete |
Disallow | /config |
Disallow | /controllers |
Disallow | /elements |
Disallow | /helpers |
Disallow | /jobs |
Disallow | /languages |
Disallow | /libraries |
Disallow | |
Disallow | /models |
Disallow | /packages |
Disallow | /single_pages |
Disallow | /themes |
Disallow | /tools |
Disallow | /wp |
Other Records
Field | Value |
---|---|
sitemap | http://www.bartlebysnopes.com/sitemap.xml |