commonreads.com
robots.txt
Robots Exclusion Standard data for commonreads.com
Resource Scan
Scan Details
Site Domain | commonreads.com |
Base Domain | commonreads.com |
Scan Status | Ok |
Last Scan | 2024-11-04T19:38:02+00:00 |
Next Scan | 2024-12-04T19:38:02+00:00 |
Last Scan
Scanned | 2024-11-04T19:38:02+00:00 |
URL | https://commonreads.com/robots.txt |
Domain IPs | 23.185.0.3, 2620:12a:8000::3, 2620:12a:8001::3 |
Response IP | 23.185.0.3 |
Found | Yes |
Hash | d092d3ffa8e440d3a2699c305973f5064545af5f21107f373980fbcd66fa07b9 |
SimHash | 490048c0c5b3 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp/wp-admin/ |
Allow | /wp/wp-admin/admin-ajax.php |
*
Rule | Path |
---|---|
Disallow |
Other Records
Field | Value |
---|---|
sitemap | https://commonreads.com/sitemap_index.xml |
Comments