todojs.com
robots.txt
Robots Exclusion Standard data for todojs.com
Resource Scan
Scan Details
Site Domain | todojs.com |
Base Domain | todojs.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-22T18:20:31+00:00 |
Next Scan | 2024-07-06T18:20:31+00:00 |
Last Successful Scan
Scanned | 2024-05-15T18:20:10+00:00 |
URL | https://www.todojs.com/robots.txt |
Domain IPs | 138.199.44.209, 2a02:6ea0:c806:1::4, 2a02:6ea0:cc2c:1::4, 2a02:6ea0:e210::4, 79.127.211.129, 79.127.237.161 |
Response IP | 79.127.211.129 |
Found | Yes |
Hash | 8c484d6b1e406f7d30286ce5a55c81d463409f0f0f6da718a6d1a3a9bb3e5797 |
SimHash | 6000080089b2 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
*
Rule | Path |
---|---|
Disallow | /lib/uploads/wpo-plugins-tables-list.json |
Other Records
Field | Value |
---|---|
sitemap | https://www.todojs.com/wp-sitemap.xml |