todojs.com
robots.txt

Robots Exclusion Standard data for todojs.com

Resource Scan

Scan Details

Site Domain todojs.com
Base Domain todojs.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-22T18:20:31+00:00
Next Scan 2024-07-06T18:20:31+00:00

Last Successful Scan

Scanned2024-05-15T18:20:10+00:00
URL https://www.todojs.com/robots.txt
Domain IPs 138.199.44.209, 2a02:6ea0:c806:1::4, 2a02:6ea0:cc2c:1::4, 2a02:6ea0:e210::4, 79.127.211.129, 79.127.237.161
Response IP 79.127.211.129
Found Yes
Hash 8c484d6b1e406f7d30286ce5a55c81d463409f0f0f6da718a6d1a3a9bb3e5797
SimHash 6000080089b2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /lib/uploads/wpo-plugins-tables-list.json

Other Records

Field Value
sitemap https://www.todojs.com/wp-sitemap.xml