42doit.com
robots.txt

Robots Exclusion Standard data for 42doit.com

Resource Scan

Scan Details

Site Domain 42doit.com
Base Domain 42doit.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-01T21:30:55+00:00
Next Scan 2025-12-31T21:30:55+00:00

Last Successful Scan

Scanned2025-10-11T03:14:00+00:00
URL https://42doit.com/robots.txt
Redirect https://www.42doit.com/robots.txt
Redirect Domain www.42doit.com
Redirect Base 42doit.com
Domain IPs 185.151.30.219
Redirect IPs 185.151.30.219
Response IP 185.151.30.219
Found Yes
Hash 3c474615aafe7b6f4fa17161a681ba9ec9b70e47637cbe22ceaf22c9cca26a6b
SimHash 6900cc004993

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.42doit.com/sitemap_index.xml