microtasks.io
robots.txt

Robots Exclusion Standard data for microtasks.io

Resource Scan

Scan Details

Site Domain microtasks.io
Base Domain microtasks.io
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-16T18:26:57+00:00
Next Scan 2025-10-30T18:26:57+00:00

Last Successful Scan

Scanned2025-10-01T16:15:13+00:00
URL https://microtasks.io/robots.txt
Domain IPs 104.21.89.145, 172.67.160.222, 2606:4700:3033::6815:5991, 2606:4700:3037::ac43:a0de
Response IP 104.21.89.145
Found Yes
Hash 4e5ee7c53736ac3428df314dc49f875a5cb4fadcd4636d1fe2891af067e2c5e3
SimHash 695cc4534733

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://microtasks.io/sitemap.xml