mftransparency.org
robots.txt

Robots Exclusion Standard data for mftransparency.org

Resource Scan

Scan Details

Site Domain mftransparency.org
Base Domain mftransparency.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-02T09:52:03+00:00
Next Scan 2025-12-01T09:52:03+00:00

Last Successful Scan

Scanned2025-07-12T05:58:49+00:00
URL https://www.mftransparency.org/robots.txt
Domain IPs 104.21.29.62, 172.67.148.131, 2606:4700:3032::ac43:9483, 2606:4700:3036::6815:1d3e
Response IP 172.67.148.131
Found Yes
Hash b1b59ad203b1dc0afb5c542c150537209fc722ca7336ef26449cd78af6883b7b
SimHash 6558dcd641b1

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20