mwg.aaa.com
robots.txt

Robots Exclusion Standard data for mwg.aaa.com

Resource Scan

Scan Details

Site Domain mwg.aaa.com
Base Domain aaa.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-10T14:04:54+00:00
Next Scan 2025-10-08T14:04:54+00:00

Last Successful Scan

Scanned2023-11-26T14:01:29+00:00
URL https://mwg.aaa.com/robots.txt
Domain IPs 104.18.8.216, 104.18.9.216, 2606:4700::6812:8d8, 2606:4700::6812:9d8
Response IP 104.18.8.216
Found Yes
Hash 7b3fb854c99a78db4b34e4c4e655da1a0a7528261aa061ad94885bbfde5b04ca
SimHash 6d14dc5067d2

Groups

*

Rule Path
Disallow /search

Other Records

Field Value
crawl-delay 10