magweta.com
robots.txt

Robots Exclusion Standard data for magweta.com

Resource Scan

Scan Details

Site Domain magweta.com
Base Domain magweta.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-08-21T17:17:55+00:00
Next Scan 2024-11-19T17:17:55+00:00

Last Successful Scan

Scanned2023-10-27T12:40:45+00:00
URL https://magweta.com/robots.txt
Domain IPs 172.234.25.151
Response IP 199.59.243.225
Found Yes
Hash ac7feb4e52fd6b99a1cbde3f2c2c375ba9f263aec80d992ca333ade3c91f4866
SimHash a12ada40c3b3

Groups

*

Rule Path
Allow /
Disallow /?*
Disallow /_zc

Other Records

Field Value
crawl-delay 120