mundi.net
robots.txt

Robots Exclusion Standard data for mundi.net

Resource Scan

Scan Details

Site Domain mundi.net
Base Domain mundi.net
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-03-24T17:53:57+00:00
Next Scan 2024-06-22T17:53:57+00:00

Last Successful Scan

Scanned2023-08-03T08:49:14+00:00
URL http://mundi.net/robots.txt
Redirect https://mappa.mundi.net/robots.txt
Redirect Domain mappa.mundi.net
Redirect Base mundi.net
Domain IPs 52.219.120.115
Redirect IPs 52.84.251.23, 52.84.251.30, 52.84.251.38, 52.84.251.40
Response IP 52.84.251.23
Found Yes
Hash f8e5275f16805f1c6c966b34de3cbd4474c0e52b97dee5fb48e84a349be883b4
SimHash ac106b446ec2

Groups

*

Rule Path
Disallow /cgi-bin/

Comments

  • Search Engine Policy for Mappa.Mundi.Net