refer.mg
robots.txt

Robots Exclusion Standard data for refer.mg

Resource Scan

Scan Details

Site Domain refer.mg
Base Domain refer.mg
Scan Status Ok
Last Scan2024-11-14T16:59:04+00:00
Next Scan 2024-11-21T16:59:04+00:00

Last Scan

Scanned2024-11-14T16:59:04+00:00
URL https://refer.mg/robots.txt
Domain IPs 104.21.10.102, 172.67.162.186, 2606:4700:3033::ac43:a2ba, 2606:4700:3034::6815:a66
Response IP 104.21.10.102
Found Yes
Hash 017b80785df38820d04c9b3bbfe87b4d5987a6810f5a1128f76016b45d8a8748
SimHash a900c004e911

Groups

*

Rule Path
Disallow /dl?*