magwayfootballclub.com
robots.txt
Robots Exclusion Standard data for magwayfootballclub.com
Resource Scan
Scan Details
Site Domain | magwayfootballclub.com |
Base Domain | magwayfootballclub.com |
Scan Status | Ok |
Last Scan | 2024-11-04T21:15:40+00:00 |
Next Scan | 2024-11-11T21:15:40+00:00 |
Last Scan
Scanned | 2024-11-04T21:15:40+00:00 |
URL | https://magwayfootballclub.com/robots.txt |
Domain IPs | 104.21.51.197, 172.67.185.126, 2606:4700:3032::ac43:b97e, 2606:4700:3035::6815:33c5 |
Response IP | 104.21.51.197 |
Found | Yes |
Hash | 454fa401b8bf7ed5e2fabe47d6121fd38d875797c8bdbc377324bebfec562d1c |
SimHash | 49081c964711 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /?search= |
Disallow | /admin/ |
Disallow | /files/games/ |
Allow | /files/games/*.swf$ |
Disallow | /policy.html |
Other Records
Field | Value |
---|---|
sitemap | https://magwayfootballclub.com/sitemap-en.xml |