fightmag.net
robots.txt
Robots Exclusion Standard data for fightmag.net
Resource Scan
Scan Details
Site Domain | fightmag.net |
Base Domain | fightmag.net |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 4/27/2025, 12:22:53 PM |
Next Scan | 7/26/2025, 12:22:53 PM |
Last Successful Scan
Scanned | 1/5/2023, 5:30:21 AM |
URL | https://fightmag.net/robots.txt |
Redirect | https://www.fightmag.com.au/robots.txt |
Redirect Domain | www.fightmag.com.au |
Redirect Base | fightmag.com.au |
Domain IPs | 104.21.31.109, 172.67.176.59, 2606:4700:3032::6815:1f6d, 2606:4700:3032::ac43:b03b |
Redirect IPs | 104.21.89.180, 172.67.145.236, 2606:4700:3030::ac43:91ec, 2606:4700:3033::6815:59b4 |
Response IP | 104.21.89.180 |
Found | Yes |
Hash | 2a254b3a9ad0102fa73ca118abc34ea80085a3aa5d400dc7bc53364ad9980ad7 |
SimHash | 685cc98563d3 |
Groups
*
Rule | Path |
---|---|
Disallow | /readme.html |
Disallow | /cgi-bin/ |