metalconstructionnews.com
robots.txt
Robots Exclusion Standard data for metalconstructionnews.com
Resource Scan
Scan Details
Site Domain | metalconstructionnews.com |
Base Domain | metalconstructionnews.com |
Scan Status | Ok |
Last Scan | 2024-11-01T07:27:15+00:00 |
Next Scan | 2024-11-08T07:27:15+00:00 |
Last Scan
Scanned | 2024-11-01T07:27:15+00:00 |
URL | https://metalconstructionnews.com/robots.txt |
Redirect | https://www.metalconstructionnews.com/robots.txt |
Redirect Domain | www.metalconstructionnews.com |
Redirect Base | metalconstructionnews.com |
Domain IPs | 52.60.84.107 |
Redirect IPs | 52.60.84.107 |
Response IP | 52.60.84.107 |
Found | Yes |
Hash | 1e1cb4ca0cb762c2221cb2c7888ba34b27e76422ed4168895e4a7e9efb2f149b |
SimHash | c928da80e3f2 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/admin-ajax.php |
Disallow | /wp-admin/ |
Disallow | /wp-snapshots/ |
Disallow | */trackback/ |
Disallow | */feed/ |
Disallow | /*/feed/rss/$ |
Disallow | /media/ |