devicemag.com
robots.txt
Robots Exclusion Standard data for devicemag.com
Resource Scan
Scan Details
Site Domain | devicemag.com |
Base Domain | devicemag.com |
Scan Status | Ok |
Last Scan | 2024-11-01T10:35:49+00:00 |
Next Scan | 2024-11-08T10:35:49+00:00 |
Last Scan
Scanned | 2024-11-01T10:35:49+00:00 |
URL | https://devicemag.com/robots.txt |
Redirect | https://www.devicemag.com/robots.txt |
Redirect Domain | www.devicemag.com |
Redirect Base | devicemag.com |
Domain IPs | 209.58.167.25 |
Redirect IPs | 209.58.173.178 |
Response IP | 209.58.167.25 |
Found | Yes |
Hash | f67843d1b7fd099d1729e8680c4fc5280cfa5f4384e4b43ee63338e98c6c04d5 |
SimHash | c8155c108612 |
Groups
*
Rule | Path |
---|---|
Disallow | /trackback/ |
Disallow | /comments/ |
Disallow | /cgi-bin |
Disallow | /wp-admin |
Disallow | /wp-includes |
Disallow | /author |
Disallow | /wget/ |
Disallow | /httpd/ |
Disallow | /feed/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.devicemag.com/sitemap.xml |