salvagedata.com
robots.txt
Robots Exclusion Standard data for salvagedata.com
Resource Scan
Scan Details
Site Domain | salvagedata.com |
Base Domain | salvagedata.com |
Scan Status | Ok |
Last Scan | 2024-04-26T14:40:07+00:00 |
Next Scan | 2024-05-26T14:40:07+00:00 |
Last Scan
Scanned | 2024-04-26T14:40:07+00:00 |
URL | https://salvagedata.com/robots.txt |
Redirect | https://www.salvagedata.com/robots.txt |
Redirect Domain | www.salvagedata.com |
Redirect Base | salvagedata.com |
Domain IPs | 172.66.40.147, 172.66.43.109, 2606:4700:3108::ac42:2893, 2606:4700:3108::ac42:2b6d |
Redirect IPs | 172.66.40.147, 172.66.43.109, 2606:4700:3108::ac42:2893, 2606:4700:3108::ac42:2b6d |
Response IP | 172.66.40.147 |
Found | Yes |
Hash | 098293d43786123e8247662d26ebc43f5bc9531702e4dfbd1e72a96e9949d84b |
SimHash | 5b019c604907 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | /template-generator/ |
Disallow | */?* |
Disallow | /locations/city/ |
Disallow | /edu-mpg/ |
Disallow | /san-storage-data-recovery/ |
Disallow | /manufacturers/mpg_brand/ |
Disallow | /locations/city-tabs/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.salvagedata.com/sitemap_index.xml |
sitemap | https://www.salvagedata.com/manufacturers.xml |
sitemap | https://www.salvagedata.com/server-storage.xml |
sitemap | https://www.salvagedata.com/multipage-sitemap.xml |
sitemap | https://www.salvagedata.com/states.xml |
Warnings
- `host` is not a known field.