usstoragecenters.com
robots.txt
Robots Exclusion Standard data for usstoragecenters.com
Resource Scan
Scan Details
| Site Domain | usstoragecenters.com |
| Base Domain | usstoragecenters.com |
| Scan Status | Ok |
| Last Scan | 2024-09-22T01:12:46+00:00 |
| Next Scan | 2024-10-22T01:12:46+00:00 |
Last Scan
| Scanned | 2024-09-22T01:12:46+00:00 |
| URL | https://usstoragecenters.com/robots.txt |
| Redirect | https://www.usstoragecenters.com/robots.txt |
| Redirect Domain | www.usstoragecenters.com |
| Redirect Base | usstoragecenters.com |
| Domain IPs | 172.66.41.34, 172.66.42.222, 2606:4700:3108::ac42:2922, 2606:4700:3108::ac42:2ade |
| Redirect IPs | 172.66.41.34, 172.66.42.222, 2606:4700:3108::ac42:2922, 2606:4700:3108::ac42:2ade |
| Response IP | 172.66.42.222 |
| Found | Yes |
| Hash | 6ceb545a15fe4695849a8061d37a9f566338e35db4cff5bdf54b3db2c5aed23b |
| SimHash | 6b005c47cf00 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /aspnet_client/ |
| Disallow | /bin/ |
| Disallow | /config/ |
| Disallow | /Config/ |
| Disallow | /macroscripts/ |
| Disallow | /MacroScripts/ |
| Disallow | /MacroScripts/ |
| Disallow | /macroScripts/ |
| Disallow | /umbraco/ |
| Disallow | /Umbraco/ |
| Disallow | /umbraco_client/ |
| Disallow | /Umbraco_client/ |
| Disallow | /Umbraco_Client/ |
| Disallow | /usercontrols/ |
| Disallow | /UserControls/ |
| Disallow | /xslt/ |
| Disallow | /Xslt/ |
| Disallow | /ui-kit |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.usstoragecenters.com/xml-sitemap |