shefinds.com
robots.txt
Robots Exclusion Standard data for shefinds.com
Resource Scan
Scan Details
| Site Domain | shefinds.com |
| Base Domain | shefinds.com |
| Scan Status | Ok |
| Last Scan | 2024-05-14T22:22:38+00:00 |
| Next Scan | 2024-05-21T22:22:38+00:00 |
Last Scan
| Scanned | 2024-05-14T22:22:38+00:00 |
| URL | https://shefinds.com/robots.txt |
| Redirect | https://www.shefinds.com/robots.txt |
| Redirect Domain | www.shefinds.com |
| Redirect Base | shefinds.com |
| Domain IPs | 104.22.78.143, 104.22.79.143, 172.67.36.32, 2606:4700:10::6816:4e8f, 2606:4700:10::6816:4f8f, 2606:4700:10::ac43:2420 |
| Redirect IPs | 104.22.78.143, 104.22.79.143, 172.67.36.32, 2606:4700:10::6816:4e8f, 2606:4700:10::6816:4f8f, 2606:4700:10::ac43:2420 |
| Response IP | 104.22.79.143 |
| Found | Yes |
| Hash | d0ed7d9a671f9c05c005ff4bd39c138f156fff07d8ba59b575c6471418d233ff |
| SimHash | c929dc528657 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /content/press/ |
| Disallow | /press/ibd.htm |
| Disallow | /all.html |
| Disallow | /buy.html |
| Disallow | *? |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 25 |
*
| Rule | Path |
|---|---|
| Disallow | /wp-content/uploads/wp-import-export-lite/ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.shefinds.com/sitemap.xml |
| sitemap | https://www.shefinds.com/shop/sitemap.xml |
Comments