smallmx.com
robots.txt
Robots Exclusion Standard data for smallmx.com
Resource Scan
Scan Details
| Site Domain | smallmx.com |
| Base Domain | smallmx.com |
| Scan Status | Ok |
| Last Scan | 2024-06-07T11:58:23+00:00 |
| Next Scan | 2024-07-07T11:58:23+00:00 |
Last Scan
| Scanned | 2024-06-07T11:58:23+00:00 |
| URL | https://smallmx.com/robots.txt |
| Redirect | https://www.smallmx.com/robots.txt |
| Redirect Domain | www.smallmx.com |
| Redirect Base | smallmx.com |
| Domain IPs | 104.26.14.182, 104.26.15.182, 172.67.74.40, 2606:4700:20::681a:eb6, 2606:4700:20::681a:fb6, 2606:4700:20::ac43:4a28 |
| Redirect IPs | 104.26.14.182, 104.26.15.182, 172.67.74.40, 2606:4700:20::681a:eb6, 2606:4700:20::681a:fb6, 2606:4700:20::ac43:4a28 |
| Response IP | 172.67.74.40 |
| Found | Yes |
| Hash | 7af893fa243296afd17a77c2bc648e25010e8c46176718913e2d8e3473594fb6 |
| SimHash | 8008c943ccf3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /bin/ |
| Disallow | /atos/ |
| Disallow | /Logs/ |
| Disallow | /Views/ |
| Disallow | /Avis/ |
| Disallow | /GoogleShopping/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.smallmx.com/sitemap |
| sitemap | https://www.smallmx.com/sitemap/SiteMapProducts |
| sitemap | https://www.smallmx.com/sitemap/SiteMapBrands |
| sitemap | https://www.smallmx.com/sitemap/SiteMapCategories |
Warnings
- 2 invalid lines.
Comments