smallmx.com
robots.txt
Robots Exclusion Standard data for smallmx.com
Resource Scan
Scan Details
Site Domain | smallmx.com |
Base Domain | smallmx.com |
Scan Status | Ok |
Last Scan | 2024-09-05T12:01:42+00:00 |
Next Scan | 2024-10-05T12:01:42+00:00 |
Last Scan
Scanned | 2024-09-05T12:01:42+00:00 |
URL | https://smallmx.com/robots.txt |
Redirect | https://www.smallmx.com/robots.txt |
Redirect Domain | www.smallmx.com |
Redirect Base | smallmx.com |
Domain IPs | 104.26.14.182, 104.26.15.182, 172.67.74.40, 2606:4700:20::681a:eb6, 2606:4700:20::681a:fb6, 2606:4700:20::ac43:4a28 |
Redirect IPs | 104.26.14.182, 104.26.15.182, 172.67.74.40, 2606:4700:20::681a:eb6, 2606:4700:20::681a:fb6, 2606:4700:20::ac43:4a28 |
Response IP | 104.26.15.182 |
Found | Yes |
Hash | 7af893fa243296afd17a77c2bc648e25010e8c46176718913e2d8e3473594fb6 |
SimHash | 8008c943ccf3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /bin/ |
Disallow | /atos/ |
Disallow | /Logs/ |
Disallow | /Views/ |
Disallow | /Avis/ |
Disallow | /GoogleShopping/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.smallmx.com/sitemap |
sitemap | https://www.smallmx.com/sitemap/SiteMapProducts |
sitemap | https://www.smallmx.com/sitemap/SiteMapBrands |
sitemap | https://www.smallmx.com/sitemap/SiteMapCategories |
Warnings
- 2 invalid lines.
Comments