smart.co
robots.txt

Robots Exclusion Standard data for smart.co

Resource Scan

Scan Details

Site Domain smart.co
Base Domain smart.co
Scan Status Ok
Last Scan2025-11-27T05:27:22+00:00
Next Scan 2025-12-27T05:27:22+00:00

Last Scan

Scanned2025-11-27T05:27:22+00:00
URL https://smart.co/robots.txt
Redirect https://www.smart.co/robots.txt
Redirect Domain www.smart.co
Redirect Base smart.co
Domain IPs 75.2.70.75, 99.83.190.102
Redirect IPs 13.203.125.58, 13.233.175.166, 3.109.243.18
Response IP 57.180.160.60
Found Yes
Hash 92e96a438fbc1de28ffa1a8eae186df07647c05a9da9d60e58e9965a4ca0abb1
SimHash b93994686f92

Groups

*

Rule Path
Disallow /search
Disallow /awards/
Disallow /media/
Disallow /p/

Other Records

Field Value
sitemap https://www.smart.co/sitemap.xml
sitemap https://www.smart.co/sitemap.xml