clever.com
robots.txt

Robots Exclusion Standard data for clever.com

Resource Scan

Scan Details

Site Domain clever.com
Base Domain clever.com
Scan Status Ok
Last Scan2024-11-15T23:49:48+00:00
Next Scan 2024-11-29T23:49:48+00:00

Last Scan

Scanned2024-11-15T23:49:48+00:00
URL https://clever.com/robots.txt
Domain IPs 54.230.112.120, 54.230.112.41, 54.230.112.7, 54.230.112.71
Response IP 108.156.22.16
Found Yes
Hash eff0938caf8df030708ee7ce88c790a10ea5af03dcd691dfcd0db9a13045bfc5
SimHash a8015c454f12

Groups

*

Rule Path
Disallow /craft/
Disallow /vendor/
Disallow /schools/signup
Disallow /signup
Disallow /appstore/orders/

Other Records

Field Value
sitemap https://clever.com/sitemap.xml