cleverget.com
robots.txt

Robots Exclusion Standard data for cleverget.com

Resource Scan

Scan Details

Site Domain cleverget.com
Base Domain cleverget.com
Scan Status Ok
Last Scan2025-12-05T02:25:56+00:00
Next Scan 2026-01-04T02:25:56+00:00

Last Scan

Scanned2025-12-05T02:25:56+00:00
URL https://cleverget.com/robots.txt
Redirect https://cleverget.org/robots.txt
Redirect Domain cleverget.org
Redirect Base cleverget.org
Domain IPs 172.238.50.199
Redirect IPs 172.66.40.94, 172.66.43.162, 2606:4700:3108::ac42:285e, 2606:4700:3108::ac42:2ba2
Response IP 172.66.40.94
Found Yes
Hash fa3ba714c7bd73f7cb6efd6ea5f172f9ae1953ecad8c510cd11a9cffb62e70c6
SimHash 985fd7206e38

Groups

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /