cloze.com
robots.txt
Robots Exclusion Standard data for cloze.com
Resource Scan
Scan Details
Site Domain | cloze.com |
Base Domain | cloze.com |
Scan Status | Ok |
Last Scan | 2024-11-18T16:17:57+00:00 |
Next Scan | 2024-12-02T16:17:57+00:00 |
Last Scan
Scanned | 2024-11-18T16:17:57+00:00 |
URL | https://cloze.com/robots.txt |
Redirect | https://www.cloze.com/robots.txt |
Redirect Domain | www.cloze.com |
Redirect Base | cloze.com |
Domain IPs | 34.198.136.67 |
Redirect IPs | 34.206.118.115 |
Response IP | 3.212.242.32 |
Found | Yes |
Hash | 05c176567114b12cb4bf868989899ad6b386efb8bea9034ae167676da749e5d5 |
SimHash | 2d4cb1581d86 |
Groups
*
Rule | Path |
---|---|
Disallow | /api/ |
Disallow | /me/ |
Disallow | /in/ |
Disallow | /c8/ |
Disallow | /res/ |
Disallow | /r/ |
Disallow | /t/ |
Disallow | /app/reset/ |
Disallow | /app/invite/ |
Disallow | /app/login |
Disallow | /app/confirm/ |
Disallow | /app/unconfirm/ |
Disallow | /app/confirmemail/ |
Disallow | /app/unsubscribe/ |
Disallow | /app/forgot |
Other Records
Field | Value |
---|---|
sitemap | https://www.cloze.com/sitemap.xml |