buzzflicker.com
robots.txt
Robots Exclusion Standard data for buzzflicker.com
Resource Scan
Scan Details
Site Domain | buzzflicker.com |
Base Domain | buzzflicker.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-07-28T04:07:15+00:00 |
Next Scan | 2024-10-26T04:07:15+00:00 |
Last Successful Scan
Scanned | 2021-10-27T02:26:22+00:00 |
URL | https://www.buzzflicker.com/robots.txt |
Found | Yes |
Hash | ab04b2b0c000b27376c8e0c83d4988fec5d541fbf9d57c9829b72ee2bc4d572c |
SimHash | aa15f15704f9 |
Groups
*
Rule | Path | Comment |
---|---|---|
Disallow | / | - |
Disallow | /signup/collablink/ | - |
Allow | /$ | - |
Allow | /sitemap.xml$ | - |
Allow | /login | - |
Allow | /simpleshare | - |
Allow | /services | - |
Allow | /reset | - |
Allow | /signup | - |
Allow | /cdn | The marketing site shares a CDN with the webapp; this prevents those assets from being blocked. |
Allow | /sites | The marketing site shares a CDN with the webapp; this prevents those assets from being blocked. |
Allow | /platform | Platform static assets (Box Elements) share a CDN with the webapp; this prevents those assets from being blocked. |
Allow | /s/ | The "noindex" robots directive is only respected if these pages are crawlable |
Allow | /shared/ | The "noindex" robots directive is only respected if these pages are crawlable |
Allow | /v/ | The "noindex" robots directive is only respected if these pages are crawlable |