blog.designcrowd.com
robots.txt
Robots Exclusion Standard data for blog.designcrowd.com
Resource Scan
Scan Details
Site Domain | blog.designcrowd.com |
Base Domain | designcrowd.com |
Scan Status | Ok |
Last Scan | 2024-11-13T19:06:47+00:00 |
Next Scan | 2024-11-14T19:06:47+00:00 |
Last Scan
Scanned | 2024-11-13T19:06:47+00:00 |
URL | https://blog.designcrowd.com/robots.txt |
Domain IPs | 13.227.254.19, 13.227.254.24, 13.227.254.47, 13.227.254.61 |
Response IP | 13.227.254.24 |
Found | Yes |
Hash | 648ef5bb6cee83b060e053538ecb5f2165a06bc4c5d1fbecb3a9663eec56a8c7 |
SimHash | 4200db7703c1 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /admin/ |
Disallow | /*.axd |
Disallow | /WebResource.axd |
Disallow | /ScriptResource.axd |
Disallow | /search.aspx* |
Disallow | /report-issue-re-design.aspx?* |
Disallow | /manage-project/ |
Disallow | /manage-account/ |
Disallow | /designer-account/ |
Disallow | /manage-profile/ |
Disallow | /customer-handover/ |
Disallow | /designer-handover/ |
Disallow | /submit-design/ |
Disallow | /login.aspx?returnUrl* |
Disallow | /login?returnUrl* |
Disallow | /s/ |
Disallow | /poll/ |
Disallow | /manage-poll/ |
Disallow | /vote/ |
Other Records
Field | Value |
---|---|
sitemap | https://blog.designcrowd.com/sitemap-index.xml |
Warnings
- 4 invalid lines.
Comments