crowdspring.com
robots.txt
Robots Exclusion Standard data for crowdspring.com
Resource Scan
Scan Details
| Site Domain | crowdspring.com |
| Base Domain | crowdspring.com |
| Scan Status | Ok |
| Last Scan | 2024-09-29T02:37:50+00:00 |
| Next Scan | 2024-10-29T02:37:50+00:00 |
Last Scan
| Scanned | 2024-09-29T02:37:50+00:00 |
| URL | https://crowdspring.com/robots.txt |
| Redirect | https://www.crowdspring.com/robots.txt |
| Redirect Domain | www.crowdspring.com |
| Redirect Base | crowdspring.com |
| Domain IPs | 107.22.213.183, 2600:1f18:11e:5601:db53:c754:bd90:5c44, 2600:1f18:11e:5602:a9a7:df34:a0d0:6df7, 2600:1f18:11e:5603:1b6d:dc0a:28db:34b2, 3.226.58.43, 34.232.218.179 |
| Redirect IPs | 107.22.213.183, 2600:1f18:11e:5601:db53:c754:bd90:5c44, 2600:1f18:11e:5602:a9a7:df34:a0d0:6df7, 2600:1f18:11e:5603:1b6d:dc0a:28db:34b2, 3.226.58.43, 34.232.218.179 |
| Response IP | 3.226.58.43 |
| Found | Yes |
| Hash | b1f6c0a821024eb143596c9df60f070405301ff5661e22b7b6dd346e0c19cc09 |
| SimHash | 6098d002a7a0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /login/ |
| Disallow | /join/ |
| Disallow | /register/ |
| Disallow | /projects/*/*/focus-groups/ |
| Disallow | /projects/*/*/settings/ |
| Disallow | /your-projects/ |
| Disallow | /account/ |
| Disallow | /api/v1/ |
| Disallow | /notifications/ |
| Disallow | /logout/ |
| Disallow | /404/ |
| Disallow | /myspring/ |
| Disallow | /projects/*/*/entries/ |
| Disallow | /projects/*/*/entry/ |
| Disallow | /projects/item/*/ |
| Disallow | /projects/edit/*/ |
| Disallow | /entry/ |
| Disallow | /partner/promo/ |
| Disallow | /*?*filter= |
| Disallow | /*?*sort= |
| Disallow | /start-a-project/* |
| Disallow | /users/*/image/ |
| Disallow | /users/*/name/ |
bingbot
| Rule | Path |
|---|---|
| Disallow | /login/ |
| Disallow | /join/ |
| Disallow | /register/ |
| Disallow | /projects/*/*/focus-groups/ |
| Disallow | /projects/*/*/settings/ |
| Disallow | /your-projects/*/*/ |
| Disallow | /account/ |
| Disallow | /api/v1/ |
| Disallow | /notifications/ |
| Disallow | /logout/ |
| Disallow | /404/ |
| Disallow | /myspring/ |
| Disallow | /projects/*/*/entries/ |
| Disallow | /projects/*/*/entry/ |
| Disallow | /projects/item/*/ |
| Disallow | /projects/edit/*/ |
| Disallow | /entry/ |
| Disallow | /partner/promo/ |
| Disallow | /*?*filter= |
| Disallow | /*?*sort= |
| Disallow | /start-a-project/* |
| Disallow | /users/*/image/ |
| Disallow | /users/*/name/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.crowdspring.com/sitemap/sitemap.xml |
| sitemap | https://www.crowdspring.com/blog/sitemap_index.xml |
| sitemap | https://www.crowdspring.com/resources/sitemap_index.xml |
| sitemap | https://www.crowdspring.com/sitemap/sitemap.xml |
| sitemap | https://www.crowdspring.com/blog/sitemap_index.xml |
| sitemap | https://www.crowdspring.com/resources/sitemap_index.xml |
Comments