thecrowdspace.com
robots.txt
Robots Exclusion Standard data for thecrowdspace.com
Resource Scan
Scan Details
| Site Domain | thecrowdspace.com |
| Base Domain | thecrowdspace.com |
| Scan Status | Ok |
| Last Scan | 2025-10-12T17:27:06+00:00 |
| Next Scan | 2025-10-19T17:27:06+00:00 |
Last Scan
| Scanned | 2025-10-12T17:27:06+00:00 |
| URL | https://thecrowdspace.com/robots.txt |
| Domain IPs | 104.21.23.32, 172.67.208.121, 2606:4700:3033::6815:1720, 2606:4700:3033::ac43:d079 |
| Response IP | 104.21.23.32 |
| Found | Yes |
| Hash | 78ea3f2311d325c101cd9bd3c542d752290012440563ebb443ea32749501312c |
| SimHash | 4946da5542f6 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /xmlrpc.php |
| Disallow | /template.html |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content |
| Disallow | /tag |
| Disallow | /archive |
| Disallow | */trackback/ |
| Disallow | */feed/ |
| Disallow | */comments/ |
| Disallow | /?feed= |
| Disallow | /?s= |
| Allow | /wp-content/uploads/*.js* |
| Allow | /wp-content/uploads/*.css* |
| Allow | /wp-content/uploads/*.jpg* |
| Allow | /wp-content/uploads/*.jpeg* |
| Allow | /wp-content/uploads/*.svg* |
| Allow | /wp-content/uploads/*.png* |
| Allow | /wp-content/uploads/*.bmp* |
| Allow | /wp-content/uploads/*.pdf* |
| Allow | /wp-content/uploads/*.gif* |
| Allow | /wp-content/uploads/*.gif* |
| Allow | /wp-content/uploads/*.jp2* |
| Allow | /wp-content/uploads/*.webp* |
| Allow | /wp-content/cache/*.js* |
| Allow | /wp-content/cache/*.css* |
| Allow | /wp-content/plugins/*.js* |
| Allow | /wp-content/plugins/*.css* |
| Allow | /wp-content/themes/crowd-space/public/favicon/*.* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://thecrowdspace.com/sitemap_index.xml |
Comments