techsoup.org
robots.txt
Robots Exclusion Standard data for techsoup.org
Resource Scan
Scan Details
| Site Domain | techsoup.org |
| Base Domain | techsoup.org |
| Scan Status | Ok |
| Last Scan | 2025-12-03T13:28:31+00:00 |
| Next Scan | 2026-01-02T13:28:31+00:00 |
Last Scan
| Scanned | 2025-12-03T13:28:31+00:00 |
| URL | https://techsoup.org/robots.txt |
| Redirect | https://www.techsoup.org/robots.txt |
| Redirect Domain | www.techsoup.org |
| Redirect Base | techsoup.org |
| Domain IPs | 45.60.106.93, 45.60.45.93 |
| Redirect IPs | 45.60.49.93 |
| Response IP | 45.60.49.93 |
| Found | Yes |
| Hash | e7659470f2ec1c6758fa4be16d84a69fb36a7fa1b19f1d0759bfda28e04d76d3 |
| SimHash | 6203c7d65f94 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /_layouts/ |
| Disallow | /ReusableContent/ |
| Disallow | /Reports%20List/ |
| Disallow | /WorkflowTasks/ |
| Disallow | /SiteCollectionDocuments/ |
| Disallow | /Documents/Forms/ |
| Disallow | /Pages/Forms/ |
| Disallow | /products/*Tasks$ |
| Disallow | /*?* |
| Allow | /SiteCollectionDocuments/*.pdf$ |
| Allow | /SiteCollectionDocuments/*.PDF$ |
| Allow | /_layouts/*.css* |
| Allow | /_layouts/*.CSS* |
| Allow | /_layouts/*.js* |
| Allow | /_layouts/*.JS* |
| Allow | /_layouts/*.png* |
| Allow | /_layouts/*.PNG* |
| Allow | /_layouts/*.jpg* |
| Allow | /_layouts/*.JPG* |
| Allow | /_layouts/*.jpeg* |
| Allow | /_layouts/*.JPEG* |
| Allow | /_layouts/*.gif* |
| Allow | /_layouts/*.GIF* |
| Allow | /_layouts/*.svg* |
| Allow | /_layouts/*.SVG* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
slurp
msnbot
| Rule | Path |
|---|---|
| Disallow | /_layouts/ |
| Disallow | /ReusableContent/ |
| Disallow | /Reports%20List/ |
| Disallow | /WorkflowTasks/ |
| Disallow | /SiteCollectionDocuments/ |
| Disallow | /Documents/Forms/ |
| Disallow | /Pages/Forms/ |
| Disallow | /products/*Tasks$ |
| Disallow | /*?* |
| Allow | /SiteCollectionDocuments/*.pdf$ |
| Allow | /SiteCollectionDocuments/*.PDF$ |
| Allow | /_layouts/*.css* |
| Allow | /_layouts/*.CSS* |
| Allow | /_layouts/*.js* |
| Allow | /_layouts/*.JS* |
| Allow | /_layouts/*.png* |
| Allow | /_layouts/*.PNG* |
| Allow | /_layouts/*.jpg* |
| Allow | /_layouts/*.JPG* |
| Allow | /_layouts/*.jpeg* |
| Allow | /_layouts/*.JPEG* |
| Allow | /_layouts/*.gif* |
| Allow | /_layouts/*.GIF* |
| Allow | /_layouts/*.svg* |
| Allow | /_layouts/*.SVG* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
Comments