willmaster.com
robots.txt
Robots Exclusion Standard data for willmaster.com
Resource Scan
Scan Details
| Site Domain | willmaster.com |
| Base Domain | willmaster.com |
| Scan Status | Ok |
| Last Scan | 2025-11-25T22:01:59+00:00 |
| Next Scan | 2025-12-02T22:01:59+00:00 |
Last Scan
| Scanned | 2025-11-25T22:01:59+00:00 |
| URL | https://willmaster.com/robots.txt |
| Redirect | https://www.willmaster.com/robots.txt |
| Redirect Domain | www.willmaster.com |
| Redirect Base | willmaster.com |
| Domain IPs | 66.33.193.44 |
| Redirect IPs | 66.33.193.44 |
| Response IP | 66.33.193.44 |
| Found | Yes |
| Hash | b87fabee1b80116d8fa5fac6e6929a49736bc95457959aaad23d2e66f0ecf764 |
| SimHash | ec41e932d2ea |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /2/ |
| Disallow | /t/ |
| Disallow | /go/ |
| Disallow | /logos/ |
| Disallow | /mage/ |
| Disallow | /specs/ |
| Disallow | /email/ |
| Disallow | /master/ |
| Disallow | /godemo/ |
| Disallow | /altdest/ |
| Disallow | /testing/ |
| Disallow | /cgi-bin/ |
| Disallow | /php-bin/ |
| Disallow | /04image/ |
| Disallow | /05images/ |
| Disallow | /08images/ |
| Disallow | /affimages/ |
| Disallow | /blogimages/ |
| Disallow | /-bannedaddys/ |
| Disallow | /support/forum/ |
| Disallow | /wm-bcmstemplates2/ |
| Disallow | /software/WebSitesSecret/demonstrations/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |