brothers-brick.com
robots.txt
Robots Exclusion Standard data for brothers-brick.com
Resource Scan
Scan Details
| Site Domain | brothers-brick.com |
| Base Domain | brothers-brick.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T21:14:51+00:00 |
| Next Scan | 2024-11-20T21:14:51+00:00 |
Last Scan
| Scanned | 2024-11-13T21:14:51+00:00 |
| URL | https://www.brothers-brick.com/robots.txt |
| Domain IPs | 52.26.222.248, 54.218.158.28 |
| Response IP | 52.26.222.248 |
| Found | Yes |
| Hash | edfc3dce61e12105d84278826bd8d6fa3e999a7669212adb13b7e1b56d378b28 |
| SimHash | 61095513c6f4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-content/plugins/ |
| Disallow | /readme.html |
| Disallow | /cgi-bin/ |
| Disallow | /20?%3F%2F |
| Disallow | /page/ |
| Disallow | /privacy/ |
| Disallow | /terms-of-service/ |
| Disallow | /downloads/ |
| Disallow | /ads/ |
| Disallow | /graphics/ |
| Disallow | */comment-page-* |
| Disallow | */feed/ |
| Disallow | */trackback/ |
| Disallow | /rss/ |
| Disallow | /*.php$ |
| Disallow | /*.inc$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.brothers-brick.com/sitemap_index.xml |
Comments