fujichuo-housedo.com
robots.txt
Robots Exclusion Standard data for fujichuo-housedo.com
Resource Scan
Scan Details
| Site Domain | fujichuo-housedo.com |
| Base Domain | fujichuo-housedo.com |
| Scan Status | Ok |
| Last Scan | 2024-11-05T17:28:57+00:00 |
| Next Scan | 2024-12-05T17:28:57+00:00 |
Last Scan
| Scanned | 2024-11-05T17:28:57+00:00 |
| URL | https://fujichuo-housedo.com/robots.txt |
| Domain IPs | 3.165.82.36, 3.165.82.37, 3.165.82.8, 3.165.82.95 |
| Response IP | 3.165.82.37 |
| Found | Yes |
| Hash | e0d745fca740b81dff1b95c82460eb093d0f00784d4f2a771c8220d281c2d4ba |
| SimHash | 1a7d7442df3c |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /php-comps/ |
| Disallow | /php-partials/ |
| Disallow | /node_modules/ |
| Disallow | /test/ |
bingbot
| Rule | Path |
|---|---|
| Disallow | /php-comps/ |
| Disallow | /php-partials/ |
| Disallow | /node_modules/ |
| Disallow | /test/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 150 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /php-comps/ |
| Disallow | /php-partials/ |
| Disallow | /node_modules/ |
| Disallow | /test/ |
slurp
| Rule | Path |
|---|---|
| Disallow | /php-comps/ |
| Disallow | /php-partials/ |
| Disallow | /node_modules/ |
| Disallow | /test/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
msnbot
| Rule | Path |
|---|---|
| Disallow | /php-comps/ |
| Disallow | /php-partials/ |
| Disallow | /node_modules/ |
| Disallow | /test/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 150 |
msnbot-media
| Rule | Path |
|---|---|
| Disallow | /php-comps/ |
| Disallow | /php-partials/ |
| Disallow | /node_modules/ |
| Disallow | /test/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 150 |
teoma
| Rule | Path |
|---|---|
| Disallow | /php-comps/ |
| Disallow | /php-partials/ |
| Disallow | /node_modules/ |
| Disallow | /test/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 600 |
yandex
| Rule | Path |
|---|---|
| Disallow | /php-comps/ |
| Disallow | /php-partials/ |
| Disallow | /node_modules/ |
| Disallow | /test/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 600 |
Warnings
- 4 invalid lines.