pedia.watcha.com
robots.txt
Robots Exclusion Standard data for pedia.watcha.com
Resource Scan
Scan Details
| Site Domain | pedia.watcha.com |
| Base Domain | watcha.com |
| Scan Status | Ok |
| Last Scan | 2024-06-24T23:51:55+00:00 |
| Next Scan | 2024-07-01T23:51:55+00:00 |
Last Scan
| Scanned | 2024-06-24T23:51:55+00:00 |
| URL | https://pedia.watcha.com/robots.txt |
| Domain IPs | 3.35.106.162, 43.200.24.172, 43.200.78.26, 52.79.238.37 |
| Response IP | 52.79.238.37 |
| Found | Yes |
| Hash | 59d554bb401da15c3605706a4bbeff57c226bc8e4d6135967bee0b0879499ccc |
| SimHash | e154d470da92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /keywordjp |
| Disallow | /api |
| Disallow | /abacus |
bingbot
| Rule | Path |
|---|---|
| Disallow | /keywordjp |
| Disallow | /api |
| Disallow | /abacus |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3600 |
seekportbot
| Rule | Path |
|---|---|
| Disallow | /keywordjp |
| Disallow | /api |
| Disallow | /abacus |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3600 |
dataforseobot
| Rule | Path |
|---|---|
| Disallow | /keywordjp |
| Disallow | /api |
| Disallow | /abacus |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3600 |
coccocbot-web
| Rule | Path |
|---|---|
| Disallow | /keywordjp |
| Disallow | /api |
| Disallow | /abacus |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3600 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://pedia.watcha.com/sitemap/sitemap.xml |