chemydata.com
robots.txt
Robots Exclusion Standard data for chemydata.com
Resource Scan
Scan Details
| Site Domain | chemydata.com |
| Base Domain | chemydata.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2026-02-11T00:38:12+00:00 |
| Next Scan | 2026-02-25T00:38:12+00:00 |
Last Successful Scan
| Scanned | 2026-01-27T00:36:00+00:00 |
| URL | https://chemydata.com/robots.txt |
| Domain IPs | 104.21.10.164, 172.67.146.3, 2606:4700:3030::6815:aa4, 2606:4700:3032::ac43:9203 |
| Response IP | 104.21.10.164 |
| Found | Yes |
| Hash | 67d171a2218651fb1b88cb9f1c53e3940af5dba1d7b7ba92592bc16f5e584257 |
| SimHash | 3c20e842e518 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | - | |
| Disallow | /Search/ | Prevent indexing of search result pages |
| Disallow | /Localization/ | Prevent indexing of language switcher |
| Disallow | /SiteMap/ | Prevent indexing of sitemap controller (XML is enough) |
Other Records
| Field | Value |
|---|---|
| sitemap | https://chemydata.com/sitemap.xml |
Comments