deriv.me
robots.txt
Robots Exclusion Standard data for deriv.me
Resource Scan
Scan Details
| Site Domain | deriv.me |
| Base Domain | deriv.me |
| Scan Status | Ok |
| Last Scan | 2024-06-04T21:12:10+00:00 |
| Next Scan | 2024-06-18T21:12:10+00:00 |
Last Scan
| Scanned | 2024-06-04T21:12:10+00:00 |
| URL | https://deriv.me/robots.txt |
| Domain IPs | 104.26.10.174, 104.26.11.174, 172.67.69.68, 2606:4700:20::681a:aae, 2606:4700:20::681a:bae, 2606:4700:20::ac43:4544 |
| Response IP | 172.67.69.68 |
| Found | Yes |
| Hash | 08fa6ae7de2082161c6e3c79d4d8bf2da38c38ec06488754fc3bd5cef815e0aa |
| SimHash | 1828e8a8c5b0 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /404/ |
| Disallow | /homepage/ |
| Disallow | /landing/ |
| Disallow | /endpoint/ |
| Disallow | /livechat/ |
| Disallow | /storybook/ |
| Disallow | *.binary.sx |
| Disallow | /?region=*%2F |
Other Records
| Field | Value |
|---|---|
| sitemap | https://deriv.com/sitemap-index.xml |
Warnings
- `host` is not a known field.