tomade.com
robots.txt
Robots Exclusion Standard data for tomade.com
Resource Scan
Scan Details
| Site Domain | tomade.com |
| Base Domain | tomade.com |
| Scan Status | Ok |
| Last Scan | 2024-09-25T06:19:20+00:00 |
| Next Scan | 2024-10-25T06:19:20+00:00 |
Last Scan
| Scanned | 2024-09-25T06:19:20+00:00 |
| URL | https://tomade.com/robots.txt |
| Redirect | https://www.tomade.com/robots.txt |
| Redirect Domain | www.tomade.com |
| Redirect Base | tomade.com |
| Domain IPs | 104.25.43.119, 104.25.44.119, 2606:4700:20::6819:2b77, 2606:4700:20::6819:2c77 |
| Redirect IPs | 104.25.43.119, 104.25.44.119, 2606:4700:20::6819:2b77, 2606:4700:20::6819:2c77 |
| Response IP | 104.25.43.119 |
| Found | Yes |
| Hash | 45c5ae596241fe6497136fd5e1e751ec1e82961199a7d982097e8e331ec6ae8c |
| SimHash | f321d7fec631 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /checkout/ |
| Disallow | /my/ |
| Disallow | /errors/ |
| Disallow | /static/ |
| Disallow | /users/ |
| Disallow | /*_attrs%3D* |
| Disallow | /*_order%3D* |
| Disallow | /*_q%3D* |
| Disallow | /*_cat%3D* |
| Disallow | /*_size%3D* |
| Disallow | /*_ava%3D* |
| Disallow | /*_new%3D* |
| Disallow | /*_sale%3D* |
| Disallow | /*_minprice%3D* |
| Disallow | /*_maxprice%3D* |
| Disallow | /search?* |
| Disallow | /*_response%3Djson* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.tomade.com/sitemap/sitemaps.xml |
Warnings
- 2 invalid lines.
- `host` is not a known field.