shkedya.co.il
robots.txt
Robots Exclusion Standard data for shkedya.co.il
Resource Scan
Scan Details
Site Domain | shkedya.co.il |
Base Domain | shkedya.co.il |
Scan Status | Ok |
Last Scan | 2024-05-19T20:27:24+00:00 |
Next Scan | 2024-06-18T20:27:24+00:00 |
Last Scan
Scanned | 2024-05-19T20:27:24+00:00 |
URL | https://shkedya.co.il/robots.txt |
Redirect | https://www.shkedya.co.il/robots.txt |
Redirect Domain | www.shkedya.co.il |
Redirect Base | shkedya.co.il |
Domain IPs | 65.9.112.113, 65.9.112.56, 65.9.112.84, 65.9.112.93 |
Redirect IPs | 65.9.112.113, 65.9.112.56, 65.9.112.84, 65.9.112.93 |
Response IP | 18.165.171.53 |
Found | Yes |
Hash | b98506713ad1d4da93dc6999995b4588c7c0b0f2f575c41be71fac7cdb69b011 |
SimHash | 068a54156673 |
Groups
*
Rule | Path |
---|---|
Disallow | /*order%3D |
Disallow | /*compare_it%3D |
Disallow | /*top$ |
Disallow | /*%2Ctop? |
Disallow | /*mid$ |
Disallow | /*%2Cmid? |
Disallow | /*low$ |
Disallow | /*%2Clow? |
Disallow | /*?q= |
Disallow | /*%26amp%3Bamp%3Bnum_of_cart_items%3D |
Disallow | /*contact?about_product= |
Disallow | /*?payments= |
Disallow | /*payments |
Disallow | /*gclid%3D |
Disallow | /*%26amp%3Bamp%3Bpage%3D |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Warnings
- ` disallow` is not a known field.