walkin.co.il
robots.txt

Robots Exclusion Standard data for walkin.co.il

Resource Scan

Scan Details

Site Domain walkin.co.il
Base Domain walkin.co.il
Scan Status Ok
Last Scan2024-11-15T08:37:45+00:00
Next Scan 2024-12-15T08:37:45+00:00

Last Scan

Scanned2024-11-15T08:37:45+00:00
URL https://walkin.co.il/robots.txt
Redirect https://www.walkin.co.il/robots.txt
Redirect Domain www.walkin.co.il
Redirect Base walkin.co.il
Domain IPs 54.230.112.21, 54.230.112.41, 54.230.112.67, 54.230.112.70
Redirect IPs 54.230.112.21, 54.230.112.41, 54.230.112.67, 54.230.112.70
Response IP 3.164.206.21
Found Yes
Hash faa47a27ae272d5871339b7a301c04c48882a316c650f9c094870a293e20bffb
SimHash 17115c156332

Groups

*

Rule Path
Disallow /*order%3D
Disallow /*compare_it%3D
Disallow /*top$
Disallow /*%2Ctop?
Disallow /*mid$
Disallow /*%2Cmid?
Disallow /*low$
Disallow /*%2Clow?
Disallow /*?q=

Other Records

Field Value
crawl-delay 10