kikarhashabat.co.il
robots.txt
Robots Exclusion Standard data for kikarhashabat.co.il
Resource Scan
Scan Details
Site Domain | kikarhashabat.co.il |
Base Domain | kikarhashabat.co.il |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-10-15T04:26:55+00:00 |
Next Scan | 2024-12-14T04:26:55+00:00 |
Last Successful Scan
Scanned | 2024-08-17T04:25:47+00:00 |
URL | http://kikarhashabat.co.il/robots.txt |
Domain IPs | 84.95.137.7 |
Response IP | 84.95.137.7 |
Found | Yes |
Hash | 6657490afe1ecbe6a4e1d8da8f92cb2df43a86897a138d30afdbfb70b72e11ec |
SimHash | 001cc3724691 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /mrlclk.php |
Disallow | /mk_ajax_server.php |
Disallow | /kikartalk/ajax_server.php |
Disallow | /NFORUM/ |
Disallow | /14723412/ |
Disallow | /landing_page.php* |
Disallow | /image.php?id= |
Disallow | /*search.php?q= |
Disallow | /*html?operation=print |
Other Records
Field | Value |
---|---|
sitemap | https://www.kikar.co.il/sitemap/articles.xml |