arad2000.co.il
robots.txt
Robots Exclusion Standard data for arad2000.co.il
Resource Scan
Scan Details
Site Domain | arad2000.co.il |
Base Domain | arad2000.co.il |
Scan Status | Ok |
Last Scan | 2024-09-21T23:55:04+00:00 |
Next Scan | 2024-10-21T23:55:04+00:00 |
Last Scan
Scanned | 2024-09-21T23:55:04+00:00 |
URL | https://arad2000.co.il/robots.txt |
Redirect | http://www.arad2000.co.il/robots.txt |
Redirect Domain | www.arad2000.co.il |
Redirect Base | arad2000.co.il |
Domain IPs | 54.76.177.85 |
Redirect IPs | 18.200.76.182, 52.212.189.53 |
Response IP | 18.200.76.182 |
Found | Yes |
Hash | f0c5a3324fd3dd33e5012fc69240dc2a8cddc580766fff2d52806d2654fece51 |
SimHash | 6a1c9c60e2b0 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | http://www.arad2000.co.il/sitemap.asp?depart_id=254489 |