arad2000.co.il
robots.txt

Robots Exclusion Standard data for arad2000.co.il

Resource Scan

Scan Details

Site Domain arad2000.co.il
Base Domain arad2000.co.il
Scan Status Ok
Last Scan2024-09-21T23:55:04+00:00
Next Scan 2024-10-21T23:55:04+00:00

Last Scan

Scanned2024-09-21T23:55:04+00:00
URL https://arad2000.co.il/robots.txt
Redirect http://www.arad2000.co.il/robots.txt
Redirect Domain www.arad2000.co.il
Redirect Base arad2000.co.il
Domain IPs 54.76.177.85
Redirect IPs 18.200.76.182, 52.212.189.53
Response IP 18.200.76.182
Found Yes
Hash f0c5a3324fd3dd33e5012fc69240dc2a8cddc580766fff2d52806d2654fece51
SimHash 6a1c9c60e2b0

Groups

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

spbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap http://www.arad2000.co.il/sitemap.asp?depart_id=254489