m.news1.co.il
robots.txt

Robots Exclusion Standard data for m.news1.co.il

Resource Scan

Scan Details

Site Domain m.news1.co.il
Base Domain news1.co.il
Scan Status Ok
Last Scan2024-04-17T20:07:57+00:00
Next Scan 2024-05-17T20:07:57+00:00

Last Scan

Scanned2024-04-17T20:07:57+00:00
URL https://m.news1.co.il/robots.txt
Domain IPs 104.26.14.46, 104.26.15.46, 172.67.75.31, 2606:4700:20::681a:e2e, 2606:4700:20::681a:f2e, 2606:4700:20::ac43:4b1f
Response IP 104.26.14.46
Found Yes
Hash 382404c7946ef5beaf4dd17cc94776b85c702b795e9412313b6de55e59a27ae2
SimHash a100c8228b12

Groups

*

Rule Path
Disallow /showtitles.aspx
Disallow /tagssearchresults.aspx