movies.walla.co.il
robots.txt

Robots Exclusion Standard data for movies.walla.co.il

Resource Scan

Scan Details

Site Domain movies.walla.co.il
Base Domain walla.co.il
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-22T19:03:54+00:00
Next Scan 2024-11-21T19:03:54+00:00

Last Successful Scan

Scanned2024-09-23T18:21:34+00:00
URL https://movies.walla.co.il/robots.txt
Domain IPs 52.84.229.115, 52.84.229.47, 52.84.229.56, 52.84.229.82
Response IP 52.84.229.56
Found Yes
Hash d1591d5bca416122a6e649eb2ab913efcc3b6ebda31f6db38a24a705ddac3e7c
SimHash c14853c416f3

Groups

*

Rule Path
Disallow *%26timeStamp%3D
Disallow *%40entity
Disallow *%40opinion
Disallow *%40placation
Disallow *%40poll.results
Disallow /%26tagfly%3D1
Disallow *%40search%26
Disallow *hotOrNot.commit
Disallow /43010785/*
Disallow */userfeedback/facebook.stream.publish
Disallow *mobile%3D*
Disallow *?0*
Disallow *?feature
Disallow *layout%3D
Disallow /*?mediazone*
Disallow /*%26mediazone*
Disallow *navindex%3D*
Disallow /*?fallback*
Disallow /*?fb_comment_id*
Disallow /player.html*
Disallow /rm*
Disallow *?_w_open_tlk
Disallow *?year=20*

mediapartners-google

Rule Path
Allow /

Other Records

Field Value
sitemap https://movies.walla.co.il/sitemap/28/today.xml
sitemap https://movies.walla.co.il/sitemap/28/index.xml
sitemap https://movies.walla.co.il/sitemap/28/history.xml

Comments

  • robots.txt - 2018-03-13
  • robots file for domain: https://movies.walla.co.il/