plot.gr
robots.txt

Robots Exclusion Standard data for plot.gr

Resource Scan

Scan Details

Site Domain plot.gr
Base Domain plot.gr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-16T17:46:37+00:00
Next Scan 2024-11-14T17:46:37+00:00

Last Successful Scan

Scanned2024-01-20T17:00:07+00:00
URL https://plot.gr/robots.txt
Redirect https://www.plot.gr/robots.txt
Redirect Domain www.plot.gr
Redirect Base plot.gr
Domain IPs 104.26.12.172, 104.26.13.172, 172.67.68.130, 2606:4700:20::681a:cac, 2606:4700:20::681a:dac, 2606:4700:20::ac43:4482
Redirect IPs 104.26.12.172, 104.26.13.172, 172.67.68.130, 2606:4700:20::681a:cac, 2606:4700:20::681a:dac, 2606:4700:20::ac43:4482
Response IP 172.67.68.130
Found Yes
Hash c29337db132a57f30deb1afa9c519212cb14f02076b5a1156495d4cb7391910a
SimHash ae85698d2450

Groups

*

Rule Path
Disallow /user/login/
Disallow /classified/login/
Disallow /account/
Disallow /en/classifieds/recent/
Disallow /classifieds/recent/
Disallow /en/classifieds/favorite/
Disallow /classifieds/favorite/
Disallow /en/searches/recent/
Disallow /searches/recent/
Disallow /en/classifieds/hidden/
Disallow /classifieds/hidden/

Other Records

Field Value
sitemap https://www.plot.gr/sitemaps/sitemap_index.xml

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /