topgeargreece.gr
robots.txt

Robots Exclusion Standard data for topgeargreece.gr

Resource Scan

Scan Details

Site Domain topgeargreece.gr
Base Domain topgeargreece.gr
Scan Status Ok
Last Scan2024-05-16T14:14:38+00:00
Next Scan 2024-05-23T14:14:38+00:00

Last Scan

Scanned2024-05-16T14:14:38+00:00
URL https://topgeargreece.gr/robots.txt
Redirect https://www.topgeargreece.gr/robots.txt
Redirect Domain www.topgeargreece.gr
Redirect Base topgeargreece.gr
Domain IPs 23.64.122.120, 23.64.122.128
Redirect IPs 184.51.102.89, 184.51.102.96
Response IP 23.64.122.120
Found Yes
Hash b310aa5dcdeec9d60eeafd4366de02b7f0db4624e3838f6e2325fdef12abb9ac
SimHash 6109c861c1b4

Groups

*

Rule Path
Allow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Comments

  • Sitemap: https://www.topgeargreece.gr/sitemap/allnews
  • Sitemap: https://www.topgeargreece.gr/sitemap/googlenews
  • Sitemap: https://www.topgeargreece.gr/sitemap/categories
  • User-agent: *
  • Disallow:
  • Disallow: /Api/*
  • Disallow: /api/*
  • Disallow: /Search*
  • Disallow: /search*
  • Disallow: /Newsletter*
  • Disallow: /newsletter*
  • User-agent: msnbot
  • Crawl-delay: 120
  • Block ChatGPT etc.