aegeanhub.com
robots.txt

Robots Exclusion Standard data for aegeanhub.com

Resource Scan

Scan Details

Site Domain aegeanhub.com
Base Domain aegeanhub.com
Scan Status Ok
Last Scan2025-07-27T21:35:49+00:00
Next Scan 2025-08-03T21:35:49+00:00

Last Scan

Scanned2025-07-27T21:35:49+00:00
URL https://www.aegeanhub.com/robots.txt
Domain IPs 23.45.207.201, 23.45.207.203, 2600:1413:b000:1e::17d1:2e47, 2600:1413:b000:1e::17d1:2e58
Response IP 23.55.39.168
Found Yes
Hash 788a0d8f8488ee7099a3aa00ce30996b174dca2faecd5ec25fe7bf183ab8a42c
SimHash 2812dd00e5f4

Groups

slurp

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

*

Rule Path Comment
Allow / -
Disallow /netvolution/ -
Disallow /Themes/ -
Disallow /Temp/ -
Disallow /z_ prevent indexing of the search catalog!
Disallow *?_ga -
Disallow *?utm -
Disallow *?icn -
Disallow *?cid -
Disallow *?CID -
Disallow *gclid -
Disallow *?yclid -
Disallow /?* -

Comments

  • Block the following known bots
  • Block Subfolders
  • Block Cross-Domain Tracking
  • Block Campaign Parameter
  • Block Internal Banners
  • Block Paid Campaigns
  • Block query strings