douleutaras.com.cy
robots.txt

Robots Exclusion Standard data for douleutaras.com.cy

Resource Scan

Scan Details

Site Domain douleutaras.com.cy
Base Domain douleutaras.com.cy
Scan Status Ok
Last Scan2024-10-30T18:33:04+00:00
Next Scan 2024-11-29T18:33:04+00:00

Last Scan

Scanned2024-10-30T18:33:04+00:00
URL https://douleutaras.com.cy/robots.txt
Redirect https://www.douleutaras.com.cy/robots.txt
Redirect Domain www.douleutaras.com.cy
Redirect Base douleutaras.com.cy
Domain IPs 104.26.6.120, 104.26.7.120, 172.67.73.191, 2606:4700:20::681a:678, 2606:4700:20::681a:778, 2606:4700:20::ac43:49bf
Redirect IPs 104.26.6.120, 104.26.7.120, 172.67.73.191, 2606:4700:20::681a:678, 2606:4700:20::681a:778, 2606:4700:20::ac43:49bf
Response IP 172.67.73.191
Found Yes
Hash 8fae8abf3860d1955d14a35a150945da1d714826b6906f918624f48e30fba4cf
SimHash 6911c06242b4

Groups

twitterbot

Rule Path
Allow /

*

Rule Path
Disallow /dir/makedonia/*
Disallow /jobs/create_unauthed/*
Disallow /jobs/search*
Disallow /portfolio_items/*
Disallow /sellers/*
Disallow /sellers/search*
Disallow /jobs/create/*
Disallow /site/assets*
Disallow /makedonia/*
Disallow /buyers/*
Disallow /dashboard*
Disallow /test/*
Disallow /partials/header_panel
Disallow /en/*
Disallow /activate-language/*

npbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

npbot-1/2.0

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yahoo!-adcrawler

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

adidxbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

adsbot-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

*

Rule Path
Allow /jobs/create/signup/*/iframe/*
Allow /api/public/category_form/*
Allow /api/public/city/*
Allow /api/public/pricing_csv/*
Disallow /jobs/create_unauthed/*
Disallow /jobs/search*
Disallow /portfolio_items/*
Disallow /sellers/*
Disallow /sellers/search*
Disallow /jobs/create/*
Disallow /site/assets*
Disallow /makedonia/*
Disallow /buyers/*
Disallow /dashboard*
Disallow /test/*
Disallow /partials/header_panel
Disallow /?lkws_11794
Disallow /anatoliki-makedonia-kai-thraki/
Disallow /boreio-aigaio/
Disallow /ipeiros/
Disallow /ionioi-nisoi/
Disallow /notio-aigaio/
Disallow /accounts/
Disallow /pro/
Disallow /profile/sunthetika-koufomata/
Disallow /?utm_source
Disallow /admin/
Disallow /renovation_guide_download/*
Disallow /jobs/*
Disallow /api/*
Disallow /r/*
Disallow /en/*
Disallow /activate-language/*

Other Records

Field Value
sitemap https://www.douleutaras.com.cy/sitemap.xml

Warnings

  • `host` is not a known field.