Log In Sign Up

eu-schwerbehinderung.eu
robots.txt

Robots Exclusion Standard data for eu-schwerbehinderung.eu

Resource Scan

Scan Details

Site Domain eu-schwerbehinderung.eu
Base Domain eu-schwerbehinderung.eu
Scan Status Ok
Last Scan2024-09-21T05:52:24+00:00
Next Scan 2024-09-28T05:52:24+00:00

Last Scan

Scanned2024-09-21T05:52:24+00:00
URL https://eu-schwerbehinderung.eu/robots.txt
Domain IPs 51.145.154.134
Response IP 51.145.154.134
Found Yes
Hash 162eab01d8bc576851be41351d78430779734a64aa1a5e54845b87a196c4fcb1
SimHash 673f5bb156bc

Groups

*

Rule Path
Allow /*.js*
Allow /*.css*
Allow /*.png*
Allow /*.jpg*
Allow /*.gif*
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /8-pflege/
Disallow /component/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow *?option*
Disallow /tmp/

serpstatbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 120

claudebot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 120

bidswitchbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 120

nanointeractive

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 120

proximic

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 120

grapeshotcrawler

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 120

semrushbot-ba

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 120

aimysitemapcrawler

Rule Path
Disallow *?tmpl=component&print=1*

googlebot

Rule Path
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow */40-archiv/*
Disallow */43-archiv/*
Disallow */44-archiv/*
Disallow */49-archiv/*
Disallow */allgemeines-archiv/*
Disallow */coronavirus-archiv/*
Disallow */pflege-archiv/*
Disallow /*40-archiv*/
Disallow /*43-archiv*/
Disallow /*44-archiv*/
Disallow /*49-archiv*/
Disallow /*allgemeines-archiv*/
Disallow /*coronavirus-archiv*/
Disallow /*pflege-archiv*/
Disallow /index.php/allgemeines/40-archiv/*
Disallow /index.php/allgemeines/43-archiv/*
Disallow /index.php/allgemeines/44-archiv/*
Disallow /index.php/allgemeines/49-archiv/*
Disallow /index.php/40-archiv/*
Disallow /index.php/43-archiv/*
Disallow /index.php/44-archiv/*
Disallow /index.php/49-archiv/*
Disallow /index.php/recht/40-archiv/*
Disallow /index.php/schwerbehinderung/43-archiv/*
Disallow /component/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow *?option*

Other Records

Field Value
crawl-delay 120

amazonbot

Rule Path
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow */40-archiv/*
Disallow */43-archiv/*
Disallow */44-archiv/*
Disallow */49-archiv/*
Disallow */allgemeines-archiv/*
Disallow */coronavirus-archiv/*
Disallow */pflege-archiv/*
Disallow /*40-archiv*/
Disallow /*43-archiv*/
Disallow /*44-archiv*/
Disallow /*49-archiv*/
Disallow /*allgemeines-archiv*/
Disallow /*coronavirus-archiv*/
Disallow /*pflege-archiv*/
Disallow /component/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow *?option*

Other Records

Field Value
crawl-delay 120

googlebot-image

Rule Path
Allow /images/*
Disallow /*

Other Records

Field Value
crawl-delay 120

mojeekbot

Rule Path
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /component/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow *?option*

Other Records

Field Value
crawl-delay 120

slurp

Rule Path
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /component/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow *?option*

Other Records

Field Value
crawl-delay 3600

applebot

Rule Path
Disallow /private/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /component/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow *?option*

Other Records

Field Value
crawl-delay 120

gumgum-bot

Rule Path
Disallow *

gptbot

Rule Path
Disallow *

adsbot-google

Rule Path
Disallow

googlebot-news

Rule Path
Disallow

outbrain

Rule Path
Disallow *

barkrowler

Rule Path
Disallow *

dataforseobot

Rule Path
Disallow *

seekportbot

Rule Path
Disallow *

Other Records

Field Value
crawl-delay 120

mj12bot

Rule Path
Disallow *

Other Records

Field Value
crawl-delay 120

googlebot-image

Rule Path
Allow /images/24/DBT-01/*.jpg
Allow /images/24/DBT-02/*.jpg
Allow /images/24/DBT-03/*.jpg
Allow /images/24/DBT-04/*.jpg
Allow /images/24/DBT-05/*.jpg
Allow /images/24/DBT-06/*.jpg
Allow /images/23/DBT-07/*.jpg
Allow /images/23/DBT-09/*.jpg
Allow /images/23/DBT-10/*.jpg
Allow /images/23/DBT-11/*.jpg
Allow /images/23/DBT-12/*.jpg
Disallow

cookiebot

Rule Path
Disallow /component/*
Disallow /34-Master/*
Disallow /*-archiv/*
Disallow /themen/*
Disallow /pflege/*
Disallow /schwerbehinderung/*
Disallow /35-gesundheit/*
Disallow /rente/*
Disallow /politik/*
Disallow /steuern/*
Disallow /administrator/*
Disallow /index.php/component/*
Disallow /index.php/34-Master/*
Disallow /index.php/themen/*
Disallow /index.php/pflege/*
Disallow /index.php/schwerbehinderung/*
Disallow /index.php/35-gesundheit/*
Disallow /index.php/rente/*
Disallow /index.php/politik/*
Disallow /index.php/steuern/*
Disallow /index.php/administrator/*
Disallow /index.php/*-archiv/*

Other Records

Field Value
crawl-delay 120

semrushbot

Rule Path
Disallow /component/*
Disallow /34-Master/*
Disallow /*-archiv/*
Disallow /themen/*
Disallow /pflege/*
Disallow /schwerbehinderung/*
Disallow /35-gesundheit/*
Disallow /rente/*
Disallow /politik/*
Disallow /steuern/*
Disallow /administrator/*
Disallow /index.php/component/*
Disallow /index.php/34-Master/*
Disallow /index.php/themen/*
Disallow /index.php/pflege/*
Disallow /index.php/schwerbehinderung/*
Disallow /index.php/35-gesundheit/*
Disallow /index.php/rente/*
Disallow /index.php/politik/*
Disallow /index.php/steuern/*
Disallow /index.php/administrator/*
Disallow /index.php/*-archiv/*

Other Records

Field Value
crawl-delay 120

criteobot

Rule Path
Disallow /component/
Disallow /34-Master/
Disallow /themen/
Disallow /pflege/
Disallow /schwerbehinderung/
Disallow /35-gesundheit/
Disallow /rente/
Disallow /politik/
Disallow /steuern/
Disallow /index.php/*-archiv/*
Disallow /*-archiv/*

Other Records

Field Value
crawl-delay 3600

muckrack

Rule Path
Disallow /component/
Disallow /34-Master/
Disallow /themen/
Disallow /pflege/
Disallow /schwerbehinderung/
Disallow /35-gesundheit/
Disallow /rente/
Disallow /politik/
Disallow /steuern/
Disallow /index.php/*-archiv/*
Disallow /*-archiv/*

Other Records

Field Value
crawl-delay 3600

glonaad

Rule Path
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /component/
Disallow /34-Master/
Disallow /themen/
Disallow /pflege/
Disallow /schwerbehinderung/
Disallow /35-gesundheit/
Disallow /rente/
Disallow /politik/
Disallow /steuern/
Disallow /index.php/*-archiv/*
Disallow /*-archiv/*

Other Records

Field Value
crawl-delay 3600

bingbot

Rule Path
Disallow /37-coronavirus/
Disallow /35-gesundheit/
Disallow /34-master/
Disallow /index.php/*-archiv/*
Disallow /*-archiv/*
Disallow */40-archiv/*
Disallow */43-archiv/*
Disallow */44-archiv/*
Disallow */49-archiv/*

Other Records

Field Value
crawl-delay 3600

weborama-fetcher

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 120
Back to top

Other Records

Field Value
sitemap https://www.eu-schwerbehinderung.eu/sitemap_gnews.xml
sitemap https://www.eu-schwerbehinderung.eu/sitemap_xml_dataset2.xml
sitemap https://www.eu-schwerbehinderung.eu/index.php?option=com_jmap&view=sitemap&format=xml&dataset=2
Back to top

Comments

  • Default Sitemap robots.txt
  • User-agent: Google-Extended
  • Disallow: /
  • Sitemap entries
  • JSitemap entries
Back to top