Log In Sign Up

biermann-medizin.de
robots.txt

Robots Exclusion Standard data for biermann-medizin.de

Resource Scan

Scan Details

Site Domain biermann-medizin.de
Base Domain biermann-medizin.de
Scan Status Ok
Last Scan2024-09-06T14:52:59+00:00
Next Scan 2024-10-06T14:52:59+00:00

Last Scan

Scanned2024-09-06T14:52:59+00:00
URL https://biermann-medizin.de/robots.txt
Domain IPs 104.26.14.234, 104.26.15.234, 172.67.70.34, 2606:4700:20::681a:eea, 2606:4700:20::681a:fea, 2606:4700:20::ac43:4622
Response IP 104.26.14.234
Found Yes
Hash 1f8eea19351417e3d026d9355ffd09821135a862886fe0495baa0a474cd4cdbe
SimHash 01144873c6fc

Groups

*

Rule Path
Disallow /pdf/
Disallow /wp-admin/
Disallow /trackback/
Disallow /feed/
Disallow /comments/
Disallow */trackback/
Disallow */feed/
Disallow */comments/
Allow /wp-admin/admin-ajax.php

turnitinbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

mail.ru_bot/robots/2.0

Rule Path
Disallow /

mail.ru_bot/2.0

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

ccbot

Rule Path
Disallow /

ccbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

bingbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50
Back to top

Other Records

Field Value
sitemap http://biermann-medizin.de/post-sitemap.xml
sitemap http://biermann-medizin.de/page-sitemap.xml
sitemap http://biermann-medizin.de/tribe_events-sitemap.xml
sitemap http://biermann-medizin.de/category-sitemap.xml
sitemap http://biermann-medizin.de/post_tag-sitemap.xml
sitemap http://biermann-medizin.de/tribe_events_cat-sitemap.xml
Back to top