biermannmedizin.de
robots.txt

Robots Exclusion Standard data for biermannmedizin.de

Resource Scan

Scan Details

Site Domain biermannmedizin.de
Base Domain biermannmedizin.de
Scan Status Ok
Last Scan2024-09-30T21:31:15+00:00
Next Scan 2024-10-30T21:31:15+00:00

Last Scan

Scanned2024-09-30T21:31:15+00:00
URL https://biermannmedizin.de/robots.txt
Domain IPs 104.21.79.77, 172.67.169.89, 2606:4700:3030::6815:4f4d, 2606:4700:3031::ac43:a959
Response IP 172.67.169.89
Found Yes
Hash 1f8eea19351417e3d026d9355ffd09821135a862886fe0495baa0a474cd4cdbe
SimHash 01144873c6fc

Groups

*

Rule Path
Disallow /pdf/
Disallow /wp-admin/
Disallow /trackback/
Disallow /feed/
Disallow /comments/
Disallow */trackback/
Disallow */feed/
Disallow */comments/
Allow /wp-admin/admin-ajax.php

turnitinbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

mail.ru_bot/robots/2.0

Rule Path
Disallow /

mail.ru_bot/2.0

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

ccbot

Rule Path
Disallow /

ccbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

bingbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

Other Records

Field Value
sitemap http://biermann-medizin.de/post-sitemap.xml
sitemap http://biermann-medizin.de/page-sitemap.xml
sitemap http://biermann-medizin.de/tribe_events-sitemap.xml
sitemap http://biermann-medizin.de/category-sitemap.xml
sitemap http://biermann-medizin.de/post_tag-sitemap.xml
sitemap http://biermann-medizin.de/tribe_events_cat-sitemap.xml