elektormagazine.de
robots.txt

Robots Exclusion Standard data for elektormagazine.de

Resource Scan

Scan Details

Site Domain elektormagazine.de
Base Domain elektormagazine.de
Scan Status Ok
Last Scan2024-09-08T21:17:20+00:00
Next Scan 2024-10-08T21:17:20+00:00

Last Scan

Scanned2024-09-08T21:17:20+00:00
URL https://elektormagazine.de/robots.txt
Redirect https://www.elektormagazine.de/robots.txt
Redirect Domain www.elektormagazine.de
Redirect Base elektormagazine.de
Domain IPs 198.211.126.214, 2a03:b0c0:0:1010::5c:1
Redirect IPs 198.211.126.214, 2a03:b0c0:0:1010::5c:1
Response IP 198.211.126.214
Found Yes
Hash de9c5c9dda223a34ed58a39667ab0363351d60ed642f7df137e3fa12ff717313
SimHash 7dc2fd01c0f5

Groups

*

Rule Path
Disallow /portal/
Disallow /embed/
Disallow /search/
Disallow /banners-elektor/
Disallow /waitress/
Disallow /admin/
Disallow /account/mssc/
Disallow /files/
Disallow /includes/
Disallow /*/*/vote
Disallow /search
Disallow /*%26q%3D*
Disallow /*.pdf$
Disallow /*.PDF$
Disallow /*.zip$
Disallow /*.ZIP$
Disallow /assets/upload/files/EN2014120381.pdf

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

baiduspider

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.elektormagazine.de/sitemap
sitemap https://www.elektormagazine.de/sitemap/general
sitemap https://www.elektormagazine.de/sitemap/news
sitemap https://www.elektormagazine.de/sitemap/articles
sitemap https://www.elektormagazine.de/sitemap/magazines
sitemap https://www.elektormagazine.de/sitemap/categories
sitemap https://www.elektormagazine.de/sitemap/tags
sitemap https://www.elektormagazine.de/sitemap/selects
sitemap https://www.elektormagazine.de/sitemap/newsrooms

Comments

  • Disallowed Sub-Directories
  • Disallowed File Types
  • For specific bots