elektormagazine.fr
robots.txt

Robots Exclusion Standard data for elektormagazine.fr

Resource Scan

Scan Details

Site Domain elektormagazine.fr
Base Domain elektormagazine.fr
Scan Status Ok
Last Scan2024-09-06T12:27:47+00:00
Next Scan 2024-10-06T12:27:47+00:00

Last Scan

Scanned2024-09-06T12:27:47+00:00
URL https://elektormagazine.fr/robots.txt
Redirect https://www.elektormagazine.fr/robots.txt
Redirect Domain www.elektormagazine.fr
Redirect Base elektormagazine.fr
Domain IPs 198.211.126.214, 2a03:b0c0:0:1010::5c:1
Redirect IPs 198.211.126.214, 2a03:b0c0:0:1010::5c:1
Response IP 198.211.126.214
Found Yes
Hash c44054bb7d96282e139e5a38e13b80abcdb33a22e9bb1bf8fecbb84eb1b0b7a4
SimHash 3cce5511c4d5

Groups

*

Rule Path
Disallow /portal/
Disallow /embed/
Disallow /search/
Disallow /banners-elektor/
Disallow /waitress/
Disallow /admin/
Disallow /account/mssc/
Disallow /files/
Disallow /includes/
Disallow /*/*/vote
Disallow /search
Disallow /*%26q%3D*
Disallow /*.pdf$
Disallow /*.PDF$
Disallow /*.zip$
Disallow /*.ZIP$
Disallow /assets/upload/files/EN2014120381.pdf

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

baiduspider

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.elektormagazine.fr/sitemap
sitemap https://www.elektormagazine.fr/sitemap/general
sitemap https://www.elektormagazine.fr/sitemap/news
sitemap https://www.elektormagazine.fr/sitemap/articles
sitemap https://www.elektormagazine.fr/sitemap/magazines
sitemap https://www.elektormagazine.fr/sitemap/categories
sitemap https://www.elektormagazine.fr/sitemap/tags
sitemap https://www.elektormagazine.fr/sitemap/selects
sitemap https://www.elektormagazine.fr/sitemap/newsrooms

Comments

  • Disallowed Sub-Directories
  • Disallowed File Types
  • For specific bots