elektormagazine.com
robots.txt

Robots Exclusion Standard data for elektormagazine.com

Resource Scan

Scan Details

Site Domain elektormagazine.com
Base Domain elektormagazine.com
Scan Status Ok
Last Scan2024-09-23T20:51:32+00:00
Next Scan 2024-10-23T20:51:32+00:00

Last Scan

Scanned2024-09-23T20:51:32+00:00
URL https://elektormagazine.com/robots.txt
Redirect https://www.elektormagazine.com/robots.txt
Redirect Domain www.elektormagazine.com
Redirect Base elektormagazine.com
Domain IPs 198.211.126.214, 2a03:b0c0:0:1010::5c:1
Redirect IPs 198.211.126.214, 2a03:b0c0:0:1010::5c:1
Response IP 198.211.126.214
Found Yes
Hash 323f2a5d837be45ce032a759e2ee143b9df5f295f16e590b115606eca6cd5127
SimHash 7cc6dd11c0b7

Groups

*

Rule Path
Disallow /portal/
Disallow /embed/
Disallow /search/
Disallow /banners-elektor/
Disallow /waitress/
Disallow /admin/
Disallow /account/mssc/
Disallow /files/
Disallow /includes/
Disallow /*/*/vote
Disallow /search
Disallow /*%26q%3D*
Disallow /*.pdf$
Disallow /*.PDF$
Disallow /*.zip$
Disallow /*.ZIP$
Disallow /assets/upload/files/EN2014120381.pdf

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

baiduspider

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.elektormagazine.com/sitemap
sitemap https://www.elektormagazine.com/sitemap/general
sitemap https://www.elektormagazine.com/sitemap/news
sitemap https://www.elektormagazine.com/sitemap/articles
sitemap https://www.elektormagazine.com/sitemap/magazines
sitemap https://www.elektormagazine.com/sitemap/categories
sitemap https://www.elektormagazine.com/sitemap/tags
sitemap https://www.elektormagazine.com/sitemap/selects
sitemap https://www.elektormagazine.com/sitemap/newsrooms
sitemap https://www.elektormagazine.com/sitemap/labs
sitemap https://www.elektormagazine.com/sitemap/labs-users
sitemap https://www.elektormagazine.com/sitemap/products

Comments

  • Disallowed Sub-Directories
  • Disallowed File Types
  • For specific bots