helpathome.com
robots.txt

Robots Exclusion Standard data for helpathome.com

Resource Scan

Scan Details

Site Domain helpathome.com
Base Domain helpathome.com
Scan Status Ok
Last Scan2025-11-30T22:48:35+00:00
Next Scan 2025-12-30T22:48:35+00:00

Last Scan

Scanned2025-11-30T22:48:35+00:00
URL https://helpathome.com/robots.txt
Redirect https://www.helpathome.com/robots.txt
Redirect Domain www.helpathome.com
Redirect Base helpathome.com
Domain IPs 104.18.2.153, 104.18.3.153
Redirect IPs 104.18.2.153, 104.18.3.153
Response IP 104.18.2.153
Found Yes
Hash fa528ad25f43b9f549482c850657c98cb180ae547197c4572a710df9c6926db1
SimHash 6af63ee08ae8

Groups

*

Rule Path
Disallow /wp-admin
Disallow /wp-login.php
Disallow /wp-includes/*php
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow */comment*
Disallow /.*

Other Records

Field Value
crawl-delay 5

googlebot-image
msnbot-media

Rule Path
Disallow /

psbot

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

baiduspider+(+http://www.baidu.com/search/spider.htm)

Rule Path
Disallow /

baiduspider/2.0;+http://www.baidu.com/search/spider.html

Rule Path
Disallow /

baiduspider/2.0

Rule Path
Disallow /

mozilla/5.0(compatible; baiduspider/2.0;+http://www.baidu.com/search/spider.html)

Rule Path
Disallow /

spider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandex.com

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blekkobot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Comments

  • Disallow: /wp-content/uploads
  • Baiduspider
  • Yandex
  • Block BlexBot
  • Block MegaIndex.ru
  • Block Ahrefs
  • Block MJ12bot as it is just noise

Warnings

  • 6 invalid lines.