Log In Sign Up

beyonddream.com
robots.txt

Robots Exclusion Standard data for beyonddream.com

Resource Scan

Scan Details

Site Domain beyonddream.com
Base Domain beyonddream.com
Scan Status Ok
Last Scan2024-11-08T08:13:22+00:00
Next Scan 2024-12-08T08:13:22+00:00

Last Scan

Scanned2024-11-08T08:13:22+00:00
URL https://www.beyonddream.com/robots.txt
Domain IPs 2a02:4780:1:1::1:963c, 5.183.11.8
Response IP 5.183.11.8
Found Yes
Hash 8d146dae7aaf8c9c9641b0f9e5428c3857dad57bf619f3df61e27d606feddf91
SimHash 5a34d143e8ba

Groups

omniexplorer_bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

ocelli

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

thunderstone

Rule Path
Disallow /

daum

Rule Path
Disallow /

*

Rule Path
Disallow /family/
Disallow /s/
Disallow /cgi-bin/
Disallow /items/
Disallow /admin/
Disallow /secure
Disallow /admin/admin.pl
Disallow /pages/privacy.html
Disallow /pages/aSearch.html
Disallow /pages/terms.html
Disallow /fullsite
Disallow /tablet
Disallow /phone
Disallow /affiliate/aff-terms.html
Disallow /subject/frame-oil-paintings
Disallow /i/i/
Back to top

Other Records

Field Value
sitemap https://www.beyonddream.com/me/feeds/sitemap.txt
sitemap https://www.beyonddream.com/me/feeds/image_sitemap.xml
Back to top

Comments

  • Disallow: /oil-painting/
  • Disallow: /style/framed-oil-paintings
  • Disallow: /style/asian-oil-paintings:
  • Disallow: /style/decorative-oil-paintings:
  • Disallow: /style/impressionism-oil-paintings:
  • Disallow: /style/post-impressionism-oil-paintings:
  • Disallow: /style/classic-oil-paintings:
  • Disallow: /style/modern-oil-paintings:
  • Disallow: /style/naturalism-oil-paintings:
  • Disallow: /style/pop-art-oil-paintings:
  • Disallow: /subject/framed-oil-paintings:
  • Disallow: /subject/canvas-set-oil-paintings:
  • Disallow: /subject/eight-horse-oil-paintings:
  • Disallow: /subject/italy-oil-paintings:
  • Disallow: /subject/new-oil-paintings:
Back to top