beecoder.org
robots.txt

Robots Exclusion Standard data for beecoder.org

Resource Scan

Scan Details

Site Domain beecoder.org
Base Domain beecoder.org
Scan Status Ok
Last Scan2025-08-23T19:36:19+00:00
Next Scan 2025-08-30T19:36:19+00:00

Last Scan

Scanned2025-08-23T19:36:19+00:00
URL https://beecoder.org/robots.txt
Domain IPs 104.21.64.87, 172.67.179.116, 2606:4700:3030::ac43:b374, 2606:4700:3037::6815:4057
Response IP 172.67.179.116
Found Yes
Hash 6d7b4e7a1b51116a542c21088abb9f72730fc09e652c9fb5f4c945f12036a2b0
SimHash 251564924595

Groups

googlebot

Rule Path
Disallow /download/
Disallow /*/embed-banner*

mail.ru_bot

Rule Path
Disallow /download/
Disallow /*/embed-banner*

mail.ru

Rule Path
Disallow /download/
Disallow /*/embed-banner*

googlebot-image

Rule Path
Disallow /download/
Disallow /*/embed-banner*

googlebot-mobile

Rule Path
Disallow /download/
Disallow /*/embed-banner*

bingbot

Rule Path
Disallow /download/
Disallow /*/embed-banner*

yandex

Rule Path
Disallow /download/
Disallow /*/embed-banner*

msnbot

Rule Path
Disallow /download/
Disallow /*/embed-banner*

slurp

Rule Path
Disallow /download/
Disallow /*/embed-banner*

teoma

Rule Path
Disallow /download/
Disallow /*/embed-banner*

gigabot

Rule Path
Disallow /download/
Disallow /*/embed-banner*

robozilla

Rule Path
Disallow /download/
Disallow /*/embed-banner*

nutch

Rule Path
Disallow /download/
Disallow /*/embed-banner*

ia_archiver

Rule Path
Disallow /download/
Disallow /*/embed-banner*

baiduspider

Rule Path
Disallow /download/
Disallow /*/embed-banner*

naverbot

Rule Path
Disallow /download/
Disallow /*/embed-banner*

yeti

Rule Path
Disallow /download/
Disallow /*/embed-banner*

yahoo-mmcrawler

Rule Path
Disallow /download/
Disallow /*/embed-banner*

psbot

Rule Path
Disallow /download/
Disallow /*/embed-banner*

yahoo-blogs/v3.9

Rule Path
Disallow /download/
Disallow /*/embed-banner*

*

Rule Path
Disallow /download/
Disallow /admin/
Disallow /*/embed-banner*

Other Records

Field Value
sitemap https://beecoder.org/sitemap.xml