bereaky.edefeed.com
robots.txt

Robots Exclusion Standard data for bereaky.edefeed.com

Resource Scan

Scan Details

Site Domain bereaky.edefeed.com
Base Domain edefeed.com
Scan Status Ok
Last Scan2025-07-21T07:39:09+00:00
Next Scan 2025-08-20T07:39:09+00:00

Last Scan

Scanned2025-07-21T07:39:09+00:00
URL https://bereaky.edefeed.com/robots.txt
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.64.1
Found Yes
Hash ebd6d911552e6aee8b9a47eaa5c908196f1caf1dab7ec2a3aa028d74729b2e2b
SimHash 0cb610d1e7c3

Groups

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow /add/
Disallow /pwv/
Disallow /share/
Disallow /print/
Disallow /reply/
Disallow /account/
Disallow /signup/
Disallow /activate/
Disallow /login/
Disallow /verify/
Disallow /show/
Disallow /link/
Disallow /deleted/
Disallow /about/this-site/
Disallow /about/nasz-portal/
Disallow /about/privacy/
Disallow /about/faq/
Disallow /adblock/
Disallow /other_topics/
Disallow /users_online/
Disallow /quickreply/
Disallow /search/
Disallow /widgety/
Disallow /widgets/
Disallow /accountwdg/
Disallow /post/*/report/

mediapartners-google

Rule Path
Disallow

mediapartners-google

Rule Path
Allow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5