bee.bbsgayru25.com
robots.txt

Robots Exclusion Standard data for bee.bbsgayru25.com

Resource Scan

Scan Details

Site Domain bee.bbsgayru25.com
Base Domain bbsgayru25.com
Scan Status Ok
Last Scan2025-04-02T13:54:56+00:00
Next Scan 2025-05-02T13:54:56+00:00

Last Scan

Scanned2025-04-02T13:54:56+00:00
URL https://bee.bbsgayru25.com/robots.txt
Redirect https://bkd.bbsgayru26.com/robots.txt
Redirect Domain bkd.bbsgayru26.com
Redirect Base bbsgayru26.com
Domain IPs 104.21.84.175, 172.67.195.113, 2606:4700:3033::6815:54af, 2606:4700:3034::ac43:c371
Redirect IPs 104.26.14.197, 104.26.15.197, 172.67.72.76, 2606:4700:20::681a:ec5, 2606:4700:20::681a:fc5, 2606:4700:20::ac43:484c
Response IP 104.26.14.197
Found Yes
Hash cd9fe2de90a321d8b2b69e544443730c339012efcce95e0d6767c59487faad6c
SimHash 6b1cbe02e292

Groups

semrushbot-sa

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 2

mj12bot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 2

*

Rule Path
Disallow /*?*
Disallow /user-profil
Disallow /user_ads
Disallow /user-photos
Disallow /settings
Disallow /chat
Disallow /search

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://bkd.bbsgayru26.com/sitemap.xml

Warnings

  • `host` is not a known field.