van.bbsgayru23.com
robots.txt

Robots Exclusion Standard data for van.bbsgayru23.com

Resource Scan

Scan Details

Site Domain van.bbsgayru23.com
Base Domain bbsgayru23.com
Scan Status Ok
Last Scan2025-07-20T10:25:37+00:00
Next Scan 2025-08-19T10:25:37+00:00

Last Scan

Scanned2025-07-20T10:25:37+00:00
URL https://van.bbsgayru23.com/robots.txt
Redirect https://bkd.bbsgayru33.com/robots.txt
Redirect Domain bkd.bbsgayru33.com
Redirect Base bbsgayru33.com
Domain IPs 104.26.0.81, 104.26.1.81, 172.67.74.24, 2606:4700:20::681a:151, 2606:4700:20::681a:51, 2606:4700:20::ac43:4a18
Redirect IPs 104.21.82.201, 172.67.162.218, 2606:4700:3033::6815:52c9, 2606:4700:3034::ac43:a2da
Response IP 172.67.162.218
Found Yes
Hash 31d80aeee52e8c03d1581e5c8ba1eb4440b4356aa66d6f2a7ec1fae137b159ed
SimHash 6b18be52e7e2

Groups

semrushbot-sa

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 2

mj12bot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 2

*

Rule Path
Disallow /*?*
Disallow /user-profil
Disallow /user_ads
Disallow /user-photos
Disallow /settings
Disallow /chat
Disallow /search

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://bkd.bbsgayru33.com/sitemap.xml

Warnings

  • `host` is not a known field.