boyabatsesi.com
robots.txt

Robots Exclusion Standard data for boyabatsesi.com

Resource Scan

Scan Details

Site Domain boyabatsesi.com
Base Domain boyabatsesi.com
Scan Status Ok
Last Scan2026-01-19T17:58:27+00:00
Next Scan 2026-01-26T17:58:27+00:00

Last Scan

Scanned2026-01-19T17:58:27+00:00
URL https://boyabatsesi.com/robots.txt
Redirect https://www.boyabatsesi.com/robots.txt
Redirect Domain www.boyabatsesi.com
Redirect Base boyabatsesi.com
Domain IPs 104.21.20.238, 172.67.194.221, 2606:4700:3034::6815:14ee, 2606:4700:3036::ac43:c2dd
Redirect IPs 104.21.20.238, 172.67.194.221, 2606:4700:3034::6815:14ee, 2606:4700:3036::ac43:c2dd
Response IP 172.67.194.221
Found Yes
Hash 7e20093ae6deeeb156d0643743be92cc2c0c34d402fd7d3450294dba178dcbd4
SimHash 08401ee2d292

Groups

*

Rule Path
Disallow /public
Disallow /public/*
Disallow /service*
Disallow /arama/
Disallow /api
Disallow /*?q=
Disallow /*?preview=
Disallow /*?utm_source=
Disallow /*?page=
Disallow /*%26page%3D
Disallow /*?sort=
Disallow /*%26sort%3D
Disallow /service/
Disallow /advert/*
Disallow /*model%3DTE%5C
Disallow /admin/
Disallow /login/
Disallow /register/
Disallow /password-reset/
Disallow /user/
Disallow /auth/
Disallow */bigdata/hit.json

adsbot-google

Rule Path
Disallow /advert/*
Allow /

yandex

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

googlebot

Rule Path
Allow /

semrushbot

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

applebot

Rule Path
Disallow /vendor/
Disallow /media/
Disallow /public/
Disallow /admin/
Disallow /login/
Disallow /register/
Disallow /password-reset/
Disallow /user/
Disallow /auth/

Other Records

Field Value
sitemap https://www.boyabatsesi.com/sitemap.xml
sitemap https://www.boyabatsesi.com/rss?yandex=turbo

Warnings

  • `clean-param` is not a known field.