Log In Sign Up

marasbugun.com.tr
robots.txt

Robots Exclusion Standard data for marasbugun.com.tr

Resource Scan

Scan Details

Site Domain marasbugun.com.tr
Base Domain marasbugun.com.tr
Scan Status Ok
Last Scan2025-03-13T09:34:35+00:00
Next Scan 2025-03-20T09:34:35+00:00

Last Scan

Scanned2025-03-13T09:34:35+00:00
URL https://marasbugun.com.tr/robots.txt
Redirect https://www.marasbugun.com.tr/robots.txt
Redirect Domain www.marasbugun.com.tr
Redirect Base marasbugun.com.tr
Domain IPs 104.21.80.197, 172.67.153.101, 2606:4700:3034::ac43:9965, 2606:4700:3037::6815:50c5
Redirect IPs 104.21.80.197, 172.67.153.101, 2606:4700:3034::ac43:9965, 2606:4700:3037::6815:50c5
Response IP 172.67.153.101
Found Yes
Hash c0aa5df0b09bc3a4ec8fc0b824e7be0c23c8d4065e9060d79f7dce3621bd32da
SimHash e9581e26e31a

Groups

*

Rule Path
Disallow /arama
Disallow /public
Disallow /public/*
Disallow /public/index.php
Disallow /public/index.php/*
Disallow /service*
Disallow /share*
Disallow /tr/*
Disallow /?ref=
Disallow /?preview=
Disallow /?page=
Allow /

adsbot-google

Rule Path
Disallow /advert/*
Allow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2
Back to top

Other Records

Field Value
sitemap https://www.marasbugun.com.tr/sitemap.xml
Back to top

Warnings

  • 3 invalid lines.
Back to top