netron.web.tr
robots.txt

Robots Exclusion Standard data for netron.web.tr

Resource Scan

Scan Details

Site Domain netron.web.tr
Base Domain netron.web.tr
Scan Status Ok
Last Scan2025-10-01T03:55:41+00:00
Next Scan 2025-10-31T03:55:41+00:00

Last Scan

Scanned2025-10-01T03:55:41+00:00
URL https://netron.web.tr/robots.txt
Redirect https://netron.tr/robots.txt
Redirect Domain netron.tr
Redirect Base netron.tr
Domain IPs 104.21.32.47, 172.67.183.22, 2606:4700:3031::ac43:b716, 2606:4700:3034::6815:202f
Redirect IPs 104.21.1.244, 172.67.128.102, 2606:4700:3030::ac43:8066, 2606:4700:3035::6815:1f4
Response IP 104.21.1.244
Found Yes
Hash 309b629859011f302a784d444d93cdeb779ddf2af6790df7c3bf13c9e8e29edb
SimHash 445b58d28ba5

Groups

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

mediapartners-google*

Rule Path
Disallow

*

Rule Path
Disallow /admin.php
Disallow /account/
Disallow /attachments/
Disallow /conversations/
Disallow /find-new/
Disallow /goto/
Disallow /login/
Disallow /register/
Disallow /search/
Allow /

Other Records

Field Value
sitemap http://netron.web.tr/sitemap.php