sinerji.gen.tr
robots.txt

Robots Exclusion Standard data for sinerji.gen.tr

Resource Scan

Scan Details

Site Domain sinerji.gen.tr
Base Domain sinerji.gen.tr
Scan Status Ok
Last Scan2024-10-20T03:18:28+00:00
Next Scan 2024-11-19T03:18:28+00:00

Last Scan

Scanned2024-10-20T03:18:28+00:00
URL https://sinerji.gen.tr/robots.txt
Redirect https://www.sinerji.gen.tr/robots.txt
Redirect Domain www.sinerji.gen.tr
Redirect Base sinerji.gen.tr
Domain IPs 104.26.0.110, 104.26.1.110, 172.67.74.137, 2606:4700:20::681a:16e, 2606:4700:20::681a:6e, 2606:4700:20::ac43:4a89
Redirect IPs 104.26.0.110, 104.26.1.110, 172.67.74.137, 2606:4700:20::681a:16e, 2606:4700:20::681a:6e, 2606:4700:20::ac43:4a89
Response IP 172.67.74.137
Found Yes
Hash 50e183f5dbab88a5c44655b104bef18165668d9df5d499e9900bbacd8fe373e1
SimHash 881d76c00c13

Groups

*

Rule Path
Disallow /myaccount/
Disallow /account/
Disallow /shoppingcart/
Disallow /payment/
Disallow /common/
Disallow /Product/_ProductActionIsListed
Disallow /Payment/_InstallmentPlans*

yandex
bingbot

Rule Path
Disallow /*sx*

grapeshotcrawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

adsrvrbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

pingdombot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

baidu

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yaanibot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

ip-web-crawler.com

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

discoverybot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

siteliner

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

nutch

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

proximic

Rule Path
Disallow /

spbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

wesee

Rule Path
Disallow /

yandexmarket

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

advbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

ntentbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.sinerji.gen.tr/sitemap.xml

Warnings

  • 2 invalid lines.