bizimcografya.com
robots.txt

Robots Exclusion Standard data for bizimcografya.com

Resource Scan

Scan Details

Site Domain bizimcografya.com
Base Domain bizimcografya.com
Scan Status Ok
Last Scan2024-09-29T05:19:40+00:00
Next Scan 2024-10-06T05:19:40+00:00

Last Scan

Scanned2024-09-29T05:19:40+00:00
URL https://bizimcografya.com/robots.txt
Redirect https://www.bizimcografya.com/robots.txt
Redirect Domain www.bizimcografya.com
Redirect Base bizimcografya.com
Domain IPs 185.254.237.170
Redirect IPs 185.254.237.170
Response IP 185.254.237.170
Found Yes
Hash 74fc0c2c05126b88c2f08b07c28a2c52a1c702787421409099c5161e98b7227a
SimHash c0454e8a4443

Groups

mediapartners-google*

Rule Path
Disallow

akakce

Rule Path
Disallow /

asterias

Rule Path
Disallow /

bizbot003

Rule Path
Disallow /

bpimagewalker

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

excite

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

heraspider

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

infoseek

Rule Path
Disallow /

lycra

Rule Path
Disallow /

lycos

Rule Path
Disallow /

mycnnspider

Rule Path
Disallow /

nutch

Rule Path
Disallow /
Disallow /

purebot

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

slurp

Rule Path
Disallow /

slowbot

Rule Path
Disallow /

surfbot

Rule Path
Disallow /

summycrawler

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

ti spider

Rule Path
Disallow /

teoma

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

yahoo-blogs

Rule Path
Disallow /

yahoo/inktomi

Rule Path
Disallow /

yeti

Rule Path
Disallow /

webcrawler

Rule Path
Disallow /

w3index

Rule Path
Disallow /

wisenut

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.bizimcografya.com/sitemap.php

Warnings

  • 1 invalid line.
  • `sitemap index` is not a known field.