Log In Sign Up

pdi.com.tr
robots.txt

Robots Exclusion Standard data for pdi.com.tr

Resource Scan

Scan Details

Site Domain pdi.com.tr
Base Domain pdi.com.tr
Scan Status Ok
Last Scan2024-05-25T11:21:32+00:00
Next Scan 2024-06-24T11:21:32+00:00

Last Scan

Scanned2024-05-25T11:21:32+00:00
URL https://pdi.com.tr/robots.txt
Domain IPs 212.58.28.139
Response IP 212.58.28.139
Found Yes
Hash c39ad8fb826f072b9aaee079f965eae1f484a92db2f5e754e9fb6eed0a92bc59
SimHash 3212404ed8d3

Groups

*

Rule Path
Disallow /_____old

exabot

Rule Path
Disallow /

thesubot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yetibot

Rule Path
Disallow /

yeti/0.01

Rule Path
Disallow /

nhn/1noon

Rule Path
Disallow /

nhn

Rule Path
Disallow /

discobot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

mj12bot

Rule Path
Disallow

suggybot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

iisbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

custo 3.0 (www.netwu.com)

Rule Path
Disallow /

custo 3 (netwu.com)

Rule Path
Disallow /

scrapy*

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

newspointbot/1.0 (http://www.netsprint.eu/)

Rule Path
Disallow /

aipbot

Rule Path
Disallow /

qihoobot 1.0

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

mj12bot

Rule Path
Disallow

suggybot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

iisbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

custo 3.0 (www.netwu.com)

Rule Path
Disallow /

custo 3 (netwu.com)

Rule Path
Disallow /

scrapy*

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

newspointbot/1.0 (http://www.netsprint.eu/)

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

seodiver

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://www.pdi.com.tr/sitemap.xml
Back to top

Warnings

  • 2 invalid lines.
Back to top