duzcetso.org.tr
robots.txt
Robots Exclusion Standard data for duzcetso.org.tr
Resource Scan
Scan Details
Site Domain | duzcetso.org.tr |
Base Domain | duzcetso.org.tr |
Scan Status | Ok |
Last Scan | 2024-09-08T21:56:17+00:00 |
Next Scan | 2024-10-08T21:56:17+00:00 |
Last Scan
Scanned | 2024-09-08T21:56:17+00:00 |
URL | https://duzcetso.org.tr/robots.txt |
Domain IPs | 185.210.93.139 |
Response IP | 185.210.93.139 |
Found | Yes |
Hash | ff0ce1aee6ac9a5ce716e6e040b9b3f5c175d607c96cc15ebf0ad79678670a5b |
SimHash | 4a145143d5b1 |
Groups
googlebot
googlebot-video
adsbot-google
googlebot-mobile
googlebot-news
googlebot-image
googlebot-image/1.0
mediapartners-google
slurp
yahoo! slurp
yahoo-mmcrawler
msnbot
twitterbot
yandexbot
yandeximages
yandex
bingbot
applebot
ia_archiver
baiduspider
naverbot
seznambot
teoma
yeti
grapeshot
linklooker
enigmabot
ninjabot
ahrefsbot
duckduckbot
facebookexternalhit
icc-crawler
pinterest
bspider
exabot
exabot-images
ocelli
ichiro
archive.org_bot
heritrix
httrack
jakarta commons-httpclient
jbot
magpierss
mail.ru
nutch
phantom
python-urllib
sogou develop spider
sogou orion spider
sogou spider
sogou web spider
sohu agent
turnitinbot
web core / roots
yandexmetrika
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
*
Rule | Path |
---|---|
Allow | / |
Allow | /resim/* |
Allow | /resim/upload/* |
Allow | /resim/upload/ |
Warnings
- 2 invalid lines.