www.ytest.youth4work.com
robots.txt
Robots Exclusion Standard data for www.ytest.youth4work.com
Resource Scan
Scan Details
| Site Domain | www.ytest.youth4work.com |
| Base Domain | youth4work.com |
| Scan Status | Ok |
| Last Scan | 2024-11-03T15:52:31+00:00 |
| Next Scan | 2024-12-03T15:52:31+00:00 |
Last Scan
| Scanned | 2024-11-03T15:52:31+00:00 |
| URL | https://www.ytest.youth4work.com/robots.txt |
| Domain IPs | 20.192.170.11 |
| Response IP | 20.192.170.11 |
| Found | Yes |
| Hash | c4fe7bdfab59c2d816d7de85aee948f4191ac2bbeca91ffb992f44c756dbef56 |
| SimHash | 0c72cb1261c1 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /bn/ |
| Disallow | /de/ |
| Disallow | /fr/ |
| Disallow | /gu/ |
| Disallow | /it/ |
| Disallow | /ja/ |
| Disallow | /kn/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /or/ |
| Disallow | /pa/ |
| Disallow | /ru/ |
| Disallow | /ta/ |
| Disallow | /te/ |
| Disallow | /tr/ |
| Disallow | /ur/ |
applebot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
bingbot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
msnbot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
slurp
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /bn/ |
| Disallow | /de/ |
| Disallow | /fr/ |
| Disallow | /gu/ |
| Disallow | /it/ |
| Disallow | /ja/ |
| Disallow | /kn/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /or/ |
| Disallow | /pa/ |
| Disallow | /ru/ |
| Disallow | /ta/ |
| Disallow | /te/ |
| Disallow | /tr/ |
| Disallow | /ur/ |
googlebot-news
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /bn/ |
| Disallow | /de/ |
| Disallow | /fr/ |
| Disallow | /gu/ |
| Disallow | /it/ |
| Disallow | /ja/ |
| Disallow | /kn/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /or/ |
| Disallow | /pa/ |
| Disallow | /ru/ |
| Disallow | /ta/ |
| Disallow | /te/ |
| Disallow | /tr/ |
| Disallow | /ur/ |
googlebot-video
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /bn/ |
| Disallow | /de/ |
| Disallow | /fr/ |
| Disallow | /gu/ |
| Disallow | /it/ |
| Disallow | /ja/ |
| Disallow | /kn/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /or/ |
| Disallow | /pa/ |
| Disallow | /ru/ |
| Disallow | /ta/ |
| Disallow | /te/ |
| Disallow | /tr/ |
| Disallow | /ur/ |
googlebot-mobile
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /bn/ |
| Disallow | /de/ |
| Disallow | /fr/ |
| Disallow | /gu/ |
| Disallow | /it/ |
| Disallow | /ja/ |
| Disallow | /kn/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /or/ |
| Disallow | /pa/ |
| Disallow | /ru/ |
| Disallow | /ta/ |
| Disallow | /te/ |
| Disallow | /tr/ |
| Disallow | /ur/ |
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /bn/ |
| Disallow | /de/ |
| Disallow | /fr/ |
| Disallow | /gu/ |
| Disallow | /it/ |
| Disallow | /ja/ |
| Disallow | /kn/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /or/ |
| Disallow | /pa/ |
| Disallow | /ru/ |
| Disallow | /ta/ |
| Disallow | /te/ |
| Disallow | /tr/ |
| Disallow | /ur/ |
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /bn/ |
| Disallow | /de/ |
| Disallow | /fr/ |
| Disallow | /gu/ |
| Disallow | /it/ |
| Disallow | /ja/ |
| Disallow | /kn/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /or/ |
| Disallow | /pa/ |
| Disallow | /ru/ |
| Disallow | /ta/ |
| Disallow | /te/ |
| Disallow | /tr/ |
| Disallow | /ur/ |
adsbot-google-mobile
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /bn/ |
| Disallow | /de/ |
| Disallow | /fr/ |
| Disallow | /gu/ |
| Disallow | /it/ |
| Disallow | /ja/ |
| Disallow | /kn/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /or/ |
| Disallow | /pa/ |
| Disallow | /ru/ |
| Disallow | /ta/ |
| Disallow | /te/ |
| Disallow | /tr/ |
| Disallow | /ur/ |
adsbot-google-mobile-apps
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /bn/ |
| Disallow | /de/ |
| Disallow | /fr/ |
| Disallow | /gu/ |
| Disallow | /it/ |
| Disallow | /ja/ |
| Disallow | /kn/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /or/ |
| Disallow | /pa/ |
| Disallow | /ru/ |
| Disallow | /ta/ |
| Disallow | /te/ |
| Disallow | /tr/ |
| Disallow | /ur/ |
baiduspider
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /es/ |
| Disallow | /hi/ |
| Disallow | /bn/ |
| Disallow | /it/ |
seznambot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
teoma
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
yandex
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /hi/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
yeti
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
msnbot-media
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
duckduckbot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
daumoa
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
orangebot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
orangebot-collector
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
stackrambler
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
twitterbot/1.0
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
mail.ru_bot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /hi/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
naverbot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
vebidoobot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
mj12bot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
sogou
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
rogerbot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
deepcrawl
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
*
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 23 invalid lines.