prep.youth4work.com
robots.txt
Robots Exclusion Standard data for prep.youth4work.com
Resource Scan
Scan Details
| Site Domain | prep.youth4work.com |
| Base Domain | youth4work.com |
| Scan Status | Ok |
| Last Scan | 2024-10-27T19:01:22+00:00 |
| Next Scan | 2024-11-26T19:01:22+00:00 |
Last Scan
| Scanned | 2024-10-27T19:01:22+00:00 |
| URL | https://prep.youth4work.com/robots.txt |
| Domain IPs | 20.192.170.11 |
| Response IP | 20.192.170.11 |
| Found | Yes |
| Hash | f1fb1bcb9853d63f23e69d459441d19c797e5d5ab2825a48efb235362fff1514 |
| SimHash | 2c72ab526181 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /bn/ |
| Disallow | /de/ |
| Disallow | /fr/ |
| Disallow | /gu/ |
| Disallow | /it/ |
| Disallow | /ja/ |
| Disallow | /kn/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /or/ |
| Disallow | /pa/ |
| Disallow | /ru/ |
| Disallow | /ta/ |
| Disallow | /te/ |
| Disallow | /tr/ |
| Disallow | /ur/ |
| Disallow | /zh/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /es/ |
applebot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
bingbot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
msnbot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
slurp
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /bn/ |
| Disallow | /de/ |
| Disallow | /fr/ |
| Disallow | /gu/ |
| Disallow | /it/ |
| Disallow | /ja/ |
| Disallow | /kn/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /or/ |
| Disallow | /pa/ |
| Disallow | /ru/ |
| Disallow | /ta/ |
| Disallow | /te/ |
| Disallow | /tr/ |
| Disallow | /ur/ |
| Disallow | /zh/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /es/ |
googlebot-news
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /bn/ |
| Disallow | /de/ |
| Disallow | /fr/ |
| Disallow | /gu/ |
| Disallow | /it/ |
| Disallow | /ja/ |
| Disallow | /kn/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /or/ |
| Disallow | /pa/ |
| Disallow | /ru/ |
| Disallow | /ta/ |
| Disallow | /te/ |
| Disallow | /tr/ |
| Disallow | /ur/ |
| Disallow | /zh/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /es/ |
googlebot-video
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /bn/ |
| Disallow | /de/ |
| Disallow | /fr/ |
| Disallow | /gu/ |
| Disallow | /it/ |
| Disallow | /ja/ |
| Disallow | /kn/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /or/ |
| Disallow | /pa/ |
| Disallow | /ru/ |
| Disallow | /ta/ |
| Disallow | /te/ |
| Disallow | /tr/ |
| Disallow | /ur/ |
| Disallow | /zh/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /es/ |
googlebot-mobile
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /bn/ |
| Disallow | /de/ |
| Disallow | /fr/ |
| Disallow | /gu/ |
| Disallow | /it/ |
| Disallow | /ja/ |
| Disallow | /kn/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /or/ |
| Disallow | /pa/ |
| Disallow | /ru/ |
| Disallow | /ta/ |
| Disallow | /te/ |
| Disallow | /tr/ |
| Disallow | /ur/ |
| Disallow | /zh/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /es/ |
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
adsbot-google-mobile
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
adsbot-google-mobile-apps
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
baiduspider
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /es/ |
| Disallow | /hi/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
seznambot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
teoma
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
yandex
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /hi/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
yeti
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
msnbot-media
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
duckduckbot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
daumoa
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
orangebot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
orangebot-collector
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
stackrambler
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
twitterbot/1.0
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
mail.ru_bot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /hi/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
naverbot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
vebidoobot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
mj12bot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
sogou
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
rogerbot
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
deepcrawl
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
*
| Rule | Path |
|---|---|
| Disallow | /Documents/New_Openings_Resume/ |
| Disallow | /Documents/Colleges/attache/ |
| Disallow | /Documents/PrepTest/StudyMaterial/ |
| Disallow | /tr/ |
| Disallow | /gu/ |
| Disallow | /fr/ |
| Disallow | /te/ |
| Disallow | /ta/ |
| Disallow | /ml/ |
| Disallow | /mr/ |
| Disallow | /ur/ |
| Disallow | /kn/ |
| Disallow | /ar/ |
| Disallow | /pt/ |
| Disallow | /ru/ |
| Disallow | /de/ |
| Disallow | /or/ |
| Disallow | /ja/ |
| Disallow | /pa/ |
| Disallow | /zh/ |
| Disallow | /bn/ |
| Disallow | /it/ |
| Disallow | /es/ |
Warnings
- 24 invalid lines.