san-ignacio.adhoards.com
robots.txt
Robots Exclusion Standard data for san-ignacio.adhoards.com
Resource Scan
Scan Details
Site Domain | san-ignacio.adhoards.com |
Base Domain | adhoards.com |
Scan Status | Ok |
Last Scan | 2024-09-17T18:28:03+00:00 |
Next Scan | 2024-10-17T18:28:03+00:00 |
Last Scan
Scanned | 2024-09-17T18:28:03+00:00 |
URL | https://san-ignacio.adhoards.com/robots.txt |
Domain IPs | 2600:9000:2721:2e00:1a:5324:f800:93a1, 2600:9000:2721:3e00:1a:5324:f800:93a1, 2600:9000:2721:4800:1a:5324:f800:93a1, 2600:9000:2721:800:1a:5324:f800:93a1, 2600:9000:2721:9000:1a:5324:f800:93a1, 2600:9000:2721:a400:1a:5324:f800:93a1, 2600:9000:2721:aa00:1a:5324:f800:93a1, 2600:9000:2721:da00:1a:5324:f800:93a1, 3.165.102.11, 3.165.102.118, 3.165.102.18, 3.165.102.94 |
Response IP | 3.165.102.118 |
Found | Yes |
Hash | fe15d0861d0c011e5baf43fc2af2bb5178ac7350a29dad651efd63e14dcd4461 |
SimHash | 43ff63726cd2 |
Groups
mediapartners-google
Rule | Path |
---|---|
Disallow | /adimgtemp/ |
Disallow | /admin/ |
Disallow | /library/ |
Disallow | /thirdparty/ |
Disallow | /utility/ |
Disallow | /xmlcontent/ |
Disallow | /application/ |
Disallow | /application/ |
adsbot-google
Rule | Path |
---|---|
Disallow | /adimgtemp/ |
Disallow | /admin/ |
Disallow | /library/ |
Disallow | /thirdparty/ |
Disallow | /utility/ |
Disallow | /xmlcontent/ |
Disallow | /application/ |
Disallow | /application/ |
Other Records
Field | Value |
---|---|
crawl-delay | 200 |
mozilla/5.0 (compatible; linux x86_64; mail.ru_bot/2.0; +http://go.mail.ru/help/robots)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0(compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (compatible; archive.org_bot +http://www.archive.org/details/archive.org_bot)
Rule | Path |
---|---|
Disallow | / |
ia_archiver
Rule | Path |
---|---|
Allow | / |
Disallow | /adimgtemp/ |
Disallow | /admin/ |
Disallow | /*/ajax_ |
Disallow | /*/pageloc_ |
Disallow | /*/validCaptcha/ |
Disallow | /cron/ |
Disallow | /*/*/sendReport/ |
Disallow | /*/*/AdConatctAdd/ |
Disallow | /*/*/AdConatctAdd |
Disallow | /*/*/showCaptcha/ |
Disallow | /*/*/resetpassword/* |
Disallow | /application/ |
Disallow | /errorlog/* |
Disallow | /admin/* |
Disallow | /library/ |
Disallow | /system/* |
Disallow | /system/ |
Disallow | /thirdparty/ |
Disallow | /application/ |
Disallow | /utility/ |
Disallow | /xmlcontent/ |
Disallow | /sqladmin/ |
Disallow | /*/success/* |
Disallow | /premium_ad/ |
Disallow | /premium_ad/* |
Disallow | /AdConatctAdd |
Disallow | /showCaptcha/ |
Disallow | /homelocation/ |
Disallow | /homelocation/* |
bingbot
Rule | Path |
---|---|
Disallow | /adimgtemp/ |
Disallow | /admin/ |
Disallow | /*/ajax_ |
Disallow | /*/pageloc_ |
Disallow | /*/validCaptcha/ |
Disallow | /cron/ |
Disallow | /*/*/sendReport/ |
Disallow | /*/*/AdConatctAdd/ |
Disallow | /*/*/AdConatctAdd |
Disallow | /*/*/showCaptcha/ |
Disallow | /*/*/resetpassword/* |
Disallow | /application/ |
Disallow | /errorlog/* |
Disallow | /admin/* |
Disallow | /library/ |
Disallow | /system/* |
Disallow | /system/ |
Disallow | /thirdparty/ |
Disallow | /application/ |
Disallow | /utility/ |
Disallow | /xmlcontent/ |
Disallow | /sqladmin/ |
Disallow | /*/success/* |
Disallow | /premium_ad/ |
Disallow | /premium_ad/* |
Disallow | /AdConatctAdd |
Disallow | /showCaptcha/ |
Disallow | /homelocation/ |
Disallow | /homelocation/* |
Other Records
Field | Value |
---|---|
crawl-delay | 100 |
ravencrawler
Rule | Path |
---|---|
Disallow | /adimgtemp/ |
Disallow | /admin/ |
Disallow | /*/ajax_ |
Disallow | /*/pageloc_ |
Disallow | /*/validCaptcha/ |
Disallow | /cron/ |
Disallow | /*/*/sendReport/ |
Disallow | /*/*/AdConatctAdd/ |
Disallow | /*/*/AdConatctAdd |
Disallow | /*/*/showCaptcha/ |
Disallow | /*/*/resetpassword/* |
Disallow | /application/ |
Disallow | /errorlog/* |
Disallow | /admin/* |
Disallow | /library/ |
Disallow | /system/* |
Disallow | /system/ |
Disallow | /thirdparty/ |
Disallow | /application/ |
Disallow | /utility/ |
Disallow | /xmlcontent/ |
Disallow | /sqladmin/ |
Disallow | /*/success/* |
Disallow | /premium_ad/ |
Disallow | /premium_ad/* |
Disallow | /AdConatctAdd |
Disallow | /showCaptcha/ |
Disallow | /homelocation/ |
Disallow | /homelocation/* |
mozilla/5.0 (compatible; duckduckgo-favicons-bot/1.0; +http://duckduckgo.com)
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 300 |
iiitbot/1.1 (indian language web search engine; http://webkhoj.iiit.net; pvvpr at iiit dot ac dot in)
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Allow | / |
Disallow | /*/*/sendFriendmail/ |
Disallow | /*/*/sendReport |
Disallow | /adimgtemp/ |
Disallow | /28828156/ |
Disallow | /28828156/* |
Disallow | /admin/ |
Disallow | /*/ajax_ |
Disallow | /*/pageloc_ |
Disallow | /*/validCaptcha/ |
Disallow | /*/validCaptcha |
Disallow | /*checkCaptcha |
Disallow | /*checkCaptcha/ |
Disallow | /*/*/sendReport/ |
Disallow | /*/*/AdConatctAdd/ |
Disallow | /*/*/AdConatctAdd |
Disallow | /*/*/showCaptcha/ |
Disallow | /*/*/resetpassword/* |
Disallow | /application/ |
Disallow | /errorlog/* |
Disallow | /sendFriendmail/ |
Disallow | /sendFriendmail/* |
Disallow | /admin/* |
Disallow | /library/ |
Disallow | /system/* |
Disallow | /system/ |
Disallow | /search/ |
Disallow | /all/search/ |
Disallow | /all/search/* |
Disallow | /search/* |
Disallow | */search/* |
Disallow | /thirdparty/ |
Disallow | /application/ |
Disallow | /utility/ |
Disallow | /xmlcontent/ |
Disallow | /homelocation/ |
Disallow | /homelocation/* |
Disallow | /cron/ |
Disallow | /messagebox |
Disallow | /sqladmin/ |
Disallow | /*/success/* |
Disallow | /premium_ad/ |
Disallow | /premium_ad/* |
Disallow | /AdConatctAdd |
Disallow | /*?page=*&page=* |
Disallow | /*?page=* |
Allow | /rss/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.adhoards.com/sitemapmain.xml |
Warnings
- 9 invalid lines.
- `crawl-limit` is not a known field.
Comments