churchtechtoday.com
robots.txt

Robots Exclusion Standard data for churchtechtoday.com

Resource Scan

Scan Details

Site Domain churchtechtoday.com
Base Domain churchtechtoday.com
Scan Status Ok
Last Scan2024-10-25T07:05:03+00:00
Next Scan 2024-11-01T07:05:03+00:00

Last Scan

Scanned2024-10-25T07:05:03+00:00
URL https://churchtechtoday.com/robots.txt
Domain IPs 199.189.225.22
Response IP 199.189.225.22
Found Yes
Hash 80f98946e1cbfdea9c415c4e9daa39e929d167cab80046baa5c7ec9716f55a9b
SimHash 0929d6c2c623

Groups

baiduspider/2.0

Rule Path
Disallow /

jeeves

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 5.0; yandex)

Rule Path
Disallow /

mozilla/5.0 (x11; ubuntu; linux x86_64; rv:62.0) gecko/20100101 firefox/62.0

Rule Path
Disallow /

mozilla/5.0 (compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)

Rule Path
Disallow /

mozilla/5.0 (compatible; yandexbot/3.0; +http://yandex.com/bots)

Rule Path
Disallow /

sogou web spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm

Product Comment
sogou web spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm 07)
Rule Path
Disallow /

sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm

Product Comment
sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm 07)
Rule Path
Disallow /

yandex/1.01.001 (compatible; win16; i)

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

mail-162-161.rch003.net

Rule Path
Disallow /

psbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

sogou develop spider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sohu agent

Rule Path
Disallow /

spider5.boardreader.com

Rule Path
Disallow /

totalplay.com.mx

Rule Path
Disallow /

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /wp-admin/
Disallow /facebook
Disallow /images
Disallow /oldsite
Disallow /wp-includes
Disallow /wp-snapshots

Other Records

Field Value
crawl-delay 15.0

Other Records

Field Value
sitemap https://churchtechtoday.com/sitemap_index.xml