jehovahs-witness.com
robots.txt

Robots Exclusion Standard data for jehovahs-witness.com

Resource Scan

Scan Details

Site Domain jehovahs-witness.com
Base Domain jehovahs-witness.com
Scan Status Ok
Last Scan2024-11-16T09:48:51+00:00
Next Scan 2024-11-23T09:48:51+00:00

Last Scan

Scanned2024-11-16T09:48:51+00:00
URL https://www.jehovahs-witness.com/robots.txt
Domain IPs 104.21.74.231, 172.67.164.80, 2606:4700:3032::6815:4ae7, 2606:4700:3037::ac43:a450
Response IP 172.67.164.80
Found Yes
Hash 62b4a23b19b7b6f883818bcd36ed844bbcbcc052bb8c7e0a2350cd5f3e958f2b
SimHash 400d5a52ec13

Groups

ahrefsbot

Rule Path
Disallow /

clickagy intelligence bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /account/
Disallow /api/
Disallow /subject/
Disallow /search/
Disallow /*/_post/*

Other Records

Field Value
sitemap https://www.jehovahs-witness.com/sitemap.xml