Log In Sign Up

jeevanjali.com
robots.txt

Robots Exclusion Standard data for jeevanjali.com

Resource Scan

Scan Details

Site Domain jeevanjali.com
Base Domain jeevanjali.com
Scan Status Ok
Last Scan2024-10-29T06:17:18+00:00
Next Scan 2024-11-05T06:17:18+00:00

Last Scan

Scanned2024-10-29T06:17:18+00:00
URL https://jeevanjali.com/robots.txt
Redirect https://www.jeevanjali.com/robots.txt
Redirect Domain www.jeevanjali.com
Redirect Base jeevanjali.com
Domain IPs 108.156.133.107, 108.156.133.12, 108.156.133.25, 108.156.133.83
Redirect IPs 13.225.4.104, 13.225.4.29, 13.225.4.40, 13.225.4.48, 2600:9000:21b4:4200:16:f819:dec0:93a1, 2600:9000:21b4:4c00:16:f819:dec0:93a1, 2600:9000:21b4:5200:16:f819:dec0:93a1, 2600:9000:21b4:6400:16:f819:dec0:93a1, 2600:9000:21b4:6800:16:f819:dec0:93a1, 2600:9000:21b4:9000:16:f819:dec0:93a1, 2600:9000:21b4:b400:16:f819:dec0:93a1, 2600:9000:21b4:c000:16:f819:dec0:93a1
Response IP 13.225.4.29
Found Yes
Hash 5e613c52c71f7950432b84ef8dda53c18185f0de2316981254dcdeff43ee4c56
SimHash 6119094181b0

Groups

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

applebot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /jeevanjali/*
Back to top

Other Records

Field Value
sitemap https://www.jeevanjali.com/sitemap.xml
sitemap https://www.jeevanjali.com/sitemap-news.xml
Back to top