jahajee.com
robots.txt

Robots Exclusion Standard data for jahajee.com

Resource Scan

Scan Details

Site Domain jahajee.com
Base Domain jahajee.com
Scan Status Ok
Last Scan2024-11-12T13:53:11+00:00
Next Scan 2024-11-19T13:53:11+00:00

Last Scan

Scanned2024-11-12T13:53:11+00:00
URL https://jahajee.com/robots.txt
Redirect https://www.jahajee.com/robots.txt
Redirect Domain www.jahajee.com
Redirect Base jahajee.com
Domain IPs 139.59.39.159
Redirect IPs 139.59.39.159
Response IP 139.59.39.159
Found Yes
Hash 07f9e0ad155fd198cd907e5d27c66eb98cbc15262e8c0943caa13dbb02426508
SimHash d01856c77831

Groups

*

Rule Path
Disallow /pwd/
Disallow /search/
Disallow /r/
Disallow /feedback/
Disallow /edit/
Disallow /track/
Disallow *?tki=
Disallow *?c=post
Disallow *?c=vote
Disallow *?c=add
Disallow /claim/
Disallow /login/

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

googlebot-news

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-video

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

baiduspider

Rule Path
Disallow

yandex

Rule Path
Disallow

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 60

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 60

mediapartners

Rule Path
Disallow

slurp

Rule Path
Disallow

jeeves

Rule Path
Disallow

twitterbot

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

bleriot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

centurybot9

Rule Path
Disallow /

centurybot9@gmail.com

Rule Path
Disallow /

clickagy intelligence bot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

commoncrawler

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

daum

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

germcrawler

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

linkdexbot-mobile

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

netseer

Rule Path
Disallow /

nutch

Rule Path
Disallow /

obot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

seolyticscrawler

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

wesee

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.jahajee.com/sitemap.xml