catchymood.com
robots.txt

Robots Exclusion Standard data for catchymood.com

Resource Scan

Scan Details

Site Domain catchymood.com
Base Domain catchymood.com
Scan Status Ok
Last Scan2024-11-13T05:30:05+00:00
Next Scan 2024-11-20T05:30:05+00:00

Last Scan

Scanned2024-11-13T05:30:05+00:00
URL https://catchymood.com/robots.txt
Domain IPs 104.21.49.6, 172.67.139.252, 2606:4700:3031::6815:3106, 2606:4700:3035::ac43:8bfc
Response IP 104.21.49.6
Found Yes
Hash cf5b31eed864aa62abfcd309be71001679e8e9344485cf7df1e9af94c349f128
SimHash 5bc66372c2a9

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-content/plugins
Disallow /wp-admin/
Disallow /trackback/
Disallow /*?cid*
Disallow /*?s*

*

Rule Path
Allow /ads.txt
Disallow /ads

bytespider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

madbbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

baiduimagespider

Rule Path
Disallow /

baidumobaider

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

proximic

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

microadbot

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

quantcastbot

Rule Path
Disallow /

contxbot

Rule Path
Disallow /

bidswitchbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

linespider

Rule Path
Disallow /

mappy

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

integralads

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

jet-bot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /
Allow /wp-content/uploads

googlebot

Rule Path
Disallow
Allow /*

googlebot-news

Rule Path
Disallow
Allow /*

googlebot-image

Rule Path
Disallow
Allow /*

googlebot-video

Rule Path
Disallow
Allow /*

googlebot-mobile

Rule Path
Disallow
Allow /*

mediapartners-google

Rule Path
Disallow
Allow /*

adsbot-google

Rule Path
Disallow
Allow /*

feedburner.com

Rule Path
Disallow
Allow /*

amazonadbot

Rule Path
Disallow
Allow /*

Other Records

Field Value
sitemap https://catchymood.com/sitemap.xml
sitemap https://catchymood.com/goods_and_life_plus/sitemap.xml

Warnings

  • 2 invalid lines.