cardcow.com
robots.txt

Robots Exclusion Standard data for cardcow.com

Resource Scan

Scan Details

Site Domain cardcow.com
Base Domain cardcow.com
Scan Status Ok
Last Scan2024-09-20T11:17:14+00:00
Next Scan 2024-09-27T11:17:14+00:00

Last Scan

Scanned2024-09-20T11:17:14+00:00
URL https://cardcow.com/robots.txt
Redirect https://www.cardcow.com/robots.txt
Redirect Domain www.cardcow.com
Redirect Base cardcow.com
Domain IPs 104.197.81.67
Redirect IPs 104.197.81.67
Response IP 104.197.81.67
Found Yes
Hash f2947d1df0c1fdbd2eb51110c32b84d151fbe0efded6bb5e2f6eef9bb83440b2
SimHash d13c5d43260c

Groups

mediapartners-google

Rule Path
Disallow

amazonbot

Rule Path
Disallow /search3.php
Disallow /search3.php*
Disallow /cart.php*
Disallow /help/

imagesiftbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

paracrawl

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

rainbot

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

fidget-spinner-bot

Rule Path
Disallow /

thesis-research-bot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

yandex

Rule Path
Disallow /images/backs/
Disallow /images/hits/
Disallow /wallpaper/
Disallow /backs/
Disallow /ecard/
Disallow /ecard
Disallow /search.php
Disallow /search2.php
Disallow /search3.php
Disallow /search4.php
Disallow /search/
Disallow /stock-photo/
Disallow /help/
Disallow /ebr/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /ecard/
Disallow /ecard*
Disallow /popup_ask.php
Disallow /account
Disallow /backs/
Disallow /backs
Disallow /rss/
Disallow /search.php
Disallow /product.php
Disallow /cart.php
Disallow /cart.php?*
Disallow /cart.php*
Disallow /misc
Disallow /cgi-bin
Disallow /help/
Disallow /help?section=contactus&*
Disallow /help.php
Disallow /savedsearches/
Disallow /*_bk.jpg$
Disallow /image.php
Disallow /get_block.php
Disallow /adaptive.php
Disallow /*printable%3DY*
Disallow /*js%3D*
Disallow /*print_cat%3D*
Disallow /*mode%3Dadd_vote*
Disallow /category.php
Disallow /register/
Disallow /login/
Disallow /ebr/
Disallow /t/
Disallow /antibot_image.php
Disallow /antibot_image/
Disallow /antibot_image/*
Disallow /s/
Disallow /ac/
Disallow /city-lookup/?*
Disallow /newsletter/
Disallow /help/?mode=update*
Disallow /*?*price_search_1=*
Disallow /*?*price_search_2=*
Disallow /*?*perpage=*
Disallow /*?*backs=*
Disallow /*?*orientation=*
Disallow /*?*sort=p*

baiduspider

Rule Path
Disallow /account/
Disallow /ecard/
Disallow /stock-photo/
Disallow /search3.php
Disallow /search4.php
Disallow /search/
Disallow /search.php
Disallow /images/backs/
Disallow /images/hits/
Disallow /wallpaper/
Disallow /backs/
Disallow /cart.php
Disallow /ebr/

Other Records

Field Value
crawl-delay 5.0

googlebot-image

Rule Path
Disallow /*_bk*.jpg$
Disallow /*_fr-*.jpg$
Disallow /antibot_image.php
Disallow /antibot_image/

shopwiki

Rule Path
Disallow /ecard
Disallow /wallpaper/
Disallow /search3
Disallow /stock-photo/

Other Records

Field Value
crawl-delay 10

twengabot-2.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

sitesucker

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

proximic

Rule Path
Disallow /

integromedb

Rule Path
Disallow /

daum

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /cart.php

powermapper

Rule Path
Disallow /*.css
Disallow /viewall/
Disallow /cart.php*
Disallow /search3.php*
Disallow /*objects_per_page%3D*
Disallow /page%3D*
Disallow /sort%3D*
Disallow /*printable%3DY*
Disallow /*rtoken%3D*
Disallow */thumbs/*
Disallow /*.jpg

Other Records

Field Value
sitemap https://www.cardcow.com/sitemap/sitemap_index.xml

Warnings

  • 2 invalid lines.