cartercoupons.com
robots.txt

Robots Exclusion Standard data for cartercoupons.com

Resource Scan

Scan Details

Site Domain cartercoupons.com
Base Domain cartercoupons.com
Scan Status Ok
Last Scan2024-07-01T12:57:50+00:00
Next Scan 2024-07-08T12:57:50+00:00

Last Scan

Scanned2024-07-01T12:57:50+00:00
URL https://www.cartercoupons.com/robots.txt
Domain IPs 104.21.76.174, 172.67.197.251, 2606:4700:3030::6815:4cae, 2606:4700:3036::ac43:c5fb
Response IP 104.21.76.174
Found Yes
Hash 6fe6106675a396b53748a45b5f35497409f0f9dde75685b2cd010a7730496b7d
SimHash bb15df30ceb0

Groups

*

Rule Path
Disallow /wp-admin/admin-ajax.php
Disallow /wp-content/uploads/
Disallow /wp-admin/
Disallow /user/
Disallow /user
Disallow /comments/feed/
Disallow /cgi-bin/
Disallow /out/
Disallow /user/
Disallow /go-store/
Disallow /go-store/*
Disallow /author
Disallow /author*
Disallow /author/
Disallow /author/*
Disallow /feed/
Disallow */feed/
Disallow /feed/*
Disallow /author/
Disallow /*?*
Disallow *?replytocom
Disallow /wp-*
Disallow /comments/feed/
Disallow /?s=*%2F
Disallow /page/*

ninjabot

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

ia_archiver

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ntentbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

caliperbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

hubspot links crawler 1.0

Rule Path
Disallow /

hubspot links crawler 2.0

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

linespider

Rule Path
Disallow /

ias-va/3.1

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.cartercoupons.com/coupon_store-sitemap.xml

Warnings

  • 2 invalid lines.