mycreditcardclub.com
robots.txt

Robots Exclusion Standard data for mycreditcardclub.com

Resource Scan

Scan Details

Site Domain mycreditcardclub.com
Base Domain mycreditcardclub.com
Scan Status Ok
Last Scan2024-11-16T00:30:21+00:00
Next Scan 2024-11-23T00:30:21+00:00

Last Scan

Scanned2024-11-16T00:30:21+00:00
URL https://mycreditcardclub.com/robots.txt
Domain IPs 104.21.23.71, 172.67.209.126, 2606:4700:3032::6815:1747, 2606:4700:3037::ac43:d17e
Response IP 172.67.209.126
Found Yes
Hash 11e22cbbc18f13e1ec01a69b582b6658ed37374fcf19f66d2bba215d966ccbd9
SimHash 4b3c16b0e190

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /tag/
Disallow /category/
Disallow /expand_article/
Disallow /comment-page/
Disallow /cdn-cgi/
Disallow /beardeddragon/
Disallow /secure.gravatar/
Disallow /porpoiseant/
Disallow /detroitchicago/
Disallow /tardisrocinante/
Disallow /google_vignette/
Disallow /facebook.com/
Disallow /twitter.com/
Disallow /pinterest.com/
Disallow /linkedin.com/
Disallow /reddit.com/
Disallow /api.whatsapp.com/
Disallow /endpoint/
Disallow /apply/
Disallow /apply-now/
Disallow /apply-banner/
Disallow /apply-marketplace/
Disallow /search/
Disallow /*s%3D

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

openai

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://mycreditcardclub.com/mohini.xml

Warnings

  • `noindex` is not a known field.