referralcodes.com
robots.txt

Robots Exclusion Standard data for referralcodes.com

Resource Scan

Scan Details

Site Domain referralcodes.com
Base Domain referralcodes.com
Scan Status Ok
Last Scan2026-01-27T03:12:04+00:00
Next Scan 2026-02-26T03:12:04+00:00

Last Scan

Scanned2026-01-27T03:12:04+00:00
URL https://referralcodes.com/robots.txt
Domain IPs 104.26.10.136, 104.26.11.136, 172.67.68.150, 2606:4700:20::681a:a88, 2606:4700:20::681a:b88, 2606:4700:20::ac43:4496
Response IP 104.26.11.136
Found Yes
Hash 4f06d7fb4b4b4f8d683328b41ff4853768e1ecedfc9bc63b4cd5b062af7fde8f
SimHash 496488d6ac12

Groups

*

Rule Path
Disallow /*?page=

gptbot

Rule Path
Disallow /
Allow /$
Allow /shop/
Allow /faq
Allow /how-it-works
Allow /e-mail-signature
Allow /quick-start
Allow /recommendations
Allow /testimonials
Allow /partners
Allow /about-us
Allow /moderators
Allow /referral-scheme
Allow /ambassadors
Allow /membership
Allow /invitations
Allow /forums

amazonbot

Rule Path
Disallow /
Allow /$
Allow /shop/
Allow /faq
Allow /how-it-works
Allow /e-mail-signature
Allow /quick-start
Allow /recommendations
Allow /testimonials
Allow /partners
Allow /about-us
Allow /moderators
Allow /referral-scheme
Allow /ambassadors
Allow /membership
Allow /invitations
Allow /forums

Other Records

Field Value
sitemap https://referralcodes.com/sitemap.xml

Comments

  • Specific rules for GPTBot (OpenAI crawler)
  • Same rules for Amazon