redeemcodetoday.com
robots.txt

Robots Exclusion Standard data for redeemcodetoday.com

Resource Scan

Scan Details

Site Domain redeemcodetoday.com
Base Domain redeemcodetoday.com
Scan Status Ok
Last Scan2024-09-28T13:09:18+00:00
Next Scan 2024-10-05T13:09:18+00:00

Last Scan

Scanned2024-09-28T13:09:18+00:00
URL https://redeemcodetoday.com/robots.txt
Domain IPs 104.21.7.77, 172.67.135.207, 2606:4700:3035::6815:74d, 2606:4700:3036::ac43:87cf
Response IP 172.67.135.207
Found Yes
Hash 69aa99593e98172da5e03cb57530d1d74323324a956604933f1d4271c275743f
SimHash 3a95c960eae4

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /trackback/
Disallow /feed/
Disallow /cgi-bin/
Disallow /search/*
Disallow /taxonomy/*
Disallow /widgets/
Disallow /tag/*
Disallow /user/*
Disallow /page/*
Disallow /*%26s%3D*
Disallow /*?s=*
Disallow /?s=*

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

yandex

Rule Path
Allow /

bingbot

Rule Path
Allow /

ninjabot

Rule Path
Allow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /
Allow /

Other Records

Field Value
sitemap https://redeemcodetoday.com/sitemap.xml
sitemap https://redeemcodetoday.com/news-sitemap.xml
sitemap https://redeemcodetoday.com/news-sitemap.xml
sitemap https://redeemcodetoday.com/sitemap.xml

Comments

  • Welcome Robots - Redeem Code Today
  • Sitemaps