rappler.com
robots.txt

Robots Exclusion Standard data for rappler.com

Resource Scan

Scan Details

Site Domain rappler.com
Base Domain rappler.com
Scan Status Ok
Last Scan2024-11-10T23:28:24+00:00
Next Scan 2024-11-17T23:28:24+00:00

Last Scan

Scanned2024-11-10T23:28:24+00:00
URL https://rappler.com/robots.txt
Redirect https://www.rappler.com/robots.txt
Redirect Domain www.rappler.com
Redirect Base rappler.com
Domain IPs 52.84.150.44, 52.84.150.47, 52.84.150.48, 52.84.150.55
Redirect IPs 52.84.150.44, 52.84.150.47, 52.84.150.48, 52.84.150.55
Response IP 52.84.150.55
Found Yes
Hash 177407853e6570109d779d126522cb2d4c8142ffed5604d71a287912d898322e
SimHash a14d494482b6

Groups

*

Rule Path
Disallow /?_ptid=*
Disallow /wp-json/rappler/

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.rappler.com/sitemap_index.xml
sitemap https://www.rappler.com/repo/sitemap_index.xml
sitemap https://fma.rappler.com/sitemap_index.xml
sitemap https://youthforceph.rappler.com/sitemap_index.xml
sitemap https://dakila.rappler.com/sitemap_index.xml
sitemap https://ashoka.rappler.com/sitemap_index.xml
sitemap https://btf.rappler.com/sitemap_index.xml
sitemap https://abkd.rappler.com/sitemap_index.xml
sitemap https://scoutmediaph.rappler.com/sitemap_index.xml
sitemap https://lente.rappler.com/sitemap_index.xml
sitemap https://factsfirstph-partners.rappler.com/sitemap_index.xml
sitemap https://baguiochronicle.rappler.com/sitemap_index.xml
sitemap https://nowyouknowph.rappler.com/sitemap_index.xml
sitemap https://kalikasan.rappler.com/sitemap_index.xml
sitemap https://pitikbulag.rappler.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK