Log In Sign Up

viralnewsonly.com
robots.txt

Robots Exclusion Standard data for viralnewsonly.com

Resource Scan

Scan Details

Site Domain viralnewsonly.com
Base Domain viralnewsonly.com
Scan Status Ok
Last Scan2026-03-02T00:14:32+00:00
Next Scan 2026-03-09T00:14:32+00:00

Last Scan

Scanned2026-03-02T00:14:32+00:00
URL https://viralnewsonly.com/robots.txt
Redirect https://www.viralnewsonly.com/robots.txt
Redirect Domain www.viralnewsonly.com
Redirect Base viralnewsonly.com
Domain IPs 104.21.77.245, 172.67.213.84, 2606:4700:3033::6815:4df5, 2606:4700:3033::ac43:d554
Redirect IPs 104.21.77.245, 172.67.213.84, 2606:4700:3033::6815:4df5, 2606:4700:3033::ac43:d554
Response IP 172.67.213.84
Found Yes
Hash 5af4283ea8b797ded1903e71202b98b0ad22907e68895874d580634a051234ec
SimHash 307a999083a5

Groups

msnbot

Rule Path
Disallow /*.xml$
Disallow /buzz/*.xml$
Disallow /category/*.xml$
Disallow /mobile/
Disallow *?s=mobile
Disallow *?s=bpage-next
Disallow *?s=lightbox
Disallow /fabordrab/
Disallow /bfmp/
Disallow /buzzfeed/
Disallow /contest
Disallow /contests
Disallow /plugin/
Disallow /embed/
Disallow /_comments/
Disallow /bookmarks/
Disallow /drafts/

Other Records

Field Value
crawl-delay 120

*

Rule Path
Disallow /buzz/*.xml$
Disallow /category/*.xml$
Disallow /mobile/
Disallow *?s=bpage-next
Disallow *?s=lightbox
Disallow *?s=feedpager
Disallow /fabordrab/
Disallow /bfmp/
Disallow /buzzfeed/
Disallow /contest
Disallow /contests
Disallow /_ga/
Disallow /static/
Disallow /dashboard/
Disallow /plugin/
Disallow /api/
Disallow /buzzfeed/api/
Disallow /embed/
Disallow /_comments/
Disallow /bookmarks/
Disallow /drafts/
Disallow /bpage-preview/
Disallow /cms_preview_ui/
Disallow /cms_preview_ui_static/
Disallow /search/

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

googlebot

Rule Path
Disallow /comments-api/
Disallow /content-reactions-api/

gptbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /

perplexity-user

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

ai2bot-dolma

Rule Path
Disallow /

claude-searchbot

Rule Path
Disallow /

claude-user

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

ttoyoubot

Rule Path
Disallow /

webgptbot

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

verity/1.1

Rule Path
Allow /$
Allow /*
Disallow /*.xml$
Disallow /buzz/*.xml$
Disallow /category/*.xml$
Disallow /mobile/
Disallow *?s=mobile
Disallow *?s=bpage-next
Disallow *?s=lightbox
Disallow *?s=feedpager
Disallow /fabordrab/
Disallow /bfmp/
Disallow /buzzfeed/
Disallow /contest
Disallow /contests
Disallow /_ga/
Disallow /static/
Disallow /dashboard/
Disallow /plugin/
Disallow /api/
Disallow /buzzfeed/api/
Disallow /embed/
Disallow /_comments/
Disallow /bookmarks/
Disallow /drafts/
Disallow /bpage-preview/
Disallow /cms_preview_ui/
Disallow /cms_preview_ui_static/
Disallow /search/

Other Records

Field Value
crawl-delay 20

scope3/2.0 (scope3.com)

Rule Path
Allow /$
Allow /*
Disallow /*.xml$
Disallow /buzz/*.xml$
Disallow /category/*.xml$
Disallow /mobile/
Disallow *?s=mobile
Disallow *?s=bpage-next
Disallow *?s=lightbox
Disallow *?s=feedpager
Disallow /fabordrab/
Disallow /bfmp/
Disallow /buzzfeed/
Disallow /contest
Disallow /contests
Disallow /_ga/
Disallow /static/
Disallow /dashboard/
Disallow /plugin/
Disallow /api/
Disallow /buzzfeed/api/
Disallow /embed/
Disallow /_comments/
Disallow /bookmarks/
Disallow /drafts/
Disallow /bpage-preview/
Disallow /cms_preview_ui/
Disallow /cms_preview_ui_static/
Disallow /search/

amazonadbot

Rule Path
Allow /$
Allow /*
Disallow /*.xml$
Disallow /buzz/*.xml$
Disallow /category/*.xml$
Disallow /mobile/
Disallow *?s=mobile
Disallow *?s=bpage-next
Disallow *?s=lightbox
Disallow *?s=feedpager
Disallow /fabordrab/
Disallow /bfmp/
Disallow /buzzfeed/
Disallow /contest
Disallow /contests
Disallow /_ga/
Disallow /static/
Disallow /dashboard/
Disallow /plugin/
Disallow /api/
Disallow /buzzfeed/api/
Disallow /embed/
Disallow /_comments/
Disallow /bookmarks/
Disallow /drafts/
Disallow /bpage-preview/
Disallow /cms_preview_ui/
Disallow /cms_preview_ui_static/
Disallow /search/

yacybot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.viralnewsonly.com/sitemap/buzzfeed.xml
sitemap https://www.viralnewsonly.com/sitemap/tasty.xml
sitemap https://www.viralnewsonly.com/sitemap/video.xml
sitemap https://www.viralnewsonly.com/sitemap/shopping.xml
sitemap https://www.viralnewsonly.com/sitemap/news.xml
sitemap https://www.viralnewsonly.com/sitemap/buzzfeed-community.xml
sitemap https://www.viralnewsonly.com/sitemap/editions.xml
sitemap https://www.viralnewsonly.com/sitemap/news-archive.xml
Back to top