specificfeeds.com
robots.txt

Robots Exclusion Standard data for specificfeeds.com

Resource Scan

Scan Details

Site Domain specificfeeds.com
Base Domain specificfeeds.com
Scan Status Ok
Last Scan2024-06-13T20:42:29+00:00
Next Scan 2024-06-20T20:42:29+00:00

Last Scan

Scanned2024-06-13T20:42:29+00:00
URL https://specificfeeds.com/robots.txt
Redirect https://www.specificfeeds.com/robots.txt
Redirect Domain www.specificfeeds.com
Redirect Base specificfeeds.com
Domain IPs 104.21.15.37, 172.67.161.78, 2606:4700:3031::6815:f25, 2606:4700:3035::ac43:a14e
Redirect IPs 104.21.15.37, 172.67.161.78, 2606:4700:3031::6815:f25, 2606:4700:3035::ac43:a14e
Response IP 104.21.15.37
Found Yes
Hash 063e3f3329d8c78684b5dc0191715c21f5908550ede86d7f7b45171b3f76c3c4
SimHash 6555e1d75317

Groups

googlebot

Rule Path
Allow /
Disallow /widget/emailsubscribe/*
Disallow /track-rss-story-click/*
Disallow /bookmarklet
Disallow /quick-unsub/*
Disallow /users/editprofile
Disallow /bookmarks/publisher_widget_setup/
Disallow /statistics/page/*
Disallow /newsearchdirectories/setLanguage
Disallow /users/myaccount
Disallow /feeds/quickfollow
Disallow /feeds/likeshare/*
Disallow /trackstatistics/*

slurp

Rule Path
Allow /

msnbot

Rule Path
Allow /

bingbot

Rule Path
Allow /

teoma

Rule Path
Allow /

adsbot-google

Rule Path
Allow /
Disallow /widget/emailsubscribe/*
Disallow /track-rss-story-click/*
Disallow /bookmarklet
Disallow /quick-unsub/*
Disallow /users/editprofile
Disallow /bookmarks/publisher_widget_setup/
Disallow /statistics/page/*
Disallow /newsearchdirectories/setLanguage
Disallow /users/myaccount
Disallow /feeds/quickfollow
Disallow /feeds/likeshare/*
Disallow /trackstatistics/*

googlebot-news

Rule Path
Allow /
Disallow /widget/emailsubscribe/*
Disallow /track-rss-story-click/*
Disallow /bookmarklet
Disallow /quick-unsub/*
Disallow /users/editprofile
Disallow /bookmarks/publisher_widget_setup/
Disallow /statistics/page/*
Disallow /newsearchdirectories/setLanguage
Disallow /users/myaccount
Disallow /feeds/quickfollow
Disallow /feeds/likeshare/*
Disallow /trackstatistics/*

googlebot-image

Rule Path
Allow /
Disallow /widget/emailsubscribe/*
Disallow /track-rss-story-click/*
Disallow /bookmarklet
Disallow /quick-unsub/*
Disallow /users/editprofile
Disallow /bookmarks/publisher_widget_setup/
Disallow /statistics/page/*
Disallow /newsearchdirectories/setLanguage
Disallow /users/myaccount
Disallow /feeds/quickfollow
Disallow /feeds/likeshare/*
Disallow /trackstatistics/*

googlebot-video

Rule Path
Allow /
Disallow /widget/emailsubscribe/*
Disallow /track-rss-story-click/*
Disallow /bookmarklet
Disallow /quick-unsub/*
Disallow /users/editprofile
Disallow /bookmarks/publisher_widget_setup/
Disallow /statistics/page/*
Disallow /newsearchdirectories/setLanguage
Disallow /users/myaccount
Disallow /feeds/quickfollow
Disallow /feeds/likeshare/*
Disallow /trackstatistics/*

googlebot-mobile

Rule Path
Allow /
Disallow /widget/emailsubscribe/*
Disallow /track-rss-story-click/*
Disallow /bookmarklet
Disallow /quick-unsub/*
Disallow /users/editprofile
Disallow /bookmarks/publisher_widget_setup/
Disallow /statistics/page/*
Disallow /newsearchdirectories/setLanguage
Disallow /users/myaccount
Disallow /feeds/quickfollow
Disallow /feeds/likeshare/*
Disallow /trackstatistics/*

mediapartners-google

Rule Path
Allow /
Disallow /widget/emailsubscribe/*
Disallow /track-rss-story-click/*
Disallow /bookmarklet
Disallow /quick-unsub/*
Disallow /users/editprofile
Disallow /bookmarks/publisher_widget_setup/
Disallow /statistics/page/*
Disallow /newsearchdirectories/setLanguage
Disallow /users/myaccount
Disallow /feeds/quickfollow
Disallow /feeds/likeshare/*
Disallow /trackstatistics/*

hypestat

Rule Path
Disallow /