topics.oregonlive.com
robots.txt
Robots Exclusion Standard data for topics.oregonlive.com
Resource Scan
Scan Details
| Site Domain | topics.oregonlive.com |
| Base Domain | oregonlive.com |
| Scan Status | Ok |
| Last Scan | 2024-11-08T08:26:58+00:00 |
| Next Scan | 2024-11-15T08:26:58+00:00 |
Last Scan
| Scanned | 2024-11-08T08:26:58+00:00 |
| URL | https://topics.oregonlive.com/robots.txt |
| Redirect | https://www.oregonlive.com/robots.txt |
| Redirect Domain | www.oregonlive.com |
| Redirect Base | oregonlive.com |
| Domain IPs | 23.209.46.70, 23.209.46.75, 2600:1413:b000:13::b857:c192, 2600:1413:b000:13::b857:c194 |
| Redirect IPs | 184.87.193.77, 184.87.193.86, 2600:1413:b000:13::b857:c192, 2600:1413:b000:13::b857:c194 |
| Response IP | 23.45.207.168 |
| Found | Yes |
| Hash | d35de1a0b51195faf7256b409815aa969008b09f6c5641e920de79feafebf2e3 |
| SimHash | 71b74b418764 |
Groups
bingbot
| Rule | Path |
|---|---|
| Disallow | /home-beta/ |
| Disallow | /test/ |
| Disallow | /preview/ |
| Disallow | /staging/ |
| Disallow | /clients/ |
| Disallow | /auctions/ |
| Disallow | /cgi-bin/ |
| Disallow | /printer/ |
| Disallow | /*/print.html* |
| Disallow | /*/print.ssf* |
| Disallow | /landingpages/ |
| Disallow | /oil-spill-reports/ |
| Disallow | /premium/ |
| Disallow | /contests/scrape/ |
| Disallow | /dhtml/ |
| Disallow | /oregonian-test/ |
| Disallow | /opinion/index.ssf/2011/01/bring_osu_to_portland_educatio.html |
| Disallow | /puzzles-palace/ |
| Disallow | /pacific-northwest-news/index.ssf/2010/10/woodburn_police_ask_for_help_in_locating_two_runaway_teens.html |
| Disallow | /toprailapp/ |
| Disallow | /newsletters/thank_you.html |
| Disallow | /*mt-preview-* |
| Disallow | /portland/2016/12/who_is_portlands_mysterious_li.html |
| Disallow | /today/2013/07/school_official_blames_sleepin.html |
| Disallow | /opinion/2018/06/when_fathers_day_cards_dont_qu.html |
| Disallow | /beaverton/2010/11/recapping_the_states_case_in_the_beaverton_murder_trial.html |
| Disallow | /portland/2011/01/portland_woman_upset_by_attack.html |
| Disallow | /crime/2020/11/new-mexico-man-who-drove-back-and-forth-past-home-of-ex-wife-in-portland-after-making-online-threats-found-guilty-of-stalking-and-cyberstalking.html |
| Disallow | /clackamascounty/2012/04/former_clackamas_county_sherif_1.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ac.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ar.html |
googlebot
| Rule | Path |
|---|---|
| Disallow | /home-beta/ |
| Disallow | /test/ |
| Disallow | /preview/ |
| Disallow | /staging/ |
| Disallow | /clients/ |
| Disallow | /auctions/ |
| Disallow | /cgi-bin/ |
| Disallow | /printer/ |
| Disallow | /*/print.html* |
| Disallow | /*/print.ssf* |
| Disallow | /landingpages/ |
| Disallow | /oil-spill-reports/ |
| Disallow | /premium/ |
| Disallow | /contests/scrape/ |
| Disallow | /dhtml/ |
| Disallow | /oregonian-test/ |
| Disallow | /opinion/index.ssf/2011/01/bring_osu_to_portland_educatio.html |
| Disallow | /puzzles-palace/ |
| Disallow | /pacific-northwest-news/index.ssf/2010/10/woodburn_police_ask_for_help_in_locating_two_runaway_teens.html |
| Disallow | /toprailapp/ |
| Disallow | /closures/index.ssf?other |
| Disallow | /closures/*.ssf?* |
| Disallow | /newsletters/thank_you.html |
| Disallow | /*mt-preview-* |
| Disallow | /portland/2016/12/who_is_portlands_mysterious_li.html |
| Disallow | /today/2013/07/school_official_blames_sleepin.html |
| Disallow | /opinion/2018/06/when_fathers_day_cards_dont_qu.html |
| Disallow | /beaverton/2010/11/recapping_the_states_case_in_the_beaverton_murder_trial.html |
| Disallow | /portland/2011/01/portland_woman_upset_by_attack.html |
| Disallow | /crime/2020/11/new-mexico-man-who-drove-back-and-forth-past-home-of-ex-wife-in-portland-after-making-online-threats-found-guilty-of-stalking-and-cyberstalking.html |
| Disallow | /clackamascounty/2012/04/former_clackamas_county_sherif_1.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ac.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ar.html |
ia_archiver
| Rule | Path |
|---|---|
| Disallow | /home-beta/ |
| Disallow | /test/ |
| Disallow | /preview/ |
| Disallow | /staging/ |
| Disallow | /clients/ |
| Disallow | /auctions/ |
| Disallow | /cgi-bin/ |
| Disallow | /printer/ |
| Disallow | /*/print.html* |
| Disallow | /*/print.ssf* |
| Disallow | /landingpages/ |
| Disallow | /oil-spill-reports/ |
| Disallow | /premium/ |
| Disallow | /contests/scrape/ |
| Disallow | /dhtml/ |
| Disallow | /oregonian-test/ |
| Disallow | /opinion/index.ssf/2011/01/bring_osu_to_portland_educatio.html |
| Disallow | /puzzles-palace/ |
| Disallow | /pacific-northwest-news/index.ssf/2010/10/woodburn_police_ask_for_help_in_locating_two_runaway_teens.html |
| Disallow | /toprailapp/ |
| Disallow | /closures/index.ssf?other |
| Disallow | /closures/*.ssf?* |
| Disallow | /newsletters/thank_you.html |
| Disallow | /*mt-preview-* |
| Disallow | /portland/2016/12/who_is_portlands_mysterious_li.html |
| Disallow | /today/2013/07/school_official_blames_sleepin.html |
| Disallow | /opinion/2018/06/when_fathers_day_cards_dont_qu.html |
| Disallow | /beaverton/2010/11/recapping_the_states_case_in_the_beaverton_murder_trial.html |
| Disallow | /crime/2020/11/new-mexico-man-who-drove-back-and-forth-past-home-of-ex-wife-in-portland-after-making-online-threats-found-guilty-of-stalking-and-cyberstalking.html |
| Disallow | /clackamascounty/2012/04/former_clackamas_county_sherif_1.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ac.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ar.html |
proximic
| Rule | Path |
|---|---|
| Disallow | /home-beta/ |
| Disallow | /test/ |
| Disallow | /portland/2016/12/who_is_portlands_mysterious_li.html |
| Disallow | /opinion/2018/06/when_fathers_day_cards_dont_qu.html |
| Disallow | /beaverton/2010/11/recapping_the_states_case_in_the_beaverton_murder_trial.html |
slurp
| Rule | Path |
|---|---|
| Disallow | /home-beta/ |
| Disallow | /test/ |
| Disallow | /preview/ |
| Disallow | /staging/ |
| Disallow | /clients/ |
| Disallow | /auctions/ |
| Disallow | /cgi-bin/ |
| Disallow | /printer/ |
| Disallow | /*/print.html* |
| Disallow | /*/print.ssf* |
| Disallow | /landingpages/ |
| Disallow | /oil-spill-reports/ |
| Disallow | /premium/ |
| Disallow | /contests/scrape/ |
| Disallow | /dhtml/ |
| Disallow | /oregonian-test/ |
| Disallow | /opinion/index.ssf/2011/01/bring_osu_to_portland_educatio.html |
| Disallow | /puzzles-palace/ |
| Disallow | /pacific-northwest-news/index.ssf/2010/10/woodburn_police_ask_for_help_in_locating_two_runaway_teens.html |
| Disallow | /toprailapp/ |
| Disallow | /newsletters/thank_you.html |
| Disallow | /*mt-preview-* |
| Disallow | /portland/2016/12/who_is_portlands_mysterious_li.html |
| Disallow | /today/2013/07/school_official_blames_sleepin.html |
| Disallow | /opinion/2018/06/when_fathers_day_cards_dont_qu.html |
| Disallow | /beaverton/2010/11/recapping_the_states_case_in_the_beaverton_murder_trial.html |
| Disallow | /portland/2011/01/portland_woman_upset_by_attack.html |
| Disallow | /crime/2020/11/new-mexico-man-who-drove-back-and-forth-past-home-of-ex-wife-in-portland-after-making-online-threats-found-guilty-of-stalking-and-cyberstalking.html |
| Disallow | /clackamascounty/2012/04/former_clackamas_county_sherif_1.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ac.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ar.html |
twitterbot
| Rule | Path |
|---|---|
| Disallow | /home-beta/ |
| Disallow | /test/ |
| Disallow | /preview/ |
| Disallow | /staging/ |
| Disallow | /clients/ |
| Disallow | /auctions/ |
| Disallow | /cgi-bin/ |
| Disallow | /printer/ |
| Disallow | /*/print.html* |
| Disallow | /*/print.ssf* |
| Disallow | /landingpages/ |
| Disallow | /oil-spill-reports/ |
| Disallow | /premium/ |
| Disallow | /contests/scrape/ |
| Disallow | /dhtml/ |
| Disallow | /oregonian-test/ |
| Disallow | /opinion/index.ssf/2011/01/bring_osu_to_portland_educatio.html |
| Disallow | /puzzles-palace/ |
| Disallow | /pacific-northwest-news/index.ssf/2010/10/woodburn_police_ask_for_help_in_locating_two_runaway_teens.html |
| Disallow | /toprailapp/ |
| Disallow | /newsletters/thank_you.html |
| Disallow | /*mt-preview-* |
| Disallow | /portland/2016/12/who_is_portlands_mysterious_li.html |
| Disallow | /today/2013/07/school_official_blames_sleepin.html |
| Disallow | /opinion/2018/06/when_fathers_day_cards_dont_qu.html |
| Disallow | /beaverton/2010/11/recapping_the_states_case_in_the_beaverton_murder_trial.html |
| Disallow | /crime/2020/11/new-mexico-man-who-drove-back-and-forth-past-home-of-ex-wife-in-portland-after-making-online-threats-found-guilty-of-stalking-and-cyberstalking.html |
| Disallow | /clackamascounty/2012/04/former_clackamas_county_sherif_1.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ac.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ar.html |
*
| Rule | Path |
|---|---|
| Disallow | /digitalsubscription/imagedownload/ |
*
| Rule | Path |
|---|---|
| Disallow | /for-you-parsely/ |
| Disallow | /for-you-blueconic/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.oregonlive.com/arc/outboundfeeds/rss-latest/?outputType=xml |
| sitemap | https://www.oregonlive.com/arc/outboundfeeds/sitemap-index/?outputType=xml |
| sitemap | https://www.oregonlive.com/arc/outboundfeeds/news-sitemap-index/?outputType=xml |
| sitemap | https://www.oregonlive.com/recommendations/sitemap.xml |