oregonlive.com
robots.txt
Robots Exclusion Standard data for oregonlive.com
Resource Scan
Scan Details
| Site Domain | oregonlive.com |
| Base Domain | oregonlive.com |
| Scan Status | Ok |
| Last Scan | 2024-05-11T02:10:47+00:00 |
| Next Scan | 2024-05-18T02:10:47+00:00 |
Last Scan
| Scanned | 2024-05-11T02:10:47+00:00 |
| URL | https://oregonlive.com/robots.txt |
| Redirect | https://www.oregonlive.com:443/robots.txt |
| Redirect Domain | www.oregonlive.com |
| Redirect Base | oregonlive.com |
| Domain IPs | 75.2.53.215, 99.83.138.34 |
| Redirect IPs | 173.222.148.48, 23.49.60.42, 2600:1413:b000:14::b857:c147, 2600:1413:b000:14::b857:c160 |
| Response IP | 42.99.140.194 |
| Found | Yes |
| Hash | 64fcf5ed9c08369853726f6d50e26afe1f4523877e644dc2c8f841e7f943036e |
| SimHash | 53b74a618724 |
Groups
bingbot
| Rule | Path |
|---|---|
| Disallow | /home-beta/ |
| Disallow | /test/ |
| Disallow | /preview/ |
| Disallow | /staging/ |
| Disallow | /clients/ |
| Disallow | /auctions/ |
| Disallow | /cgi-bin/ |
| Disallow | /printer/ |
| Disallow | /*/print.html* |
| Disallow | /*/print.ssf* |
| Disallow | /landingpages/ |
| Disallow | /oil-spill-reports/ |
| Disallow | /premium/ |
| Disallow | /contests/scrape/ |
| Disallow | /dhtml/ |
| Disallow | /oregonian-test/ |
| Disallow | /opinion/index.ssf/2011/01/bring_osu_to_portland_educatio.html |
| Disallow | /puzzles-palace/ |
| Disallow | /pacific-northwest-news/index.ssf/2010/10/woodburn_police_ask_for_help_in_locating_two_runaway_teens.html |
| Disallow | /toprailapp/ |
| Disallow | /newsletters/thank_you.html |
| Disallow | /*mt-preview-* |
| Disallow | /portland/2016/12/who_is_portlands_mysterious_li.html |
| Disallow | /today/2013/07/school_official_blames_sleepin.html |
| Disallow | /opinion/2018/06/when_fathers_day_cards_dont_qu.html |
| Disallow | /beaverton/2010/11/recapping_the_states_case_in_the_beaverton_murder_trial.html |
| Disallow | /portland/2011/01/portland_woman_upset_by_attack.html |
| Disallow | /crime/2020/11/new-mexico-man-who-drove-back-and-forth-past-home-of-ex-wife-in-portland-after-making-online-threats-found-guilty-of-stalking-and-cyberstalking.html |
| Disallow | /clackamascounty/2012/04/former_clackamas_county_sherif_1.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ac.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ar.html |
googlebot
| Rule | Path |
|---|---|
| Disallow | /home-beta/ |
| Disallow | /test/ |
| Disallow | /preview/ |
| Disallow | /staging/ |
| Disallow | /clients/ |
| Disallow | /auctions/ |
| Disallow | /cgi-bin/ |
| Disallow | /printer/ |
| Disallow | /*/print.html* |
| Disallow | /*/print.ssf* |
| Disallow | /landingpages/ |
| Disallow | /oil-spill-reports/ |
| Disallow | /premium/ |
| Disallow | /contests/scrape/ |
| Disallow | /dhtml/ |
| Disallow | /oregonian-test/ |
| Disallow | /opinion/index.ssf/2011/01/bring_osu_to_portland_educatio.html |
| Disallow | /puzzles-palace/ |
| Disallow | /pacific-northwest-news/index.ssf/2010/10/woodburn_police_ask_for_help_in_locating_two_runaway_teens.html |
| Disallow | /toprailapp/ |
| Disallow | /closures/index.ssf?other |
| Disallow | /closures/*.ssf?* |
| Disallow | /newsletters/thank_you.html |
| Disallow | /*mt-preview-* |
| Disallow | /portland/2016/12/who_is_portlands_mysterious_li.html |
| Disallow | /today/2013/07/school_official_blames_sleepin.html |
| Disallow | /opinion/2018/06/when_fathers_day_cards_dont_qu.html |
| Disallow | /beaverton/2010/11/recapping_the_states_case_in_the_beaverton_murder_trial.html |
| Disallow | /portland/2011/01/portland_woman_upset_by_attack.html |
| Disallow | /crime/2020/11/new-mexico-man-who-drove-back-and-forth-past-home-of-ex-wife-in-portland-after-making-online-threats-found-guilty-of-stalking-and-cyberstalking.html |
| Disallow | /clackamascounty/2012/04/former_clackamas_county_sherif_1.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ac.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ar.html |
ia_archiver
| Rule | Path |
|---|---|
| Disallow | /home-beta/ |
| Disallow | /test/ |
| Disallow | /preview/ |
| Disallow | /staging/ |
| Disallow | /clients/ |
| Disallow | /auctions/ |
| Disallow | /cgi-bin/ |
| Disallow | /printer/ |
| Disallow | /*/print.html* |
| Disallow | /*/print.ssf* |
| Disallow | /landingpages/ |
| Disallow | /oil-spill-reports/ |
| Disallow | /premium/ |
| Disallow | /contests/scrape/ |
| Disallow | /dhtml/ |
| Disallow | /oregonian-test/ |
| Disallow | /opinion/index.ssf/2011/01/bring_osu_to_portland_educatio.html |
| Disallow | /puzzles-palace/ |
| Disallow | /pacific-northwest-news/index.ssf/2010/10/woodburn_police_ask_for_help_in_locating_two_runaway_teens.html |
| Disallow | /toprailapp/ |
| Disallow | /closures/index.ssf?other |
| Disallow | /closures/*.ssf?* |
| Disallow | /newsletters/thank_you.html |
| Disallow | /*mt-preview-* |
| Disallow | /portland/2016/12/who_is_portlands_mysterious_li.html |
| Disallow | /today/2013/07/school_official_blames_sleepin.html |
| Disallow | /opinion/2018/06/when_fathers_day_cards_dont_qu.html |
| Disallow | /beaverton/2010/11/recapping_the_states_case_in_the_beaverton_murder_trial.html |
| Disallow | /crime/2020/11/new-mexico-man-who-drove-back-and-forth-past-home-of-ex-wife-in-portland-after-making-online-threats-found-guilty-of-stalking-and-cyberstalking.html |
| Disallow | /clackamascounty/2012/04/former_clackamas_county_sherif_1.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ac.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ar.html |
proximic
| Rule | Path |
|---|---|
| Disallow | /home-beta/ |
| Disallow | /test/ |
| Disallow | /portland/2016/12/who_is_portlands_mysterious_li.html |
| Disallow | /opinion/2018/06/when_fathers_day_cards_dont_qu.html |
| Disallow | /beaverton/2010/11/recapping_the_states_case_in_the_beaverton_murder_trial.html |
slurp
| Rule | Path |
|---|---|
| Disallow | /home-beta/ |
| Disallow | /test/ |
| Disallow | /preview/ |
| Disallow | /staging/ |
| Disallow | /clients/ |
| Disallow | /auctions/ |
| Disallow | /cgi-bin/ |
| Disallow | /printer/ |
| Disallow | /*/print.html* |
| Disallow | /*/print.ssf* |
| Disallow | /landingpages/ |
| Disallow | /oil-spill-reports/ |
| Disallow | /premium/ |
| Disallow | /contests/scrape/ |
| Disallow | /dhtml/ |
| Disallow | /oregonian-test/ |
| Disallow | /opinion/index.ssf/2011/01/bring_osu_to_portland_educatio.html |
| Disallow | /puzzles-palace/ |
| Disallow | /pacific-northwest-news/index.ssf/2010/10/woodburn_police_ask_for_help_in_locating_two_runaway_teens.html |
| Disallow | /toprailapp/ |
| Disallow | /newsletters/thank_you.html |
| Disallow | /*mt-preview-* |
| Disallow | /portland/2016/12/who_is_portlands_mysterious_li.html |
| Disallow | /today/2013/07/school_official_blames_sleepin.html |
| Disallow | /opinion/2018/06/when_fathers_day_cards_dont_qu.html |
| Disallow | /beaverton/2010/11/recapping_the_states_case_in_the_beaverton_murder_trial.html |
| Disallow | /portland/2011/01/portland_woman_upset_by_attack.html |
| Disallow | /crime/2020/11/new-mexico-man-who-drove-back-and-forth-past-home-of-ex-wife-in-portland-after-making-online-threats-found-guilty-of-stalking-and-cyberstalking.html |
| Disallow | /clackamascounty/2012/04/former_clackamas_county_sherif_1.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ac.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ar.html |
twitterbot
| Rule | Path |
|---|---|
| Disallow | /home-beta/ |
| Disallow | /test/ |
| Disallow | /preview/ |
| Disallow | /staging/ |
| Disallow | /clients/ |
| Disallow | /auctions/ |
| Disallow | /cgi-bin/ |
| Disallow | /printer/ |
| Disallow | /*/print.html* |
| Disallow | /*/print.ssf* |
| Disallow | /landingpages/ |
| Disallow | /oil-spill-reports/ |
| Disallow | /premium/ |
| Disallow | /contests/scrape/ |
| Disallow | /dhtml/ |
| Disallow | /oregonian-test/ |
| Disallow | /opinion/index.ssf/2011/01/bring_osu_to_portland_educatio.html |
| Disallow | /puzzles-palace/ |
| Disallow | /pacific-northwest-news/index.ssf/2010/10/woodburn_police_ask_for_help_in_locating_two_runaway_teens.html |
| Disallow | /toprailapp/ |
| Disallow | /newsletters/thank_you.html |
| Disallow | /*mt-preview-* |
| Disallow | /portland/2016/12/who_is_portlands_mysterious_li.html |
| Disallow | /today/2013/07/school_official_blames_sleepin.html |
| Disallow | /opinion/2018/06/when_fathers_day_cards_dont_qu.html |
| Disallow | /beaverton/2010/11/recapping_the_states_case_in_the_beaverton_murder_trial.html |
| Disallow | /crime/2020/11/new-mexico-man-who-drove-back-and-forth-past-home-of-ex-wife-in-portland-after-making-online-threats-found-guilty-of-stalking-and-cyberstalking.html |
| Disallow | /clackamascounty/2012/04/former_clackamas_county_sherif_1.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ac.html |
| Disallow | /portland/2017/01/lincoln_high_school_student_ar.html |
*
| Rule | Path |
|---|---|
| Disallow | /digitalsubscription/imagedownload/ |
*
| Rule | Path |
|---|---|
| Disallow | /for-you-parsely/ |
| Disallow | /for-you-blueconic/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.oregonlive.com/arc/outboundfeeds/rss-latest/?outputType=xml |
| sitemap | https://www.oregonlive.com/arc/outboundfeeds/sitemap-index/?outputType=xml |
| sitemap | https://www.oregonlive.com/arc/outboundfeeds/news-sitemap-index/?outputType=xml |
| sitemap | https://www.oregonlive.com/recommendations/sitemap.xml |