blog.nj.com
robots.txt

Robots Exclusion Standard data for blog.nj.com

Resource Scan

Scan Details

Site Domain blog.nj.com
Base Domain nj.com
Scan Status Ok
Last Scan2024-05-10T23:09:19+00:00
Next Scan 2024-05-17T23:09:19+00:00

Last Scan

Scanned2024-05-10T23:09:19+00:00
URL https://blog.nj.com/robots.txt
Redirect https://www.nj.com/robots.txt
Redirect Domain www.nj.com
Redirect Base nj.com
Domain IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133
Redirect IPs 125.56.219.49, 2600:1413:b000:13::b857:c18f, 2600:1413:b000:13::b857:c192, 96.17.72.16
Response IP 42.99.140.194
Found Yes
Hash 076089fcb0f6426dcc5841b195e7fe9fcb84df8c4fd50044a5e95c5a2e23eee3
SimHash 6f316b51e457

Groups

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /home-beta/
Disallow /test/
Disallow /preview/
Disallow /staging/
Disallow /clients/
Disallow /auctions/
Disallow /cgi-bin/
Disallow /printer/
Disallow /*/print.html*
Disallow /*/print.ssf*
Disallow /landingpages/
Disallow /oil-spill-reports/
Disallow /test_team/
Disallow /premium/
Disallow /contests/scrape/
Disallow /APWIRE/
Disallow /WIRE/
Disallow /ad_jump/
Disallow /disk04/
Disallow /mmiller/
Disallow /prototypes/
Disallow /spring/
Disallow /candan/
Disallow /access/
Disallow /njo/
Disallow /dumpbox/
Disallow /redesign/
Disallow /index/
Disallow /images/
Disallow /ads/
Disallow /styleguide/
Disallow /smallbusiness/
Disallow /localproto/
Disallow /njobutton/
Disallow /adverts/
Disallow /fusion/
Disallow /hypernews/
Disallow /internal/
Disallow /Architext/
Disallow /ofa/
Disallow /includes/
Disallow /shine/
Disallow /ros/
Disallow /marketing/
Disallow /ledger-admin/
Disallow /hot/
Disallow /old/
Disallow /coleman/
Disallow /content/
Disallow /realestate/old/
Disallow /realestate/images/
Disallow /realestate/css/
Disallow /news_test/
Disallow /news/jjournal/bayonne/index.ssf?%2Fbase%2Fnews-6%2F127537353187770.xml&amp%3Bcoll=3
Disallow /news/jjournal/bayonne/index.ssf?%2Fbase%2Fnews-6%2F1276152096131710.xml&amp%3Bcoll=3
Disallow /news/index.ssf/2010/07/union_county_college_athletic.html
Disallow /news/index.ssf/2010/07/union_county_college_athletic/1607/comments-newest.html
Disallow /news/index.ssf/2010/07/union_county_college_athletic/1607/comments.html
Disallow /news/jjournal/jerseycity/index.ssf?%2Fbase%2Fnews-12%2F1305268827289271.xml&amp%3Bcoll=3
Disallow /diamond_nation/
Disallow /the_mattress_expert/
Disallow /amboy_bank/
Disallow /north_american_precis_syndicate/
Disallow /stevens_institute_of_technology/
Disallow /shorefire_nj/
Disallow /parenting/public/
Disallow /shore/blogs/party/public/
Disallow /state_theatre/
Disallow /segal_morel/
Disallow /hallmark_homes/
Disallow /gardner_projects/
Disallow /total_hearing_care/
Disallow /puzzles-palace/
Disallow /toprailapp/
Disallow /shopping/
Disallow /*mt-preview-*
Disallow /hudson/2018/02/jersey_city_firefighter_charged_after_woman_says_h.html
Disallow /jjournal-news/2018/02/firefighter_suspended_without_1.html
Disallow /puzzles-games/
Disallow /comics/
Disallow /puzzle-society/
Disallow /go-comics/
Disallow /comics-kingdom/

googlebot

Rule Path
Disallow /home-beta/
Allow /
Allow /*.js*
Disallow /test/
Disallow /preview/
Disallow /staging/
Disallow /clients/
Disallow /auctions/
Disallow /cgi-bin/
Disallow /printer/
Disallow /*/print.html*
Disallow /*/print.ssf*
Disallow /landingpages/
Disallow /oil-spill-reports/
Disallow /test_team/
Disallow /premium/
Disallow /contests/scrape/
Disallow /APWIRE/
Disallow /WIRE/
Disallow /ad_jump/
Disallow /disk04/
Disallow /mmiller/
Disallow /prototypes/
Disallow /spring/
Disallow /candan/
Disallow /access/
Disallow /njo/
Disallow /dumpbox/
Disallow /redesign/
Disallow /index/
Disallow /images/
Disallow /ads/
Disallow /styleguide/
Disallow /smallbusiness/
Disallow /localproto/
Disallow /njobutton/
Disallow /adverts/
Disallow /fusion/
Disallow /hypernews/
Disallow /internal/
Disallow /Architext/
Disallow /ofa/
Disallow /includes/
Disallow /shine/
Disallow /ros/
Disallow /marketing/
Disallow /ledger-admin/
Disallow /hot/
Disallow /old/
Disallow /coleman/
Disallow /content/
Disallow /realestate/old/
Disallow /realestate/images/
Disallow /realestate/css/
Disallow /news_test/
Disallow /news/jjournal/bayonne/index.ssf?%2Fbase%2Fnews-6%2F127537353187770.xml&amp%3Bcoll=3
Disallow /news/jjournal/bayonne/index.ssf?%2Fbase%2Fnews-6%2F1276152096131710.xml&amp%3Bcoll=3
Disallow /news/index.ssf/2010/07/union_county_college_athletic.html
Disallow /news/index.ssf/2010/07/union_county_college_athletic/1607/comments-newest.html
Disallow /news/index.ssf/2010/07/union_county_college_athletic/1607/comments.html
Disallow /news/jjournal/jerseycity/index.ssf?%2Fbase%2Fnews-12%2F1305268827289271.xml&amp%3Bcoll=3
Disallow /diamond_nation/
Disallow /the_mattress_expert/
Disallow /amboy_bank/
Disallow /north_american_precis_syndicate/
Disallow /stevens_institute_of_technology/
Disallow /shorefire_nj/
Disallow /parenting/public/
Disallow /shore/blogs/party/public/
Disallow /state_theatre/
Disallow /segal_morel/
Disallow /hallmark_homes/
Disallow /gardner_projects/
Disallow /total_hearing_care/
Disallow /puzzles-palace/
Disallow /toprailapp/
Disallow /shopping/
Disallow /*mt-preview-*
Disallow /hudson/2018/02/jersey_city_firefighter_charged_after_woman_says_h.html
Disallow /jjournal-news/2018/02/firefighter_suspended_without_1.html
Disallow /puzzles-games/
Disallow /comics/
Disallow /puzzle-society/
Disallow /go-comics/
Disallow /comics-kingdom/

proximic

Rule Path
Disallow /home-beta/
Disallow /test/
Disallow /hudson/2018/02/jersey_city_firefighter_charged_after_woman_says_h.html
Disallow /jjournal-news/2018/02/firefighter_suspended_without_1.html

slurp

Rule Path
Disallow /home-beta/
Disallow /test/
Disallow /preview/
Disallow /staging/
Disallow /clients/
Disallow /auctions/
Disallow /cgi-bin/
Disallow /printer/
Disallow /*/print.html*
Disallow /*/print.ssf*
Disallow /landingpages/
Disallow /oil-spill-reports/
Disallow /test_team/
Disallow /premium/
Disallow /contests/scrape/
Disallow /APWIRE/
Disallow /WIRE/
Disallow /ad_jump/
Disallow /disk04/
Disallow /mmiller/
Disallow /prototypes/
Disallow /spring/
Disallow /candan/
Disallow /access/
Disallow /njo/
Disallow /dumpbox/
Disallow /redesign/
Disallow /index/
Disallow /images/
Disallow /ads/
Disallow /styleguide/
Disallow /smallbusiness/
Disallow /localproto/
Disallow /njobutton/
Disallow /adverts/
Disallow /fusion/
Disallow /hypernews/
Disallow /internal/
Disallow /Architext/
Disallow /ofa/
Disallow /includes/
Disallow /shine/
Disallow /ros/
Disallow /marketing/
Disallow /ledger-admin/
Disallow /hot/
Disallow /old/
Disallow /coleman/
Disallow /content/
Disallow /realestate/old/
Disallow /realestate/images/
Disallow /realestate/css/
Disallow /news_test/
Disallow /news/jjournal/bayonne/index.ssf?%2Fbase%2Fnews-6%2F127537353187770.xml&amp%3Bcoll=3
Disallow /news/jjournal/bayonne/index.ssf?%2Fbase%2Fnews-6%2F1276152096131710.xml&amp%3Bcoll=3
Disallow /news/index.ssf/2010/07/union_county_college_athletic.html
Disallow /news/index.ssf/2010/07/union_county_college_athletic/1607/comments-newest.html
Disallow /news/index.ssf/2010/07/union_county_college_athletic/1607/comments.html
Disallow /news/jjournal/jerseycity/index.ssf?%2Fbase%2Fnews-12%2F1305268827289271.xml&amp%3Bcoll=3
Disallow /diamond_nation/
Disallow /the_mattress_expert/
Disallow /amboy_bank/
Disallow /north_american_precis_syndicate/
Disallow /stevens_institute_of_technology/
Disallow /shorefire_nj/
Disallow /parenting/public/
Disallow /shore/blogs/party/public/
Disallow /state_theatre/
Disallow /segal_morel/
Disallow /hallmark_homes/
Disallow /gardner_projects/
Disallow /total_hearing_care/
Disallow /puzzles-palace/
Disallow /toprailapp/
Disallow /shopping/
Disallow /*mt-preview-*
Disallow /hudson/2018/02/jersey_city_firefighter_charged_after_woman_says_h.html
Disallow /jjournal-news/2018/02/firefighter_suspended_without_1.html
Disallow /puzzles-games/
Disallow /comics/
Disallow /puzzle-society/
Disallow /go-comics/
Disallow /comics-kingdom/

twitterbot

Rule Path
Disallow /home-beta/
Disallow /test/
Disallow /preview/
Disallow /staging/
Disallow /clients/
Disallow /auctions/
Disallow /cgi-bin/
Disallow /printer/
Disallow /*/print.html*
Disallow /*/print.ssf*
Disallow /saints/
Disallow /landingpages/
Disallow /oil-spill-reports/
Disallow /test_team/
Disallow /set-local-edition/
Disallow /premium/
Disallow /contests/scrape/
Disallow /howard-hanna/
Disallow /seniorgames/
Disallow /hn/
Disallow /HyperNews/
Disallow /win/
Disallow /celebrity-news/
Disallow /comics-kingdom/
Disallow /food/dash/
Disallow /puzzles-games/
Disallow /wedding-stories/
Disallow /girlsjustwannahavefun/
Disallow /engagements/
Disallow /weddings/
Disallow /photo-contests/
Disallow /pets/
Disallow /parenting/
Disallow /worldconquest/
Disallow /news/grand-rapids/index.ssf/2010/07/father_still_in_shock_after_so.html
Disallow /business-resource-center/
Disallow /travel-getaways/
Disallow /michigan-deals/
Disallow /grand-rapids-deals/
Disallow /muskegon-deals/
Disallow /kalamazoo-deals/
Disallow /jackson-deals/
Disallow /flint-deals/
Disallow /saginaw-deals/
Disallow /bay-city-deals/
Disallow /APWIRE/
Disallow /WIRE/
Disallow /ad_jump/
Disallow /disk04/
Disallow /mmiller/
Disallow /prototypes/
Disallow /spring/
Disallow /candan/
Disallow /access/
Disallow /njo/
Disallow /dumpbox/
Disallow /redesign/
Disallow /index/
Disallow /images/
Disallow /ads/
Disallow /styleguide/
Disallow /smallbusiness/
Disallow /localproto/
Disallow /njobutton/
Disallow /adverts/
Disallow /fusion/
Disallow /hypernews/
Disallow /internal/
Disallow /Architext/
Disallow /ofa/
Disallow /includes/
Disallow /shine/
Disallow /ros/
Disallow /marketing/
Disallow /ledger-admin/
Disallow /hot/
Disallow /old/
Disallow /coleman/
Disallow /content/
Disallow /realestate/old/
Disallow /realestate/images/
Disallow /realestate/css/
Disallow /news_test/
Disallow /news/jjournal/bayonne/index.ssf?%2Fbase%2Fnews-6%2F127537353187770.xml&amp%3Bcoll=3
Disallow /news/jjournal/bayonne/index.ssf?%2Fbase%2Fnews-6%2F1276152096131710.xml&amp%3Bcoll=3
Disallow /news/index.ssf/2010/07/union_county_college_athletic.html
Disallow /news/index.ssf/2010/07/union_county_college_athletic/1607/comments-newest.html
Disallow /news/index.ssf/2010/07/union_county_college_athletic/1607/comments.html
Disallow /news/jjournal/jerseycity/index.ssf?%2Fbase%2Fnews-12%2F1305268827289271.xml&amp%3Bcoll=3
Disallow /diamond_nation/
Disallow /the_mattress_expert/
Disallow /amboy_bank/
Disallow /north_american_precis_syndicate/
Disallow /stevens_institute_of_technology/
Disallow /shorefire_nj/
Disallow /parenting/public/
Disallow /shore/blogs/party/public/
Disallow /state_theatre/
Disallow /segal_morel/
Disallow /hallmark_homes/
Disallow /gardner_projects/
Disallow /total_hearing_care/
Disallow /politics/index.ssf/2010/01/nova_scotia_property_attracted.html
Disallow /politics/index.ssf/2010/01/post_247.html
Disallow /mystorm/
Disallow /tv/index.ssf/2010/10/lucy_bustamante_departs_wwl-tv.html
Disallow /tv/index.ssf/2010/09/wwls_lucy_bustamante_set_to_mo.html
Disallow /tv/index.ssf/2012/09/hurricane_isaac_re-teams_lucy.html
Disallow /news/index.ssf/2008/03/morial_associate_charged_with.html
Disallow /crime/index.ssf/2008/03/morial_associate_charged_with.html
Disallow /dhtml/
Disallow /oregonian-test/
Disallow /opinion/index.ssf/2011/01/bring_osu_to_portland_educatio.html
Disallow /mattress/
Disallow /prudential/
Disallow /mid-penn-awnings/
Disallow /us-politics/
Disallow /living/dash/
Disallow /letters/
Disallow /news/advance/index.ssf?%2Fbase%2Fnews%2F1176538514249150.xml&amp%3Bcoll=1
Disallow /news/advance/index.ssf?%2Fbase%2Fnews%2F117681121166360.xml&amp%3Bcoll=1
Disallow /westshore/index.ssf/2009/02/staten_island_psychic_reaches.html
Disallow /northshore/index.ssf/2010/09/jury_still_out_on_new_forest_a.html
Disallow /puzzles-palace/
Disallow /pacific-northwest-news/index.ssf/2010/10/woodburn_police_ask_for_help_in_locating_two_runaway_teens.html
Disallow /silive_sandbox_blog_-_azywusko
Disallow /plain_dealer_syndication/
Disallow /plain-dealer-stories/
Disallow /restaurants.oregonlive.com
Disallow /restaurants.oregonlive.com
Disallow /toprailapp/
Disallow /shopping/
Disallow /*mt-preview-*
Disallow /hudson/2018/02/jersey_city_firefighter_charged_after_woman_says_h.html
Disallow /jjournal-news/2018/02/firefighter_suspended_without_1.html
Disallow /puzzles-games/
Disallow /comics/
Disallow /puzzle-society/
Disallow /go-comics/
Disallow /comics-kingdom/

*

Rule Path
Disallow /digitalsubscription/imagedownload/

Other Records

Field Value
sitemap https://www.nj.com/arc/outboundfeeds/rss-latest/?outputType=xml
sitemap https://www.nj.com/arc/outboundfeeds/sitemap-index/?outputType=xml
sitemap https://www.nj.com/arc/outboundfeeds/news-sitemap-index/?outputType=xml
sitemap https://www.nj.com/sitemap2.xml
sitemap https://www.nj.com/personal-finance/sitemap.xml
sitemap https://www.nj.com/guides/sitemap.xml