bcgsearch.com
robots.txt
Robots Exclusion Standard data for bcgsearch.com
Resource Scan
Scan Details
Site Domain | bcgsearch.com |
Base Domain | bcgsearch.com |
Scan Status | Ok |
Last Scan | 2025-10-07T20:42:54+00:00 |
Next Scan | 2025-10-21T20:42:54+00:00 |
Last Scan
Scanned | 2025-10-07T20:42:54+00:00 |
URL | https://bcgsearch.com/robots.txt |
Redirect | https://www.bcgsearch.com/robots.txt |
Redirect Domain | www.bcgsearch.com |
Redirect Base | bcgsearch.com |
Domain IPs | 74.120.249.22 |
Redirect IPs | 74.120.249.22 |
Response IP | 74.120.249.22 |
Found | Yes |
Hash | 1f6d6278230722fb2b0fec491851be45e8422147ab0c91167b00706d1c6abe26 |
SimHash | 46d742624ba3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /data_entry |
Disallow | /bcards |
Disallow | /RTA |
Disallow | /includes |
Disallow | /downloads |
Disallow | /soap/ |
Disallow | /pdftemplate |
Disallow | /xajax_js |
Disallow | /admin |
Disallow | /crc/ |
Disallow | /popup-jobemailtocolleague.php |
Disallow | /iframe_headersocialicons.php |
Disallow | /iframe_socialicons.php |
Disallow | /iframe_footer.php |
Disallow | /iframe-searchtext.php |
Disallow | /iframe_footerslogal.php |
Disallow | /sitesearch/ |
Disallow | /utils/track.php |
Disallow | /go.php |
Disallow | /bcg_loadmorejobs.php |
Disallow | /searchresults.php |
Disallow | /bcgceospeaks.php |
Disallow | /bcgblog.php |
Disallow | /m/m/ |
Disallow | /iframe_job_resume_submit.php |
Disallow | /article/download_article_pdf.php |
Disallow | /resume_submit.php |
Disallow | /bcg_candidate_bio.php |
Disallow | /load_guide_report.php |
Disallow | /includes/iframe_most_popular_article.php |
Disallow | /iframe_nw_subscribe.php |
Disallow | /iframe_job_search.php |
Disallow | /iframe_legend.php |
Disallow | /iframe_nwblue_subscribe_right.php |
Disallow | /iframe_legalmarkets.php |
Disallow | /emailpopup.php |
Disallow | /article/printarticle.php |
Disallow | /jobs-printversion.php |
Disallow | /searchresults_rss.php |
Disallow | /article/bcg_loadlegalarticles.php |
Disallow | /savepopuprecord.php |
Disallow | /bcg_candidate_action_employer.php |
Disallow | /*/*/write-review |
Other Records
Field | Value |
---|---|
sitemap | https://www.bcgsearch.com/sitemap/BCGSearch.sitemap.gz |
sitemap | https://www.bcgsearch.com/sitemap/BCGSearch.daily_job_detail_sitemap.gz |
sitemap | https://www.bcgsearch.com//sitemap/BCGSearch.job_detail_sitemap.gz |
sitemap | https://www.bcgsearch.com//sitemap/BCGSearch.lawfirms.sitemap.gz |
sitemap | https://www.bcgsearch.com/video_sitemap.xml |
sitemap | https://www.bcgsearch.com/videosdetail.xml |
sitemap | https://www.bcgsearch.com/podcastsdetail.xml |