shine.com
robots.txt
Robots Exclusion Standard data for shine.com
Resource Scan
Scan Details
| Site Domain | shine.com |
| Base Domain | shine.com |
| Scan Status | Ok |
| Last Scan | 2024-05-03T14:07:02+00:00 |
| Next Scan | 2024-05-10T14:07:02+00:00 |
Last Scan
| Scanned | 2024-05-03T14:07:02+00:00 |
| URL | https://shine.com/robots.txt |
| Redirect | https://www.shine.com/robots.txt |
| Redirect Domain | www.shine.com |
| Redirect Base | shine.com |
| Domain IPs | 23.52.113.224, 2600:1413:b000:396::1833, 2600:1413:b000:39c::1833 |
| Redirect IPs | 23.52.113.224, 2600:1413:b000:396::1833, 2600:1413:b000:39c::1833 |
| Response IP | 23.54.58.39 |
| Found | Yes |
| Hash | d812b2167bfd48b881cfdd6bb74e54a6f4b65c2d2a2913338db5e73fbbd0ff22 |
| SimHash | 4001191ecef2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /myshine/ |
| Allow | /myshine/login/ |
| Disallow | /*?type=amp |
| Disallow | /*/disclaimer |
| Disallow | /jobs/jobs/ |
| Disallow | /job-search/simple/ |
| Disallow | /course/* |
| Disallow | /jobs/1* |
| Disallow | /jobs/9* |
| Disallow | /%5B%27blog/* |
| Disallow | /api/v2/search/search-tracking/ |
| Disallow | /api/v2/learning-touchpoints-tracking/ |
| Disallow | /api/v2/* |
| Disallow | /job-search/*?jd_cname=* |
| Disallow | /job-search/similar/?jobid=* |
| Disallow | /*?rect=* |
| Disallow | /1198510/ |
| Disallow | /*?*vendorid=* |
| Disallow | /featuredcompanystats/ |
| Disallow | /lookup/ |
| Disallow | /job-search/similar/ |
| Disallow | /unsubscribe/ |
| Disallow | */?akamai_redirect=1* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.shine.com/index-all-sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/browsejob_sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/browsejobjsrp_company_sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/company_sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/company_1_sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/company_2_sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/company_3_sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/company_4_sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/company_5_sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/company_6_sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/company_7_sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/industry_sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/location_sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/skill_sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/skill_1_sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/skill_2_sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/skill_3_sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/title_sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/title_1_sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/blog_sitemap.xml |
| sitemap | https://www.shine.com/sitemaps/topjsrp_sitemap.xml |