g2.com
robots.txt
Robots Exclusion Standard data for g2.com
Resource Scan
Scan Details
| Site Domain | g2.com |
| Base Domain | g2.com |
| Scan Status | Ok |
| Last Scan | 2024-11-05T03:01:38+00:00 |
| Next Scan | 2024-11-19T03:01:38+00:00 |
Last Scan
| Scanned | 2024-11-05T03:01:38+00:00 |
| URL | https://g2.com/robots.txt |
| Redirect | https://www.g2.com/robots.txt |
| Redirect Domain | www.g2.com |
| Redirect Base | g2.com |
| Domain IPs | 104.16.186.41, 104.16.187.41, 104.16.188.41, 104.16.189.41, 104.16.190.41, 2606:4700::6810:ba29, 2606:4700::6810:bb29, 2606:4700::6810:bc29, 2606:4700::6810:bd29, 2606:4700::6810:be29 |
| Redirect IPs | 104.16.186.41, 104.16.187.41, 104.16.188.41, 104.16.189.41, 104.16.190.41, 2606:4700::6810:ba29, 2606:4700::6810:bb29, 2606:4700::6810:bc29, 2606:4700::6810:bd29, 2606:4700::6810:be29 |
| Response IP | 104.16.186.41 |
| Found | Yes |
| Hash | c8e2bd8a4afca4116baa1b0cbe7757c13f18225ba34974b7e59c5cf25e98aac9 |
| SimHash | 66d4d6306d45 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?focus_review* |
| Disallow | /*%26focus_review* |
| Disallow | /*?format=pdf* |
| Disallow | /*%26format%3Dpdf* |
| Disallow | /*/*/vote* |
| Disallow | /products/*/take_survey |
| Disallow | /products/*/leads/* |
| Disallow | /ahoy/ |
| Disallow | /auth |
| Disallow | /batch |
| Disallow | /no_contact_leads/* |
| Disallow | /leads/recommendations/* |
| Disallow | /survey_responses/*/comments/* |
| Disallow | /survey_responses/*/details |
| Disallow | /contributor |
| Disallow | /contributor/* |
| Disallow | /contributor* |
| Disallow | /admin |
| Disallow | /concern |
| Disallow | */auth/linkedin |
| Disallow | /comparisons/* |
| Disallow | /authorize |
| Disallow | /users/*/reference_requests |
| Disallow | /g2gives/ |
| Disallow | /gated_content/tokens/* |
| Disallow | /grid_report/documents/* |
| Disallow | /invites/* |
| Disallow | /no_contact_leads/new |
| Disallow | /offers/* |
| Disallow | /offer_requests/new |
| Disallow | /logout |
| Disallow | /products/*/used |
| Disallow | /products/*/follow |
| Disallow | /products/*/free_trial/edit* |
| Disallow | */linkedin_shares/%7B%7Burl%7D%7D* |
| Disallow | /reports |
| Disallow | /search/* |
| Disallow | /static/buyer_research_inquiries |
| Disallow | /users/ |
| Disallow | /compared_products |
| Disallow | /better/* |
| Disallow | /wizard/ |
| Disallow | /quick-stack/* |
| Disallow | /chat |
| Disallow | /used-products |
| Disallow | /assistant$ |
| Disallow | /offers/* |
| Disallow | /*?locale |
| Disallow | /*/*/votes* |
| Disallow | /categories/*/grids* |
| Disallow | /tags/* |
| Disallow | /my-list |
| Disallow | /compare/*-vs-*-vs-* |
| Disallow | /deals/*/offers/*/claim |
| Disallow | /deals/offers/*/claim |
| Disallow | /deals/offers/*/form |
| Disallow | /products/*/claim_requests/* |
| Disallow | /*.rss |
| Disallow | /*scriptPath* |
| Disallow | /cdn-cgi/ |
bingbot
| Rule | Path |
|---|---|
| Disallow | /compare/*-vs-*-vs-* |
| Disallow | /better/* |
| Disallow | /survey_responses/* |
| Disallow | */linkedin_shares/%7B%7Burl%7D%7D* |
| Disallow | /products/*/leads* |
| Disallow | /products/*/reviews?page=* |
| Disallow | /ahoy/ |
| Disallow | /batch |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.g2.com/sitemaps/sitemap_content_test.xml |
| sitemap | https://www.g2.com/sitemaps/sitemap_index.xml.gz |
| sitemap | https://www.g2.com/sitemaps/sitemap_index_compare.xml.gz |