bevnet.com
robots.txt
Robots Exclusion Standard data for bevnet.com
Resource Scan
Scan Details
| Site Domain | bevnet.com |
| Base Domain | bevnet.com |
| Scan Status | Ok |
| Last Scan | 2024-10-31T16:48:07+00:00 |
| Next Scan | 2024-11-30T16:48:07+00:00 |
Last Scan
| Scanned | 2024-10-31T16:48:07+00:00 |
| URL | https://bevnet.com/robots.txt |
| Redirect | https://www.bevnet.com:443/robots.txt |
| Redirect Domain | www.bevnet.com |
| Redirect Base | bevnet.com |
| Domain IPs | 52.22.187.8 |
| Redirect IPs | 52.22.187.8 |
| Response IP | 52.22.187.8 |
| Found | Yes |
| Hash | d7816b970d0ab2aa341a7e3ef913b9cdc3ad61227b18d18db1819bc6d76adfed |
| SimHash | 2e0559c16792 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /forms/ |
| Disallow | /review/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /mvc/ |
| Disallow | /companies/new/featurelisting.aspx |
| Disallow | /companies/new/featurelisting.aspx |
| Disallow | /subscribe/subscription-individual-monthly |
| Allow | /*.js$ |
| Allow | /*.css$ |
semrushbot-sa
semrushbot
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bevnet.com/sitemap_p.xml |
| sitemap | https://www.bevnet.com/sitemap_index.xml |
| sitemap | https://www.bevnet.com/sitemaps/events.xml |
| sitemap | https://www.bevnet.com/sitemaps/jobsmarketplace.xml |
| sitemap | https://www.bevnet.com/sitemaps/supplierfinder.xml |
| sitemap | https://www.bevnet.com/sitemaps/brands.xml |
| sitemap | https://www.bevnet.com/sitemaps/education.xml |
| sitemap | https://www.bevnet.com/sitemaps/photos.xml |
| sitemap | https://www.bevnet.com/sitemaps/pressreleases.xml |
Comments