bgeneral.com
robots.txt
Robots Exclusion Standard data for bgeneral.com
Resource Scan
Scan Details
| Site Domain | bgeneral.com |
| Base Domain | bgeneral.com |
| Scan Status | Ok |
| Last Scan | 2025-05-15T07:48:42+00:00 |
| Next Scan | 2025-06-14T07:48:42+00:00 |
Last Scan
| Scanned | 2025-05-15T07:48:42+00:00 |
| URL | https://www.bgeneral.com/robots.txt |
| Domain IPs | 107.162.157.141 |
| Response IP | 107.162.157.141 |
| Found | Yes |
| Hash | fe5a7ff323836fc244243dcb38ba5aaa44832769ac85c77625fe8d675ec93d16 |
| SimHash | 6c48df1216fd |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-content/ |
| Disallow | /wp-includes/ |
| Disallow | /comment-page- |
| Disallow | /trackback/ |
| Disallow | /xmlrpc.php |
| Disallow | /portal-inmobiliario/* |
*
| Rule | Path |
|---|---|
| Allow | /wp-content/uploads/ |
| Allow | /feed/$ |
| Disallow | /clasificados/* |
| Disallow | /view/*/entry/* |
| Disallow | /*/entry/* |
| Disallow | /wp- |
| Disallow | /wp-content/ |
| Disallow | /trackback/ |
| Disallow | /wp-admin/ |
| Disallow | /feed/ |
| Disallow | /?s= |
| Disallow | /search |
| Disallow | /archives/ |
| Disallow | /index.php |
| Disallow | /*? |
| Disallow | /*.php$ |
| Disallow | /*.js$ |
| Disallow | /*.inc$ |
| Disallow | /*.gz$ |
| Disallow | /*.wmv$ |
| Disallow | /*.cgi$ |
| Disallow | /*.xhtml$ |
| Disallow | /*.css$ |
| Disallow | */feed/ |
| Disallow | */trackback/ |
| Disallow | /page/ |
| Disallow | /tag/ |
| Disallow | /category/ |
| Disallow | /cgi-bin |
| Disallow | /wp-includes/ |
| Disallow | /search/*/feed |
| Disallow | /readme.html |
| Disallow | /license.txt |
| Disallow | /*.pdf$ |
| Disallow | /*.doc$ |
| Disallow | /*.docx$ |
| Disallow | /*.xls$ |
| Disallow | /*.xlsx$ |
| Disallow | /*.ppt$ |
| Disallow | /*.pptx$ |
| Disallow | /*.zip$ |
| Disallow | /*.rar$ |
| Disallow | /*.exe$ |
*
| Rule | Path |
|---|---|
| Disallow | /wp-content/uploads/wp-import-export-lite/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bgeneral.com/page-sitemap.xml |
| sitemap | https://www.bgeneral.com/attachment-sitemap.xml |
| sitemap | https://www.bgeneral.com/product-sitemap.xml |
| sitemap | https://www.bgeneral.com/category-sitemap.xml |
| sitemap | https://www.bgeneral.com/product_cat-sitemap.xml |
| sitemap | https://www.bgeneral.com/portfolio_category-sitemap.xml |
Comments