bsg.tech
robots.txt
Robots Exclusion Standard data for bsg.tech
Resource Scan
Scan Details
| Site Domain | bsg.tech |
| Base Domain | bsg.tech |
| Scan Status | Ok |
| Last Scan | 2024-05-24T11:12:03+00:00 |
| Next Scan | 2024-06-07T11:12:03+00:00 |
Last Scan
| Scanned | 2024-05-24T11:12:03+00:00 |
| URL | https://bsg.tech/robots.txt |
| Domain IPs | 104.21.30.90, 172.67.172.177, 2606:4700:3030::6815:1e5a, 2606:4700:3033::ac43:acb1 |
| Response IP | 172.67.172.177 |
| Found | Yes |
| Hash | 6151c36dbc38fb68e7dbec819817d9d7f40943b096412799b2d31f8d6e27bcf1 |
| SimHash | cb01d8144590 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /blog/ |
| Allow | /blog/wp-admin/admin-ajax.php |
| Disallow | /privacy-policy-bsg/ |
| Disallow | /terms-and-conditions/ |
| Disallow | /blog/wp-admin/ |
| Disallow | /blog/wp-login.php |
| Disallow | /blog/*/?share=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bsg.tech/blog/sitemap.xml |
| sitemap | https://bsg.tech/blog/sitemap.rss |