hub.biz
robots.txt
Robots Exclusion Standard data for hub.biz
Resource Scan
Scan Details
| Site Domain | hub.biz |
| Base Domain | hub.biz |
| Scan Status | Ok |
| Last Scan | 2024-09-25T14:39:43+00:00 |
| Next Scan | 2024-10-02T14:39:43+00:00 |
Last Scan
| Scanned | 2024-09-25T14:39:43+00:00 |
| URL | https://hub.biz/robots.txt |
| Domain IPs | 71.187.25.175 |
| Response IP | 71.187.25.175 |
| Found | Yes |
| Hash | 18a4c6d386fef0775d86206b2c0669a861b9f3f83d78fb5f4ab9e16223d80973 |
| SimHash | cc19f4e17033 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /selected_businesses |
| Disallow | /businesses |
| Disallow | /recently_viewed |
| Disallow | /users/profiles/sign_in_popup |
| Disallow | /download_qr_code |
| Disallow | /setup_visitor |
| Disallow | /contact |
| Disallow | /a/search |
| Disallow | /activities/ |
| Disallow | /sends/ |
| Disallow | /c/ |
| Disallow | /connect_to_facebook |
| Disallow | /business_registration |
| Disallow | /setup |
| Disallow | /visits.gif |
| Disallow | /feedbacks |
| Disallow | /log_webdriver |
| Disallow | /signin-form |
| Disallow | /users/sign_in |
| Disallow | /users/password |
| Disallow | /users/sign_up |
| Disallow | /temporary_lists |