sitejabber.com
robots.txt
Robots Exclusion Standard data for sitejabber.com
Resource Scan
Scan Details
| Site Domain | sitejabber.com |
| Base Domain | sitejabber.com |
| Scan Status | Ok |
| Last Scan | 2024-11-11T05:07:49+00:00 |
| Next Scan | 2024-11-18T05:07:49+00:00 |
Last Scan
| Scanned | 2024-11-11T05:07:49+00:00 |
| URL | https://sitejabber.com/robots.txt |
| Redirect | https://www.sitejabber.com:443/robots.txt |
| Redirect Domain | www.sitejabber.com |
| Redirect Base | sitejabber.com |
| Domain IPs | 34.192.254.105, 52.72.109.62 |
| Redirect IPs | 34.192.254.105, 52.72.109.62 |
| Response IP | 34.192.254.105 |
| Found | Yes |
| Hash | cd31d1c4828a8b6482012780b0adf1ac8e20dfd36ed8b01ecd4e0bc574d41ca0 |
| SimHash | 09355060b561 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /track-sitejabber-marketing-ads |
| Disallow | /track-sitejabber-modal-ads |
| Disallow | /suggest-categories |
| Disallow | /block-follow-user |
| Disallow | /follow-user |
| Disallow | /unfollow-user |
| Disallow | /forum-check-title |
| Disallow | /forum-post-vote |
| Disallow | /forum-subscribe |
| Disallow | /forum-thread-check-title |
| Disallow | /forum-unsubscribe |
| Disallow | /send-message-window |
| Disallow | /feedback/ |
| Disallow | /get-sitejabber-ads |
| Disallow | /mailing-list-subscribe |
| Disallow | /nofollow |
| Disallow | /register-pageview |
| Disallow | /legitscript-approved-urls |
| Disallow | /rss |
| Disallow | /search-widget |
| Disallow | /hide-all-extension-prompt |
| Disallow | /hide-footer-extension-prompt |
| Disallow | /hide-header-extension-prompt |
| Disallow | /hide-social-extension-prompt |
| Disallow | /check-existing-review |
| Disallow | /check-order-id |
| Disallow | /get-review-comments |
| Disallow | /online-business-review?url=* |
| Disallow | /review-toggle-vote |
| Disallow | /review-votes |
| Disallow | /send-thank-you |
| Disallow | /set-fingerprint |
| Disallow | /share-fb |
| Disallow | /share-review |
| Disallow | /upload-review-photo |
| Disallow | /search?q=* |
| Disallow | /dashboard |
| Disallow | /popup-register |
| Disallow | /registration/ |
| Disallow | /add-question |
| Disallow | /answer-toggle-vote |
| Disallow | /check-phone |
| Disallow | /check-url |
| Disallow | /edit-business |
| Disallow | /get-ad |
| Disallow | /get-page-ad |
| Disallow | /get-page-images |
| Disallow | /load-questions |
| Disallow | /photos |
| Disallow | /products-autocomplete |
| Disallow | /question-autocomplete |
| Disallow | /reviews-xhr |
| Disallow | /share-url |
| Disallow | /test |
| Disallow | /track-lead |
| Disallow | /track-search |
| Disallow | /track-url-suggestion-click |
| Disallow | /track-url-suggestion-view |
| Disallow | /upload-url-answer-photo |
| Disallow | /upload-url-photo |
| Disallow | /urls-review-tab |
| Disallow | /redir-external/ |
| Disallow | /instant-feedback-tab/ |
| Disallow | /users/ |
| Disallow | /block-user |
| Disallow | /check-email |
| Disallow | /check-email-preconditions |
| Disallow | /check-password |
| Disallow | /dismiss-url |
| Disallow | /keep-alive |
| Disallow | /track-click |
| Disallow | /unblock-user |
| Disallow | /upload-photo |
| Disallow | /users-followers-tab |
| Disallow | /users-thank-yous-tab |
| Disallow | /users-votes-tab |
| Disallow | /visit-thank-yous-tab |
| Disallow | /visit-votes-tab |
| Disallow | /post-purchase-demo.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Warnings
- 2 invalid lines.
Comments