similarworlds.com
robots.txt
Robots Exclusion Standard data for similarworlds.com
Resource Scan
Scan Details
| Site Domain | similarworlds.com |
| Base Domain | similarworlds.com |
| Scan Status | Ok |
| Last Scan | 2024-09-26T16:15:40+00:00 |
| Next Scan | 2024-10-03T16:15:40+00:00 |
Last Scan
| Scanned | 2024-09-26T16:15:40+00:00 |
| URL | https://similarworlds.com/robots.txt |
| Domain IPs | 69.57.160.51 |
| Response IP | 69.57.160.51 |
| Found | Yes |
| Hash | 5a5c4db04e3abf5cdd36323599807ac008a335664c5ec0b9e868d696349984fb |
| SimHash | 35461810f6f2 |
Groups
bingbot
| Rule | Path |
|---|---|
| Disallow | /coins$ |
| Disallow | /coins? |
| Disallow | /consent$ |
| Disallow | /consent? |
| Disallow | /deleted-posts |
| Disallow | /design$ |
| Disallow | /design? |
| Disallow | /leave |
| Disallow | /leave-* |
| Disallow | /login-* |
| Disallow | /messages$ |
| Disallow | /messages? |
| Disallow | /messages-* |
| Disallow | /notifications |
| Disallow | /paypal-* |
| Disallow | /photos-list-arrange |
| Disallow | /photos-upload |
| Disallow | /post$ |
| Disallow | /post? |
| Disallow | /process-* |
| Disallow | /profile-attributes-sent |
| Disallow | /profile-comments-pending |
| Disallow | /profile-edit |
| Disallow | /profile-gifts-archive |
| Disallow | /profile-gifts-pending |
| Disallow | /profile-visitors |
| Disallow | /questions-submit |
| Disallow | /reactivate |
| Disallow | /reactivate-auto |
| Disallow | /settings-* |
| Disallow | /setup |
| Disallow | /support-ticket |
| Disallow | /support-tickets |
| Disallow | /vip$ |
| Disallow | /vip? |
| Disallow | /*/info$ |
| Disallow | /*/info? |
| Disallow | /*/awards$ |
| Disallow | /*/awards? |
| Disallow | /*/attributes$ |
| Disallow | /*/attributes? |
| Disallow | /*/replies$ |
| Disallow | /*/replies? |
| Disallow | /*/joined-groups$ |
| Disallow | /*/joined-groups? |
| Disallow | /*/friends$ |
| Disallow | /*/friends? |
| Disallow | /*/followers$ |
| Disallow | /*/followers? |
| Disallow | /*/circle$ |
| Disallow | /*/circle? |
| Disallow | /*/whiteboard$ |
| Disallow | /*/whiteboard? |
| Disallow | /*/gifts$ |
| Disallow | /*/gifts? |
| Disallow | /*?*com_id= |
| Allow | / |
googlebot
| Rule | Path |
|---|---|
| Disallow | /coins$ |
| Disallow | /coins? |
| Disallow | /consent$ |
| Disallow | /consent? |
| Disallow | /deleted-posts |
| Disallow | /design$ |
| Disallow | /design? |
| Disallow | /leave |
| Disallow | /leave-* |
| Disallow | /login-* |
| Disallow | /messages$ |
| Disallow | /messages? |
| Disallow | /messages-* |
| Disallow | /notifications |
| Disallow | /paypal-* |
| Disallow | /photos-list-arrange |
| Disallow | /photos-upload |
| Disallow | /post$ |
| Disallow | /post? |
| Disallow | /process-* |
| Disallow | /profile-attributes-sent |
| Disallow | /profile-comments-pending |
| Disallow | /profile-edit |
| Disallow | /profile-gifts-archive |
| Disallow | /profile-gifts-pending |
| Disallow | /profile-visitors |
| Disallow | /questions-submit |
| Disallow | /reactivate |
| Disallow | /reactivate-auto |
| Disallow | /settings-* |
| Disallow | /setup |
| Disallow | /support-ticket |
| Disallow | /support-tickets |
| Disallow | /vip$ |
| Disallow | /vip? |
| Disallow | /*/info$ |
| Disallow | /*/info? |
| Disallow | /*/awards$ |
| Disallow | /*/awards? |
| Disallow | /*/attributes$ |
| Disallow | /*/attributes? |
| Disallow | /*/replies$ |
| Disallow | /*/replies? |
| Disallow | /*/joined-groups$ |
| Disallow | /*/joined-groups? |
| Disallow | /*/friends$ |
| Disallow | /*/friends? |
| Disallow | /*/followers$ |
| Disallow | /*/followers? |
| Disallow | /*/circle$ |
| Disallow | /*/circle? |
| Disallow | /*/whiteboard$ |
| Disallow | /*/whiteboard? |
| Disallow | /*/gifts$ |
| Disallow | /*/gifts? |
| Disallow | /*?*com_id= |
| Allow | / |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /coins$ |
| Disallow | /coins? |
| Disallow | /consent$ |
| Disallow | /consent? |
| Disallow | /deleted-posts |
| Disallow | /design$ |
| Disallow | /design? |
| Disallow | /leave |
| Disallow | /leave-* |
| Disallow | /login-* |
| Disallow | /messages$ |
| Disallow | /messages? |
| Disallow | /messages-* |
| Disallow | /notifications |
| Disallow | /paypal-* |
| Disallow | /photos-list-arrange |
| Disallow | /photos-upload |
| Disallow | /post$ |
| Disallow | /post? |
| Disallow | /process-* |
| Disallow | /profile-attributes-sent |
| Disallow | /profile-comments-pending |
| Disallow | /profile-edit |
| Disallow | /profile-gifts-archive |
| Disallow | /profile-gifts-pending |
| Disallow | /profile-visitors |
| Disallow | /questions-submit |
| Disallow | /reactivate |
| Disallow | /reactivate-auto |
| Disallow | /settings-* |
| Disallow | /setup |
| Disallow | /support-ticket |
| Disallow | /support-tickets |
| Disallow | /vip$ |
| Disallow | /vip? |
| Disallow | /*/info$ |
| Disallow | /*/info? |
| Disallow | /*/awards$ |
| Disallow | /*/awards? |
| Disallow | /*/attributes$ |
| Disallow | /*/attributes? |
| Disallow | /*/replies$ |
| Disallow | /*/replies? |
| Disallow | /*/joined-groups$ |
| Disallow | /*/joined-groups? |
| Disallow | /*/friends$ |
| Disallow | /*/friends? |
| Disallow | /*/followers$ |
| Disallow | /*/followers? |
| Disallow | /*/circle$ |
| Disallow | /*/circle? |
| Disallow | /*/whiteboard$ |
| Disallow | /*/whiteboard? |
| Disallow | /*/gifts$ |
| Disallow | /*/gifts? |
| Disallow | /*?*com_id= |
| Allow | / |
yandex
| Rule | Path |
|---|---|
| Disallow | /coins$ |
| Disallow | /coins? |
| Disallow | /consent$ |
| Disallow | /consent? |
| Disallow | /deleted-posts |
| Disallow | /design$ |
| Disallow | /design? |
| Disallow | /leave |
| Disallow | /leave-* |
| Disallow | /login-* |
| Disallow | /messages$ |
| Disallow | /messages? |
| Disallow | /messages-* |
| Disallow | /notifications |
| Disallow | /paypal-* |
| Disallow | /photos-list-arrange |
| Disallow | /photos-upload |
| Disallow | /post$ |
| Disallow | /post? |
| Disallow | /process-* |
| Disallow | /profile-attributes-sent |
| Disallow | /profile-comments-pending |
| Disallow | /profile-edit |
| Disallow | /profile-gifts-archive |
| Disallow | /profile-gifts-pending |
| Disallow | /profile-visitors |
| Disallow | /questions-submit |
| Disallow | /reactivate |
| Disallow | /reactivate-auto |
| Disallow | /settings-* |
| Disallow | /setup |
| Disallow | /support-ticket |
| Disallow | /support-tickets |
| Disallow | /vip$ |
| Disallow | /vip? |
| Disallow | /*/info$ |
| Disallow | /*/info? |
| Disallow | /*/awards$ |
| Disallow | /*/awards? |
| Disallow | /*/attributes$ |
| Disallow | /*/attributes? |
| Disallow | /*/replies$ |
| Disallow | /*/replies? |
| Disallow | /*/joined-groups$ |
| Disallow | /*/joined-groups? |
| Disallow | /*/friends$ |
| Disallow | /*/friends? |
| Disallow | /*/followers$ |
| Disallow | /*/followers? |
| Disallow | /*/circle$ |
| Disallow | /*/circle? |
| Disallow | /*/whiteboard$ |
| Disallow | /*/whiteboard? |
| Disallow | /*/gifts$ |
| Disallow | /*/gifts? |
| Disallow | /*?*com_id= |
| Allow | / |
amazonbot
| Rule | Path |
|---|---|
| Disallow | /coins$ |
| Disallow | /coins? |
| Disallow | /consent$ |
| Disallow | /consent? |
| Disallow | /deleted-posts |
| Disallow | /design$ |
| Disallow | /design? |
| Disallow | /leave |
| Disallow | /leave-* |
| Disallow | /login-* |
| Disallow | /messages$ |
| Disallow | /messages? |
| Disallow | /messages-* |
| Disallow | /notifications |
| Disallow | /paypal-* |
| Disallow | /photos-list-arrange |
| Disallow | /photos-upload |
| Disallow | /post$ |
| Disallow | /post? |
| Disallow | /process-* |
| Disallow | /profile-attributes-sent |
| Disallow | /profile-comments-pending |
| Disallow | /profile-edit |
| Disallow | /profile-gifts-archive |
| Disallow | /profile-gifts-pending |
| Disallow | /profile-visitors |
| Disallow | /questions-submit |
| Disallow | /reactivate |
| Disallow | /reactivate-auto |
| Disallow | /settings-* |
| Disallow | /setup |
| Disallow | /support-ticket |
| Disallow | /support-tickets |
| Disallow | /vip$ |
| Disallow | /vip? |
| Disallow | /*/info$ |
| Disallow | /*/info? |
| Disallow | /*/awards$ |
| Disallow | /*/awards? |
| Disallow | /*/attributes$ |
| Disallow | /*/attributes? |
| Disallow | /*/replies$ |
| Disallow | /*/replies? |
| Disallow | /*/joined-groups$ |
| Disallow | /*/joined-groups? |
| Disallow | /*/friends$ |
| Disallow | /*/friends? |
| Disallow | /*/followers$ |
| Disallow | /*/followers? |
| Disallow | /*/circle$ |
| Disallow | /*/circle? |
| Disallow | /*/whiteboard$ |
| Disallow | /*/whiteboard? |
| Disallow | /*/gifts$ |
| Disallow | /*/gifts? |
| Disallow | /*?*com_id= |
| Allow | / |
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /*/joined-groups$ |
| Disallow | /*/joined-groups? |
| Disallow | /messages$ |
| Disallow | /messages? |
| Disallow | /messages-* |
| Allow | / |
adsbot-google-mobile
| Rule | Path |
|---|---|
| Disallow | /*/joined-groups$ |
| Disallow | /*/joined-groups? |
| Disallow | /messages$ |
| Disallow | /messages? |
| Disallow | /messages-* |
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /*/joined-groups$ |
| Disallow | /*/joined-groups? |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://similarworlds.com/sitemap.xml |