rewardsapp.com
robots.txt
Robots Exclusion Standard data for rewardsapp.com
Resource Scan
Scan Details
| Site Domain | rewardsapp.com |
| Base Domain | rewardsapp.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server redirected incorrectly. |
| Last Scan | 2024-11-07T09:12:07+00:00 |
| Next Scan | 2025-02-05T09:12:07+00:00 |
Last Successful Scan
| Scanned | 2022-08-15T14:24:07+00:00 |
| URL | https://rewardsapp.com/robots.txt |
| Redirect | https://foursquare.com/robots.txt |
| Redirect Domain | foursquare.com |
| Redirect Base | foursquare.com |
| Response IP | 151.101.194.132 |
| Found | Yes |
| Hash | 31351565a7158e8071bce3e1322481a149286258ef2fe048c6fde66b99c41665 |
| SimHash | 5a21ce304592 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /search? |
| Disallow | /login? |
| Disallow | /login/* |
| Disallow | /signup? |
| Disallow | /signup/* |
| Allow | /signup/$ |
| Disallow | /mobile/ |
| Disallow | /touch/login |
| Disallow | /mobile/search |
| Disallow | /user/*/checkin/ |
| Disallow | /*/checkin/ |
| Allow | /v/checkin* |
| Disallow | /private/wtrack |
| Disallow | /l/ |
| Disallow | /*/badge/ |
| Disallow | /*/badges |
| Allow | /v/badge* |
| Disallow | /oauth2/ |
| Disallow | /device/ |
| Disallow | /venue/claim |
| Disallow | /app/ |
| Disallow | /go/ |
| Disallow | /*/lists/edited$ |
| Disallow | /*/lists/followed$ |
| Disallow | /*/lists/friends$ |
| Disallow | /*/list/todos$ |
| Disallow | /*/list/tips$ |
| Disallow | /*/list/venuelikes$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://4sq-sitemap.s3.amazonaws.com/sitemap_index.xml |