mygoldsurveys.com
robots.txt
Robots Exclusion Standard data for mygoldsurveys.com
Resource Scan
Scan Details
Site Domain | mygoldsurveys.com |
Base Domain | mygoldsurveys.com |
Scan Status | Ok |
Last Scan | 2024-05-29T08:59:50+00:00 |
Next Scan | 2024-06-05T08:59:50+00:00 |
Last Scan
Scanned | 2024-05-29T08:59:50+00:00 |
URL | https://mygoldsurveys.com/robots.txt |
Redirect | https://www.swagbucks.com/robots.txt |
Redirect Domain | www.swagbucks.com |
Redirect Base | swagbucks.com |
Domain IPs | 52.84.229.127, 52.84.229.22, 52.84.229.25, 52.84.229.85 |
Redirect IPs | 35.80.139.188, 54.189.196.157, 54.190.210.116 |
Response IP | 35.80.139.188 |
Found | Yes |
Hash | ca06bc20e1b1e54dd67f1a2cd9d5379393167a2a71838182a6b7de5f85216966 |
SimHash | 4d4594806510 |
Groups
*
Rule | Path |
---|---|
Disallow | /?*sw-rules |
Disallow | /account |
Disallow | /content/components/whitelisting/swagbucks-earn-free-gift-cards.txt |
Disallow | /g/l/ |
Disallow | /g/message |
Disallow | /g/shopredir |
Disallow | /gcs/ |
Disallow | /ncrave/ |
Disallow | /p/confirm |
Disallow | /p/login |
Disallow | /p/offer-page |
Disallow | /polls/ |
Disallow | /profile |
Disallow | /shop/myfavorites |
Disallow | /shop/promo/ |
Disallow | /watch/ |
Disallow | /z/ |
Disallow | /swagbutton-tutorial |
Other Records
Field | Value |
---|---|
sitemap | https://www.swagbucks.com/sitemap_index.xml |