scamadviser.com
robots.txt
Robots Exclusion Standard data for scamadviser.com
Resource Scan
Scan Details
| Site Domain | scamadviser.com |
| Base Domain | scamadviser.com |
| Scan Status | Ok |
| Last Scan | 2024-11-08T11:37:59+00:00 |
| Next Scan | 2024-11-15T11:37:59+00:00 |
Last Scan
| Scanned | 2024-11-08T11:37:59+00:00 |
| URL | https://scamadviser.com/robots.txt |
| Redirect | https://www.scamadviser.com/robots.txt |
| Redirect Domain | www.scamadviser.com |
| Redirect Base | scamadviser.com |
| Domain IPs | 104.22.38.245, 104.22.39.245, 172.67.8.189, 2606:4700:10::6816:26f5, 2606:4700:10::6816:27f5, 2606:4700:10::ac43:8bd |
| Redirect IPs | 104.22.38.245, 104.22.39.245, 172.67.8.189, 2606:4700:10::6816:26f5, 2606:4700:10::6816:27f5, 2606:4700:10::ac43:8bd |
| Response IP | 104.22.39.245 |
| Found | Yes |
| Hash | 03e7dc8f4587073c997553216f0042310eb952b16c398555cedd2c5b37a47bda |
| SimHash | 675df831ef5e |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax/ |
| Disallow | /account/info |
| Disallow | /data/ |
| Disallow | /pageview/ |
| Disallow | /refresh-data/ |
| Disallow | /refresh-view/ |
| Disallow | /detroitchicago/ |
| Disallow | /en/redirect-webshop/ |
| Disallow | /nl/redirect-webshop/ |
| Disallow | /pt/redirect-webshop/ |
| Disallow | /es/redirect-webshop/ |
| Disallow | /de/redirect-webshop/ |
| Disallow | /fr/redirect-webshop/ |
| Disallow | /it/redirect-webshop/ |
| Disallow | /uk/redirect-webshop/ |
| Disallow | /ro/redirect-webshop/ |
| Disallow | /ru/redirect-webshop/ |
| Disallow | /zh/redirect-webshop/ |
| Disallow | /tc/redirect-webshop/ |
| Disallow | /jp/redirect-webshop/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.scamadviser.com/sitemaps/sitemaps-top-weekly.xml |
| sitemap | https://www.scamadviser.com/sitemaps/sitemaps-top-daily.xml |
| sitemap | https://www.scamadviser.com/sitemaps/sitemaps-new-weekly.xml |
| sitemap | https://www.scamadviser.com/sitemaps/sitemaps-new-daily.xml |
| sitemap | https://www.scamadviser.com/sitemap_pages.xml |