adspecials.us
robots.txt
Robots Exclusion Standard data for adspecials.us
Resource Scan
Scan Details
| Site Domain | adspecials.us |
| Base Domain | adspecials.us |
| Scan Status | Ok |
| Last Scan | 2024-06-21T14:38:35+00:00 |
| Next Scan | 2024-06-28T14:38:35+00:00 |
Last Scan
| Scanned | 2024-06-21T14:38:35+00:00 |
| URL | https://adspecials.us/robots.txt |
| Redirect | https://www.adspecials.us/robots.txt |
| Redirect Domain | www.adspecials.us |
| Redirect Base | adspecials.us |
| Domain IPs | 104.21.35.63, 172.67.214.87, 2606:4700:3030::6815:233f, 2606:4700:3030::ac43:d657 |
| Redirect IPs | 104.21.35.63, 172.67.214.87, 2606:4700:3030::6815:233f, 2606:4700:3030::ac43:d657 |
| Response IP | 172.67.214.87 |
| Found | Yes |
| Hash | c85b83d723e572feae91906ec8e28ef7d8bc4b6696f27fe2cff953c85b01d1c0 |
| SimHash | ecd7ce32f411 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /search/* |
| Disallow | /shopping-list/ |
| Disallow | /click-out/ |
| Disallow | /index.php/click-out/ |
| Disallow | /admin/ |
| Disallow | /cdn-cgi/ |
| Disallow | /brands/*?page=* |
| Disallow | /offers/*?page=* |
| Disallow | /stores/*?page=* |
| Disallow | /cities/*?page=* |
| Disallow | /latest-ads?page=* |
| Disallow | /almost-expired-ads?page=* |
| Disallow | /popular-ads?page=* |
| Disallow | /recommended-ads?page=* |
| Disallow | /latest-offers?page=* |
| Disallow | /almost-expired-offers?page=* |
| Disallow | /popular-offers?page=* |
| Disallow | /recommended-offers?page=* |
| Disallow | /offers/*?*=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.www.adspecials.us/sitemap.xml |