adskeeper.com
robots.txt
Robots Exclusion Standard data for adskeeper.com
Resource Scan
Scan Details
| Site Domain | adskeeper.com |
| Base Domain | adskeeper.com |
| Scan Status | Ok |
| Last Scan | 2025-12-15T15:11:27+00:00 |
| Next Scan | 2026-01-14T15:11:27+00:00 |
Last Scan
| Scanned | 2025-12-15T15:11:27+00:00 |
| URL | https://adskeeper.com/robots.txt |
| Redirect | https://www.adskeeper.com/robots.txt |
| Redirect Domain | www.adskeeper.com |
| Redirect Base | adskeeper.com |
| Domain IPs | 104.18.35.150, 172.64.152.106, 2606:4700:4403::6812:2396, 2606:4700:4404::ac40:986a |
| Redirect IPs | 104.18.35.150, 172.64.152.106, 2606:4700:4403::6812:2396, 2606:4700:4404::ac40:986a |
| Response IP | 172.64.152.106 |
| Found | Yes |
| Hash | c6d686229fc78956d3a8a29be3f95c38dfe1de3acac914acdf02bbe74bdbd5ad |
| SimHash | 61040b61c300 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /redirect |
| Disallow | /news |
| Disallow | /rnews |
| Disallow | /tnews |
| Disallow | /ghits |
| Disallow | /pnews |
| Disallow | /graphql |
| Disallow | /webinars |
| Disallow | /translator |
| Disallow | /dpd |
| Disallow | /landing/cpc/push-for-advertisers/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.adskeeper.com/sitemap.xml |
Warnings
- `host` is not a known field.