static.diffen.com
robots.txt

Robots Exclusion Standard data for static.diffen.com

Resource Scan

Scan Details

Site Domain static.diffen.com
Base Domain diffen.com
Scan Status Ok
Last Scan2025-05-21T05:03:05+00:00
Next Scan 2025-06-20T05:03:05+00:00

Last Scan

Scanned2025-05-21T05:03:05+00:00
URL https://static.diffen.com/robots.txt
Domain IPs 104.26.8.153, 104.26.9.153, 172.67.69.158, 2606:4700:20::681a:899, 2606:4700:20::681a:999, 2606:4700:20::ac43:459e
Response IP 104.26.8.153
Found Yes
Hash ea30930a8f36f69d5f6fd748b974d23923ed63892e8bf4bf5376c622adcd22dc
SimHash 285cd940c113

Groups

*

Rule Path
Disallow /gc2.php
Disallow /nc/
Disallow /js/prebid.js
Disallow /js/prebid231_a.js
Disallow /search/

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /