data.diffen.com
robots.txt

Robots Exclusion Standard data for data.diffen.com

Resource Scan

Scan Details

Site Domain data.diffen.com
Base Domain diffen.com
Scan Status Ok
Last Scan2025-12-03T21:47:03+00:00
Next Scan 2026-01-02T21:47:03+00:00

Last Scan

Scanned2025-12-03T21:47:03+00:00
URL https://data.diffen.com/robots.txt
Domain IPs 104.26.8.153, 104.26.9.153, 172.67.69.158, 2606:4700:20::681a:899, 2606:4700:20::681a:999, 2606:4700:20::ac43:459e
Response IP 104.26.9.153
Found Yes
Hash 781858f59c586f9ef01b31d3ab29e2175a0243121f3a5745c40a5ccc94085a10
SimHash 0904c2004730

Groups

bingbot

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

*

Rule Path
Disallow /