ideseek.com
robots.txt

Robots Exclusion Standard data for ideseek.com

Resource Scan

Scan Details

Site Domain ideseek.com
Base Domain ideseek.com
Scan Status Ok
Last Scan2025-09-29T05:16:49+00:00
Next Scan 2025-10-06T05:16:49+00:00

Last Scan

Scanned2025-09-29T05:16:49+00:00
URL https://ideseek.com/robots.txt
Redirect https://www.ideseek.com/robots.txt
Redirect Domain www.ideseek.com
Redirect Base ideseek.com
Domain IPs 81.171.31.91
Redirect IPs 81.171.31.91
Response IP 81.171.31.91
Found Yes
Hash acba279f0bacd3e74c8e8208ac34300dbd89edcf3840c2459ceb9d4495a7be13
SimHash 6dc098408750

Groups

bingbot
googlebot

Rule Path
Disallow /
Allow /$
Allow /ads.txt
Allow /favicon.ico
Allow /*-*/article/
Allow /article/
Allow /*-*/category/
Allow /adv/
Allow /pref/

adidxbot
adsbot-google
adsbot-google-mobile
mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /