clickserve.dartsearch.net
robots.txt

Robots Exclusion Standard data for clickserve.dartsearch.net

Resource Scan

Scan Details

Site Domain clickserve.dartsearch.net
Base Domain dartsearch.net
Scan Status Ok
Last Scan2024-05-01T01:41:19+00:00
Next Scan 2024-05-31T01:41:19+00:00

Last Scan

Scanned2024-05-01T01:41:19+00:00
URL https://clickserve.dartsearch.net/robots.txt
Domain IPs 142.251.175.100, 142.251.175.101, 142.251.175.102, 142.251.175.113, 142.251.175.138, 142.251.175.139, 2404:6800:4003:c00::64, 2404:6800:4003:c00::65, 2404:6800:4003:c00::8a, 2404:6800:4003:c00::8b
Response IP 74.125.24.101
Found Yes
Hash 0d61d0ac4b0fd000ff49089aba50c02757786a8239ac150921f4a667ba17b2f0
SimHash add06bb2c6d4

Groups

*

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow

msnptc

Rule Path
Disallow

adidxbot

Rule Path
Disallow

Comments

  • disallow all spiders
  • allow the Google Adwords link checker
  • allow the MSN Adcenter link checker
  • allow the Microsoft quality link checker