downloads.digitaltrends.com
robots.txt

Robots Exclusion Standard data for downloads.digitaltrends.com

Resource Scan

Scan Details

Site Domain downloads.digitaltrends.com
Base Domain digitaltrends.com
Scan Status Ok
Last Scan2024-10-22T15:50:27+00:00
Next Scan 2024-11-21T15:50:27+00:00

Last Scan

Scanned2024-10-22T15:50:27+00:00
URL https://downloads.digitaltrends.com/robots.txt
Domain IPs 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91, 2a04:4e42:200::347, 2a04:4e42:400::347, 2a04:4e42:600::347, 2a04:4e42::347
Response IP 199.232.45.91
Found Yes
Hash 08562bc8d1587620ff0119d6c7aee3e634e9d48485cd1bab449b6c4962672645
SimHash 09389a775ffa

Groups

*

Rule Path
Allow /
Disallow /download-launch?*
Disallow /es/download-launch?*

onetszukaj
sputnikbot
nigma.ru
webalta
webalta crawler
mail.ru
mail.ru_bot
rambler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Comments

  • Robots V.1.0
  • Other bots