downloads.digitaltrends.com
robots.txt

Robots Exclusion Standard data for downloads.digitaltrends.com

Resource Scan

Scan Details

Site Domain downloads.digitaltrends.com
Base Domain digitaltrends.com
Scan Status Ok
Last Scan2024-06-24T15:48:47+00:00
Next Scan 2024-07-24T15:48:47+00:00

Last Scan

Scanned2024-06-24T15:48:47+00:00
URL https://downloads.digitaltrends.com/robots.txt
Domain IPs 34.120.95.133
Response IP 34.120.95.133
Found Yes
Hash 1ee63773cbfda012ba255b23ddbf8dc865e1a4828755302eb3cd6d67c67dc550
SimHash 0938da7757fa

Groups

*

Rule Path
Allow /
Disallow /download-launch?*

onetszukaj
sputnikbot
nigma.ru
webalta
webalta crawler
mail.ru
mail.ru_bot
rambler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Comments

  • Robots V.1.0
  • Other bots