drivers.softpedia.com
robots.txt

Robots Exclusion Standard data for drivers.softpedia.com

Resource Scan

Scan Details

Site Domain drivers.softpedia.com
Base Domain softpedia.com
Scan Status Ok
Last Scan2024-05-20T01:33:30+00:00
Next Scan 2024-06-19T01:33:30+00:00

Last Scan

Scanned2024-05-20T01:33:30+00:00
URL https://drivers.softpedia.com/robots.txt
Domain IPs 104.22.12.228, 104.22.13.228, 172.67.5.104, 2606:4700:10::6816:ce4, 2606:4700:10::6816:de4, 2606:4700:10::ac43:568
Response IP 104.22.12.228
Found Yes
Hash 4b1f33329f704de3ac612495a99ae5ebf75ec766d334557abb4c4720e0a9df73
SimHash 60dd43e8d691

Groups

mediapartners-google

Rule Path
Disallow

google-site-verification

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googleother

Rule Path
Disallow

*

Rule Path
Disallow /_xaja/dltrk.php
Disallow /_xaja/nrtrk.php
Disallow /zd.php
Disallow /yd.php
Disallow /cgi-bin/
Disallow /addineyeV2.html
Disallow /DARTIframe.html
Disallow /doubleclick

gptbot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

queryseekerspider

Rule Path
Disallow /

ning

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

vegi bot

Rule Path
Disallow /

demandbase-bot

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

demandbasepublisheranalyzer

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

yak

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

germcrawler

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

buck

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /