netdriven.com
robots.txt

Robots Exclusion Standard data for netdriven.com

Resource Scan

Scan Details

Site Domain netdriven.com
Base Domain netdriven.com
Scan Status Ok
Last Scan2024-05-24T10:00:53+00:00
Next Scan 2024-06-23T10:00:53+00:00

Last Scan

Scanned2024-05-24T10:00:53+00:00
URL https://netdriven.com/robots.txt
Redirect https://www.netdriven.com/robots.txt
Redirect Domain www.netdriven.com
Redirect Base netdriven.com
Domain IPs 104.21.54.215, 172.67.142.215, 2606:4700:3037::6815:36d7, 2606:4700:3037::ac43:8ed7
Redirect IPs 104.21.54.215, 172.67.142.215, 2606:4700:3037::6815:36d7, 2606:4700:3037::ac43:8ed7
Response IP 104.21.54.215
Found Yes
Hash fed57c1bde7e348d5e36d74a0b4f48c42352705fca0553711821adfbcae4b592
SimHash 73197540a543

Groups

amazonbot

Rule Path
Disallow /

ms search 4.0 robot

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 4.01; windows nt; ms search 4.0 robot) microsoft

Rule Path
Disallow /

*

Rule Path
Disallow /Activity-Feed/
Disallow /admin/
Disallow /App_Browsers/
Disallow /App_Code/
Disallow /App_Data/
Disallow /App_GlobalResources/
Disallow /bin/
Disallow /Components/
Disallow /Config/
Disallow /contest/
Disallow /controls/
Disallow /DesktopModules/*.aspx
Disallow /Documentation/
Disallow /HttpModules/
Disallow /images/
Disallow /Install/
Disallow /Providers/
Disallow /home/ctl/
Disallow /default.aspx
Disallow /home.aspx
Disallow /login.aspx
Disallow /privacy.aspx
Disallow /stats.aspx
Disallow /thank-you.aspx
Disallow /*/ctl/
Disallow /*ctl%3Dlogin
Disallow /*ctl%3Dsendpassword*
Disallow /*ctl%3Dlicense*
Disallow /*fileticket%3D*
Disallow /*scheduleitem%3D
Disallow /*%26Sched%3D*
Disallow /*submitreview*
Disallow /vlb.aspx
Disallow /VLB.aspx
Disallow /*.asmx

Other Records

Field Value
crawl-delay 30

Comments

  • Begin robots.txt file
  • End of robots.txt file