windfinder.net
robots.txt

Robots Exclusion Standard data for windfinder.net

Resource Scan

Scan Details

Site Domain windfinder.net
Base Domain windfinder.net
Scan Status Ok
Last Scan2024-11-13T21:29:57+00:00
Next Scan 2024-11-20T21:29:57+00:00

Last Scan

Scanned2024-11-13T21:29:57+00:00
URL https://windfinder.net/robots.txt
Redirect https://www.windfinder.com/robots.txt?utm_source=windfinder.net&utm_medium=web&utm_campaign=redirect
Redirect Domain www.windfinder.com
Redirect Base windfinder.com
Domain IPs 54.171.75.14
Redirect IPs 54.171.75.14
Response IP 54.171.102.150
Found Yes
Hash 25288f274695f432d21fd3fc35821c16e72a32c081e2d1b72371e3c10db2777f
SimHash 994c9ac25162

Groups

*

Rule Path
Disallow /archiv/
Disallow /windspots/
Disallow /wind-cgi/forecast_print.pl
Disallow /wind-cgi/forecast_print_hires.pl
Disallow /wind-cgi/homepageforecast.pl
Disallow /wind-cgi/language.pl
Disallow /wind-cgi/qa-maps.pl
Disallow /wind-cgi/qa-stations.pl
Disallow /wind-cgi/clusterer.pl
Disallow /wind-cgi/locallinks.pl
Disallow /wind-cgi/mobile/
Disallow /api/
Disallow /wind-cgi/xmlforecast.pl
Disallow /wind-cgi/xmlreport.pl
Disallow /wind-cgi/stationsgif.pl
Disallow /wind-cgi/windgraph_medium.pl
Disallow /wind-cgi/weather.pl
Disallow /wind-cgi/windgraph_small.pl
Disallow /wind-cgi/homepagestatistics.pl
Disallow /forecast/*/print
Disallow /weatherforecast/*/print
Disallow /widget/forecast/
Disallow /share/forecast/
Disallow /webcams/detailed/
Disallow /apps/iphone/help/
Disallow /apps/android/help/
Disallow /apps/help/
Disallow /wind-cgi/link-sql/
Disallow /wind-cgi/top_surfspots.pl
Disallow /wind-cgi/tidenfinder.pl
Disallow /wind-cgi/adcycle/
Disallow /wind-cgi/webcam.pl
Disallow /*?mode=*$
Disallow /*wf_cmp%3D*$
Disallow /*winddir%3D*$
Disallow /*windspeed%3D*$
Disallow /*waveheight%3D*$
Disallow /*temperature%3D*$
Disallow /report/*/*-*-*
Disallow /app_resources/

msiecrawler

Rule Path
Disallow /

yandex

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

Comments

  • robots.txt for http://www.windfinder.com/
  • Allow: