Log In Sign Up

meteonews.nl
robots.txt

Robots Exclusion Standard data for meteonews.nl

Resource Scan

Scan Details

Site Domain meteonews.nl
Base Domain meteonews.nl
Scan Status Ok
Last Scan2024-06-27T04:08:41+00:00
Next Scan 2024-07-04T04:08:41+00:00

Last Scan

Scanned2024-06-27T04:08:41+00:00
URL https://meteonews.nl/robots.txt
Domain IPs 5.9.74.102
Response IP 5.9.74.102
Found Yes
Hash 3825e6c0489f2413ea0bfba24a84132777bae0820400169f88f9a96d814d811d
SimHash f244cd5469e6

Groups

mediapartners-google*

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

*

Rule Path
Disallow /Async
Disallow /nl/Async
Disallow /en/Async
Disallow /AsyncJson
Disallow /nl/AsyncJson
Disallow /en/AsyncJson
Disallow /Captcha
Disallow /nl/Captcha
Disallow /en/Captcha
Disallow /Devel
Disallow /nl/Devel
Disallow /en/Devel
Disallow /DeveloperTools
Disallow /nl/DeveloperTools
Disallow /en/DeveloperTools
Disallow /Entwicklerseiten
Disallow /nl/Entwicklerseiten
Disallow /en/Entwicklerseiten
Disallow /Utvecklarsidor
Disallow /nl/Utvecklarsidor
Disallow /en/Utvecklarsidor
Disallow /%E0%B8%9D%E0%B9%88%E0%B8%B2%E0%B8%A2%E0%B8%9E%E0%B8%B1%E0%B8%92%E0%B8%99%E0%B8%B2
Disallow /nl/%E0%B8%9D%E0%B9%88%E0%B8%B2%E0%B8%A2%E0%B8%9E%E0%B8%B1%E0%B8%92%E0%B8%99%E0%B8%B2
Disallow /en/%E0%B8%9D%E0%B9%88%E0%B8%B2%E0%B8%A2%E0%B8%9E%E0%B8%B1%E0%B8%92%E0%B8%99%E0%B8%B2
Disallow /Favorites
Disallow /nl/Favorites
Disallow /en/Favorites
Disallow /GetURL
Disallow /nl/GetURL
Disallow /en/GetURL
Disallow /HTTPError
Disallow /nl/HTTPError
Disallow /en/HTTPError
Disallow /NewsPreview
Disallow /nl/NewsPreview
Disallow /en/NewsPreview
Disallow /NewsSearchResults
Disallow /nl/NewsSearchResults
Disallow /en/NewsSearchResults
Disallow /ObsMapGetData
Disallow /nl/ObsMapGetData
Disallow /en/ObsMapGetData
Disallow /Arama_sonuclari
Disallow /nl/Arama_sonuclari
Disallow /en/Arama_sonuclari
Disallow /Hasil_pencarian
Disallow /nl/Hasil_pencarian
Disallow /en/Hasil_pencarian
Disallow /Resultats_de_la_recherche
Disallow /nl/Resultats_de_la_recherche
Disallow /en/Resultats_de_la_recherche
Disallow /Resultats_tschertga
Disallow /nl/Resultats_tschertga
Disallow /en/Resultats_tschertga
Disallow /Risultati_della_ricerca
Disallow /nl/Risultati_della_ricerca
Disallow /en/Risultati_della_ricerca
Disallow /Search_Results
Disallow /nl/Search_Results
Disallow /en/Search_Results
Disallow /SearchResults
Disallow /nl/SearchResults
Disallow /en/SearchResults
Disallow /Suchresultate
Disallow /nl/Suchresultate
Disallow /en/Suchresultate
Disallow /S%C3%B6kresultat
Disallow /nl/S%C3%B6kresultat
Disallow /en/S%C3%B6kresultat
Disallow /%E0%B8%9C%E0%B8%A5%E0%B8%81%E0%B8%B2%E0%B8%A3%E0%B8%84%E0%B9%89%E0%B8%99%E0%B8%AB%E0%B8%B2
Disallow /nl/%E0%B8%9C%E0%B8%A5%E0%B8%81%E0%B8%B2%E0%B8%A3%E0%B8%84%E0%B9%89%E0%B8%99%E0%B8%AB%E0%B8%B2
Disallow /en/%E0%B8%9C%E0%B8%A5%E0%B8%81%E0%B8%B2%E0%B8%A3%E0%B8%84%E0%B9%89%E0%B8%99%E0%B8%AB%E0%B8%B2
Disallow /Syndication
Disallow /nl/Syndication
Disallow /en/Syndication
Disallow /Squadra
Disallow /nl/Squadra
Disallow /en/Squadra
Disallow /Team
Disallow /nl/Team
Disallow /en/Team
Disallow /%C3%89quipe
Disallow /nl/%C3%89quipe
Disallow /en/%C3%89quipe
Disallow /Su_sicakliklari
Disallow /nl/Su_sicakliklari
Disallow /en/Su_sicakliklari
Disallow /Suhu_air
Disallow /nl/Suhu_air
Disallow /en/Suhu_air
Disallow /Temperatura_dell_acqua
Disallow /nl/Temperatura_dell_acqua
Disallow /en/Temperatura_dell_acqua
Disallow /Temperaturas_da_l_aua
Disallow /nl/Temperaturas_da_l_aua
Disallow /en/Temperaturas_da_l_aua
Disallow /Temperature_de_leau
Disallow /nl/Temperature_de_leau
Disallow /en/Temperature_de_leau
Disallow /Vattentemperaturer
Disallow /nl/Vattentemperaturer
Disallow /en/Vattentemperaturer
Disallow /Wassertemperaturen
Disallow /nl/Wassertemperaturen
Disallow /en/Wassertemperaturen
Disallow /Water_temperatures
Disallow /nl/Water_temperatures
Disallow /en/Water_temperatures
Disallow /WaterTemperatures
Disallow /nl/WaterTemperatures
Disallow /en/WaterTemperatures
Disallow /%E0%B8%AD%E0%B8%B8%E0%B8%93%E0%B8%AB%E0%B8%A0%E0%B8%B9%E0%B8%A1%E0%B8%B4
Disallow /nl/%E0%B8%AD%E0%B8%B8%E0%B8%93%E0%B8%AB%E0%B8%A0%E0%B8%B9%E0%B8%A1%E0%B8%B4
Disallow /en/%E0%B8%AD%E0%B8%B8%E0%B8%93%E0%B8%AB%E0%B8%A0%E0%B8%B9%E0%B8%A1%E0%B8%B4

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://meteonews.nl/sitemap.xml
sitemap https://meteonews.nl/sitemap-news.xml
Back to top