meteoweb.eu
robots.txt

Robots Exclusion Standard data for meteoweb.eu

Resource Scan

Scan Details

Site Domain meteoweb.eu
Base Domain meteoweb.eu
Scan Status Ok
Last Scan2025-10-20T20:01:11+00:00
Next Scan 2025-10-27T20:01:11+00:00

Last Scan

Scanned2025-10-20T20:01:11+00:00
URL https://meteoweb.eu/robots.txt
Redirect https://www.meteoweb.eu/robots.txt
Redirect Domain www.meteoweb.eu
Redirect Base meteoweb.eu
Domain IPs 104.21.37.167, 172.67.210.151, 2606:4700:3031::6815:25a7, 2606:4700:3035::ac43:d297
Redirect IPs 104.21.37.167, 172.67.210.151, 2606:4700:3031::6815:25a7, 2606:4700:3035::ac43:d297
Response IP 172.67.210.151
Found Yes
Hash db9233bf5f5d1bebf879aea7298548422c68d3b1820c67c4aad4a64f2d654e93
SimHash cb34dc468bb2

Groups

*

Rule Path
Allow /
Disallow /Analytics/
Disallow /Notifiche/
Disallow /Media/
Disallow /adnkronos/
Disallow /stats/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /*.pdf$
Disallow /news-adn/
Disallow /adnkronos/
Disallow /author/adnkronos/
Disallow /?cmd
Disallow /*?s=
Disallow /search/
Disallow /wp-json/wp/v2/*
Disallow /sitemap_crawler.php

facebookexternalhit

Rule Path
Disallow

Other Records

Field Value
crawl-delay 0

twitterbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.meteoweb.eu/sitemaps/sitemap-index.xml
sitemap https://www.meteoweb.eu/sitemaps/sitemap-news.xml