wxnation.com
robots.txt

Robots Exclusion Standard data for wxnation.com

Resource Scan

Scan Details

Site Domain wxnation.com
Base Domain wxnation.com
Scan Status Ok
Last Scan2026-01-06T19:33:39+00:00
Next Scan 2026-01-13T19:33:39+00:00

Last Scan

Scanned2026-01-06T19:33:39+00:00
URL https://wxnation.com/robots.txt
Redirect http://www.wxnation.com/robots.txt
Redirect Domain www.wxnation.com
Redirect Base wxnation.com
Domain IPs 104.21.49.131, 172.67.145.110, 2606:4700:3032::ac43:916e, 2606:4700:3034::6815:3183
Redirect IPs 104.21.49.131, 172.67.145.110, 2606:4700:3032::ac43:916e, 2606:4700:3034::6815:3183
Response IP 104.21.49.131
Found Yes
Hash ac6c54e3f187b770ccff08bfc2bbc5d88b000b3ab5f2a8a7a39541b005219f25
SimHash 2dab502466f4

Groups

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /cgi-bin/
Disallow /cgi-bin/cams/
Disallow /archive/
Disallow /dfw/
Disallow /guestbook/
Disallow citypages.html
Disallow postinfo.html
Disallow staging.php
Disallow /stats/
Disallow /stats1/
Disallow /cams/
Disallow indextest.html
Disallow /weatherblogs/wire/wp-content/
Disallow /weatherblogs/wire/wp-admin/
Disallow /weatherblogs/wire/wp-includes/
Disallow /weatherblogs/wire/wp-print.php
Disallow /weatherblogs/wire/wp-comments-post.php
Disallow /weatherblogs/wire/wp-commentsrss2.php
Disallow /weatherblogs/wire/wp-trackback.php
Disallow /weatherblogs/wire/page/
Disallow /weatherblogs/wire/comments/
Disallow /wire/wp-content/
Disallow /wire/wp-admin/
Disallow /wire/wp-includes/
Disallow /wire/wp-print.php
Disallow /wire/wp-mobile.php
Disallow /wire/date/
Disallow /wire/wp-comments-post.php
Disallow /wire/wp-commentsrss2.php
Disallow /wire/wp-trackback.php
Disallow /wire/feed/
Disallow /blog/
Disallow /log/
Disallow /weather_x/