Log In Sign Up

weatherforyou.com
robots.txt

Robots Exclusion Standard data for weatherforyou.com

Resource Scan

Scan Details

Site Domain weatherforyou.com
Base Domain weatherforyou.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-14T17:20:27+00:00
Next Scan 2024-10-14T17:20:27+00:00

Last Successful Scan

Scanned2024-08-16T17:19:35+00:00
URL https://weatherforyou.com/robots.txt
Redirect https://www.weatherforyou.com/robots.txt
Redirect Domain www.weatherforyou.com
Redirect Base weatherforyou.com
Domain IPs 172.66.40.238, 172.66.43.18, 2606:4700:3108::ac42:28ee, 2606:4700:3108::ac42:2b12
Redirect IPs 172.66.40.238, 172.66.43.18, 2606:4700:3108::ac42:28ee, 2606:4700:3108::ac42:2b12
Response IP 172.66.43.18
Found Yes
Hash b1324c9eba6413b3966f024f5ff1d83e26b8dde30ca7694432e345842424554f
SimHash 64a8da61bb94

Groups

amazonbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

ccbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

mattie

Rule Path
Disallow /

psbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

djecobot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

leikibot

Rule Path
Disallow /

quetextbot

Rule Path
Disallow /

voluumdsp-content-bot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

*

Rule Path
Disallow /ct/
Disallow /advertising/
Disallow /cohost/
Disallow /hamweather/
Disallow /hwscroll/
Disallow /_derived/
Disallow /mailcast/
Disallow /printforecast/
Disallow /tides/
Disallow /clickcast/
Disallow /clearsky/
Disallow /snapshots/
Disallow /places/
Disallow /archives/
Disallow /autosearch/
Disallow /rivers-lakes/
Back to top

Other Records

Field Value
sitemap https://www.weatherforyou.com/sitemap.xml
sitemap https://www.weatherforyou.com/sitemap1.xml
sitemap https://www.weatherforyou.com/sitemap1avg1jan.xml
sitemap https://www.weatherforyou.com/sitemap1avg1feb.xml
sitemap https://www.weatherforyou.com/sitemap1avg1mar.xml
sitemap https://www.weatherforyou.com/sitemap1avg1apr.xml
sitemap https://www.weatherforyou.com/sitemap1avg1may.xml
sitemap https://www.weatherforyou.com/sitemap1avg1jun.xml
sitemap https://www.weatherforyou.com/sitemap1avg1jul.xml
sitemap https://www.weatherforyou.com/sitemap1avg1aug.xml
sitemap https://www.weatherforyou.com/sitemap1avg1sep.xml
sitemap https://www.weatherforyou.com/sitemap1avg1oct.xml
sitemap https://www.weatherforyou.com/sitemap1avg1nov.xml
sitemap https://www.weatherforyou.com/sitemap1avg1dec.xml
sitemap https://www.weatherforyou.com/sitemap1avg2jan.xml
sitemap https://www.weatherforyou.com/sitemap1avg2feb.xml
sitemap https://www.weatherforyou.com/sitemap1avg2mar.xml
sitemap https://www.weatherforyou.com/sitemap1avg2apr.xml
sitemap https://www.weatherforyou.com/sitemap1avg2may.xml
sitemap https://www.weatherforyou.com/sitemap1avg2jun.xml
sitemap https://www.weatherforyou.com/sitemap1avg2jul.xml
sitemap https://www.weatherforyou.com/sitemap1avg2aug.xml
sitemap https://www.weatherforyou.com/sitemap1avg2sep.xml
sitemap https://www.weatherforyou.com/sitemap1avg2oct.xml
sitemap https://www.weatherforyou.com/sitemap1avg2nov.xml
sitemap https://www.weatherforyou.com/sitemap1avg2dec.xml
sitemap https://www.weatherforyou.com/sitemap2.xml
sitemap https://www.weatherforyou.com/sitemap3.xml
sitemap https://www.weatherforyou.com/sitemap7.xml
sitemap https://www.weatherforyou.com/sitemap8.xml
sitemap https://www.weatherforyou.com/sitemap9.xml
sitemap https://www.weatherforyou.com/sitemap10.xml
sitemap https://www.weatherforyou.com/sitemap11.xml
sitemap https://www.weatherforyou.com/sitemap12.xml
sitemap https://www.weatherforyou.com/sitemap13.xml
sitemap https://www.weatherforyou.com/sitemap14.xml
sitemap https://www.weatherforyou.com/sitemap16.xml
sitemap https://www.weatherforyou.com/sitemap18.xml
sitemap https://www.weatherforyou.com/sitemap19.xml
sitemap https://www.weatherforyou.com/sitemap20.xml
Back to top