report.weatherlive.info
robots.txt

Robots Exclusion Standard data for report.weatherlive.info

Resource Scan

Scan Details

Site Domain report.weatherlive.info
Base Domain weatherlive.info
Scan Status Ok
Last Scan2024-06-11T19:19:15+00:00
Next Scan 2024-06-18T19:19:15+00:00

Last Scan

Scanned2024-06-11T19:19:15+00:00
URL https://report.weatherlive.info/robots.txt
Domain IPs 104.19.170.63, 104.19.171.63, 2606:4700::6813:aa3f, 2606:4700::6813:ab3f
Response IP 104.19.171.63
Found Yes
Hash 28201af1be3f4ff5960af97a0c1b5b32f64ffe7ae53de5b67022dfd2036477e8
SimHash b324b864ad03

Groups

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /bundles/
Disallow /static/
Disallow /admin.php
Disallow /admin_dev.php
Disallow /app_dev.php
Disallow /cc_docker.php
Disallow /debug.php
Disallow /debug_dev.php
Disallow /facebook.php
Disallow /flag
Disallow /foreca_radar_polygons.txt
Disallow /providers.php
Disallow /rate.txt
Disallow /ratefree.txt
Disallow /utc_now.php

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449