starsalert.com
robots.txt

Robots Exclusion Standard data for starsalert.com

Resource Scan

Scan Details

Site Domain starsalert.com
Base Domain starsalert.com
Scan Status Ok
Last Scan2024-11-14T03:33:02+00:00
Next Scan 2024-11-21T03:33:02+00:00

Last Scan

Scanned2024-11-14T03:33:02+00:00
URL https://starsalert.com/robots.txt
Domain IPs 185.56.234.12
Response IP 185.56.234.12
Found Yes
Hash ddb810aafc67537ba97ad5fef1349260cc1d89b0c33d7ce9300f803f7b45d304
SimHash 4d01d651c192

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /img/
Disallow /css/
Disallow /menu/
Disallow /news?id=*
Disallow /to/
Allow *.js
Allow *.css

yandex

Rule Path
Disallow /cgi-bin/
Disallow /img/
Disallow /css/
Disallow /menu/
Disallow /to/
Allow *.js
Allow *.css
Disallow /news?id=*

Other Records

Field Value
sitemap https://starsalert.com/sitemap.xml
sitemap https://starsalert.com/sitemap_latest.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.