stage.astrology.com
robots.txt

Robots Exclusion Standard data for stage.astrology.com

Resource Scan

Scan Details

Site Domain stage.astrology.com
Base Domain astrology.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-10-11T05:10:35+00:00
Next Scan 2025-01-09T05:10:35+00:00

Last Successful Scan

Scanned2023-12-17T01:29:03+00:00
URL https://stage.astrology.com/robots.txt
Domain IPs 104.18.98.44, 104.18.99.44, 2606:4700::6812:622c, 2606:4700::6812:632c
Response IP 104.18.99.44
Found Yes
Hash fc1db13f84d9cb31a9cc31a524b6c464927fe356418b1b47a9db162771ac0def
SimHash a80cdef0c293

Groups

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://stage.astrology.com/sitemap.xml
sitemap https://stage.astrology.com/sitemap-news.xml