city-space.com
robots.txt

Robots Exclusion Standard data for city-space.com

Resource Scan

Scan Details

Site Domain city-space.com
Base Domain city-space.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-18T01:37:10+00:00
Next Scan 2025-01-16T01:37:10+00:00

Last Successful Scan

Scanned2024-05-29T01:32:46+00:00
URL https://city-space.com/robots.txt
Redirect https://www.city-space.com/robots.txt
Redirect Domain www.city-space.com
Redirect Base city-space.com
Domain IPs 108.157.254.108, 108.157.254.115, 108.157.254.36, 108.157.254.99
Redirect IPs 108.157.254.108, 108.157.254.115, 108.157.254.36, 108.157.254.99
Response IP 108.157.254.108
Found Yes
Hash 43b9f73d8c4e9a9ccf6c35edee19f08f0f2b4889ea80b8bc8bd8c123ff4d1b82
SimHash 6904dc864290

Groups

*

Rule Path
Disallow /admin/
Disallow /webhook/
Disallow /*.php

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.city-space.com/sitemap.xml