citieweb.com
robots.txt

Robots Exclusion Standard data for citieweb.com

Resource Scan

Scan Details

Site Domain citieweb.com
Base Domain citieweb.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-13T06:07:56+00:00
Next Scan 2025-08-11T06:07:56+00:00

Last Successful Scan

Scanned2024-01-20T06:04:43+00:00
URL https://citieweb.com/robots.txt
Domain IPs 104.243.32.71
Response IP 104.243.32.71
Found Yes
Hash 16d90aa2695c14a2dc7e240373d739c6e82d69c0a2b324088bbf89d2d28c406e
SimHash 680cc156c033

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://citieweb.com/sitemap-index.xml
sitemap https://citieweb.com/sitemap-index-1.xml
sitemap https://citieweb.com/sitemap.xml