citysnap.com
robots.txt

Robots Exclusion Standard data for citysnap.com

Resource Scan

Scan Details

Site Domain citysnap.com
Base Domain citysnap.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2024-09-16T13:02:25+00:00
Next Scan 2024-11-15T13:02:25+00:00

Last Successful Scan

Scanned2024-07-12T13:01:39+00:00
URL https://citysnap.com/robots.txt
Redirect https://www.citysnap.com/robots.txt
Redirect Domain www.citysnap.com
Redirect Base citysnap.com
Domain IPs 34.237.214.79, 35.173.175.118, 54.237.1.167
Redirect IPs 23.215.7.21, 23.215.7.9, 2600:1413:b000:1b::17d7:709, 2600:1413:b000:1b::17d7:715
Response IP 23.59.168.152
Found Yes
Hash ee695d3fcd978dbca5cb6871672baabf6c38e9828522f2091eaf2caa0066ca60
SimHash 40c5cc51c531

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

applebot

Rule Path
Disallow

*

Rule Path
Allow /
Allow /action?*a=10*
Disallow /*/mortgage$
Disallow /*/pdf$
Disallow /*/similar$
Disallow /*/similar/sold$
Disallow /*/tour$
Disallow /*/tour/*-*$
Disallow /my_homesnap/*
Disallow /classifieds/*
Disallow /news_feed/*
Disallow /market_guide/*
Disallow /mortgage_rates/*
Disallow /sold/*
Disallow /service/*
Disallow /*/checklist$
Disallow /action*
Disallow /pixel.js*
Disallow /*/website*
Disallow /pro/ads/*/report/*?*&hash=*
Disallow /pro/ads/*/report?*&hash=*
Disallow /pro/ads/*?*&hash=*
Disallow /pro/ads/report?*&hash=*
Disallow /pro/plus/report?*&hash=*
Disallow /pro/plus/*?*&hash=*
Disallow /pro/waze/report/*?*&hash=*

Other Records

Field Value
sitemap https://www.citysnap.com/sitemap.xml