events.clevescene.com
robots.txt

Robots Exclusion Standard data for events.clevescene.com

Resource Scan

Scan Details

Site Domain events.clevescene.com
Base Domain clevescene.com
Scan Status Ok
Last Scan2024-04-19T22:43:16+00:00
Next Scan 2024-05-19T22:43:16+00:00

Last Scan

Scanned2024-04-19T22:43:16+00:00
URL https://events.clevescene.com/robots.txt
Domain IPs 108.160.152.63
Response IP 108.160.152.63
Found Yes
Hash 191775a90142d5b9b7c12cbeba8cb008d702e1ed50f8757fc677a10bb94f4c77
SimHash 31105b40d730

Groups

*

Rule Path
Disallow /maps/api/js/
Allow /maps/api/js
Disallow /maps/api/place/js/
Disallow /maps/api/staticmap
Disallow /maps/api/streetview

Other Records

Field Value
crawl-delay 60

adsbot-google

Rule Path
Disallow /maps/api/js/
Allow /maps/api/js
Disallow /maps/api/place/js/
Disallow /maps/api/staticmap
Disallow /maps/api/streetview