sceneflavor.com
robots.txt

Robots Exclusion Standard data for sceneflavor.com

Resource Scan

Scan Details

Site Domain sceneflavor.com
Base Domain sceneflavor.com
Scan Status Ok
Last Scan2024-11-17T20:28:51+00:00
Next Scan 2024-11-24T20:28:51+00:00

Last Scan

Scanned2024-11-17T20:28:51+00:00
URL https://sceneflavor.com/robots.txt
Domain IPs 108.160.152.63
Response IP 108.160.152.63
Found Yes
Hash 191775a90142d5b9b7c12cbeba8cb008d702e1ed50f8757fc677a10bb94f4c77
SimHash 31105b40d730

Groups

*

Rule Path
Disallow /maps/api/js/
Allow /maps/api/js
Disallow /maps/api/place/js/
Disallow /maps/api/staticmap
Disallow /maps/api/streetview

Other Records

Field Value
crawl-delay 60

adsbot-google

Rule Path
Disallow /maps/api/js/
Allow /maps/api/js
Disallow /maps/api/place/js/
Disallow /maps/api/staticmap
Disallow /maps/api/streetview