vegasinsider.com
robots.txt

Robots Exclusion Standard data for vegasinsider.com

Resource Scan

Scan Details

Site Domain vegasinsider.com
Base Domain vegasinsider.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-23T11:41:41+00:00
Next Scan 2024-11-21T11:41:41+00:00

Last Successful Scan

Scanned2024-01-26T20:55:31+00:00
URL https://vegasinsider.com/robots.txt
Redirect https://www.vegasinsider.com/robots.txt
Redirect Domain www.vegasinsider.com
Redirect Base vegasinsider.com
Domain IPs 3.232.146.3, 52.1.135.89, 54.88.239.172
Redirect IPs 3.232.146.3, 52.1.135.89, 54.88.239.172
Response IP 54.88.239.172
Found Yes
Hash 74d27a4d02e5bda4b4d04a1c5666b5d0c0d97e6ee693b03362c12e0b2cadc65d
SimHash 4e65dc004313

Groups

*

Rule Path
Disallow /goto/
Disallow *shop.vegasinsider.com/*
Disallow *content.vegasinsider.com/*

Other Records

Field Value
sitemap https://www.vegasinsider.com/sitemap_index.xml
sitemap https://www.vegasinsider.com/rss/news.xml
sitemap https://www.vegasinsider.com/sitemap_news.xml