vegas-expert.com
robots.txt

Robots Exclusion Standard data for vegas-expert.com

Resource Scan

Scan Details

Site Domain vegas-expert.com
Base Domain vegas-expert.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-03-17T01:57:00+00:00
Next Scan 2026-03-31T01:57:00+00:00

Last Successful Scan

Scanned2026-02-05T10:42:38+00:00
URL https://vegas-expert.com/robots.txt
Domain IPs 104.21.62.145, 172.67.136.170, 2606:4700:3031::6815:3e91, 2606:4700:3031::ac43:88aa
Response IP 104.21.62.145
Found Yes
Hash 6642d20ed23a254e8aa0065e2b5679fa8b24998dced9c9e4e3353b57c6b6a5dd
SimHash c235d470c073

Groups

ia_archiver

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

*

Rule Path
Disallow /*utm_
Disallow /views
Disallow /embedGame
Disallow /embeddedGame
Disallow /gameDetailIos
Disallow /authorize/*
Disallow /userReview/email/verify/*
Disallow /logout
Disallow /app/
Disallow /*.swf$
Disallow /exit
Disallow /exitb
Disallow /admin/*
Disallow /service/*
Disallow /frontendService/*
Disallow /external/*

Other Records

Field Value
sitemap https://vegas-expert.com/sitemap.xml