ufcvip.com
robots.txt

Robots Exclusion Standard data for ufcvip.com

Resource Scan

Scan Details

Site Domain ufcvip.com
Base Domain ufcvip.com
Scan Status Ok
Last Scan2024-05-15T18:54:27+00:00
Next Scan 2024-06-14T18:54:27+00:00

Last Scan

Scanned2024-05-15T18:54:27+00:00
URL https://ufcvip.com/robots.txt
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 151.101.130.132
Found Yes
Hash 545b91a7dbe4acdebe3281cdbe1ea1a0a38ec9d65b5b95a4b68e10a5abade8cd
SimHash c90f3441ce76

Groups

semrushbot-sa

Rule Path
Disallow /?
Disallow /e/

semrushbot

Rule Path
Disallow /?
Disallow /e/

rogerbot

Rule Path
Disallow /?

dotbot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /p/
Disallow /e/
Disallow /v/
Disallow /whereami
Disallow /search
Disallow /tp/
Disallow /r/
Disallow /account/
Disallow /checkout/

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Disallow /p/
Disallow /e/
Disallow /v/
Disallow /whereami
Disallow /search
Disallow /tp/
Disallow /r/
Disallow /account/
Disallow /checkout/

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /whereami
Disallow /search
Disallow /tp/
Disallow /account/
Disallow /checkout/
Disallow /e/concert/
Disallow /e/theatre/
Disallow /*--test--*

Other Records

Field Value
sitemap https://ufcvip.com/sitemap.xml
sitemap https://ufcvip.com/sitemap.xml
sitemap https://ufcvip.com/sitemap.xml

Comments

  • robots.txt for ufcvip.com