usmagazine-develop.go-vip.co
robots.txt

Robots Exclusion Standard data for usmagazine-develop.go-vip.co

Resource Scan

Scan Details

Site Domain usmagazine-develop.go-vip.co
Base Domain go-vip.co
Scan Status Ok
Last Scan2024-05-23T17:49:02+00:00
Next Scan 2024-06-22T17:49:02+00:00

Last Scan

Scanned2024-05-23T17:49:02+00:00
URL https://usmagazine-develop.go-vip.co/robots.txt
Domain IPs 192.0.66.2
Response IP 192.0.66.2
Found Yes
Hash 405a57beeb4771ff5187cc88171e06b218876ed555e0f278184e07d832eddcf4
SimHash fa5678541073

Groups

*

Rule Path
Disallow /

*

Rule Path
Disallow /search-results/
Disallow /search*
Disallow /*?_s=
Disallow /*?share=
Disallow /*/dick-van-dyke/celebrities/
Disallow /*/forever21.com/
Disallow /sso-dashboard.js
Disallow /article-preview/
Disallow /wp-json/
Disallow /_static/

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://usmagazine-develop.go-vip.co/feed/video-sitemap/
sitemap https://usmagazine-develop.go-vip.co/feed/gallery-sitemap/
sitemap https://usmagazine-develop.go-vip.co/feed/google-news-sitemap/
sitemap https://usmagazine-develop.go-vip.co/feed/review-sitemap/
sitemap https://usmagazine-develop.go-vip.co/authors-sitemap.xml

Comments

  • Crawling is blocked for go-vip.co and go-vip.net domains
  • Video Sitemap
  • Gallery Sitemap
  • Google News Sitemap
  • Review Sitemap
  • Authors Sitemap
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK