onetrust.usmagazine.com
robots.txt

Robots Exclusion Standard data for onetrust.usmagazine.com

Resource Scan

Scan Details

Site Domain onetrust.usmagazine.com
Base Domain usmagazine.com
Scan Status Ok
Last Scan2024-06-09T10:23:47+00:00
Next Scan 2024-07-09T10:23:47+00:00

Last Scan

Scanned2024-06-09T10:23:47+00:00
URL https://onetrust.usmagazine.com/robots.txt
Domain IPs 192.0.66.2
Response IP 192.0.66.2
Found Yes
Hash 23de31d2ba50aa4c1c512227c2358ba5dda27948baca8fb3ed689fbf36f43726
SimHash 9a76e850d135

Groups

*

Rule Path
Disallow /search-results/
Disallow /search*
Disallow /*?_s=
Disallow /*?share=
Disallow /*/dick-van-dyke/celebrities/
Disallow /*/forever21.com/
Disallow /sso-dashboard.js
Disallow /article-preview/
Disallow /wp-json/
Disallow /_static/

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.usmagazine.com/sitemap.xml
sitemap https://www.usmagazine.com/feed/video-sitemap/
sitemap https://www.usmagazine.com/feed/gallery-sitemap/
sitemap https://www.usmagazine.com/feed/google-news-sitemap/
sitemap https://www.usmagazine.com/feed/review-sitemap/
sitemap https://www.usmagazine.com/authors-sitemap.xml

Comments

  • Sitemap archive
  • Video Sitemap
  • Gallery Sitemap
  • Google News Sitemap
  • Review Sitemap
  • Authors Sitemap
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK