qc.rollingstone.com
robots.txt

Robots Exclusion Standard data for qc.rollingstone.com

Resource Scan

Scan Details

Site Domain qc.rollingstone.com
Base Domain rollingstone.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-13T12:07:37+00:00
Next Scan 2024-11-27T12:07:37+00:00

Last Successful Scan

Scanned2024-10-29T11:34:37+00:00
URL https://qc.rollingstone.com/robots.txt
Domain IPs 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91
Response IP 151.101.1.91
Found Yes
Hash d1cbea2bd00df9b7c849f529d746d894f8e4790455bdabed4fa24024517753cc
SimHash 280d88028993

Groups

*

Rule Path
Disallow /core/*
Disallow /r/*
Disallow /mnt/*

Other Records

Field Value
sitemap https://qc.rollingstone.com/sitemap.xml
sitemap https://qc.rollingstone.com/sitemap_news.xml
sitemap https://qc.rollingstone.com/sitemap_sections.xml
sitemap https://qc.rollingstone.com/sitemap_video.xml