popbuzz.com
robots.txt

Robots Exclusion Standard data for popbuzz.com

Resource Scan

Scan Details

Site Domain popbuzz.com
Base Domain popbuzz.com
Scan Status Ok
Last Scan2024-05-03T03:39:11+00:00
Next Scan 2024-05-10T03:39:11+00:00

Last Scan

Scanned2024-05-03T03:39:11+00:00
URL https://popbuzz.com/robots.txt
Redirect https://www.capitalfm.com/robots.txt
Redirect Domain www.capitalfm.com
Redirect Base capitalfm.com
Domain IPs 81.20.53.34
Redirect IPs 81.20.53.6
Response IP 81.20.53.6
Found Yes
Hash 30178fdbafbc485008b6d7cc75dd043ae58bcb885e2625937016b7d912a2197a
SimHash eeaadc498e8a

Groups

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /CapitalFM/
Disallow /pyoa/
Disallow /preview/
Disallow /search/
Disallow /london/search/
Disallow /nottinghamshire/search/
Disallow /leicestershire/search/
Disallow /derbyshire/search/
Disallow /birmingham/search/
Disallow /yorkshiresouthwest/search/
Disallow /yorkshireeast/search/
Disallow /manchester/search/
Disallow /teesside/search/
Disallow /tynewear/search/
Disallow /southwales/search/
Disallow /edinburgh/search/
Disallow /glasgow/search/
Disallow /southcoast/search/
Disallow /scotland/search/
Disallow /yorkshire/search/
Disallow /mobile/
Disallow /london/mobile/
Disallow /nottinghamshire/mobile/
Disallow /leicestershire/mobile/
Disallow /derbyshire/mobile/
Disallow /birmingham/mobile/
Disallow /yorkshiresouthwest/mobile/
Disallow /yorkshireeast/mobile/
Disallow /manchester/mobile/
Disallow /teesside/mobile/
Disallow /tynewear/mobile/
Disallow /southwales/mobile/
Disallow /edinburgh/mobile/
Disallow /glasgow/mobile/
Disallow /southcoast/mobile/
Disallow /scotland/mobile/
Disallow /yorkshire/mobile/
Disallow /digital/search/
Disallow /london/preview/
Disallow /eastmids/preview/
Disallow /nottinghamshire/preview/
Disallow /leicestershire/preview/
Disallow /derbyshire/preview/
Disallow /birmingham/preview/
Disallow /yorkshiresouthwest/preview/
Disallow /yorkshireeast/preview/
Disallow /manchester/preview/
Disallow /teesside/preview/
Disallow /tynewear/preview/
Disallow /southwales/preview/
Disallow /edinburgh/preview/
Disallow /glasgow/preview/
Disallow /scotland/preview/
Disallow /southcoast/preview/
Disallow /digital/preview/
Disallow /scotland/preview/
Disallow /yorkshire/preview/
Disallow /channel.html
Disallow /tv/player/
Disallow /*/radio/player/*

Other Records

Field Value
sitemap https://www.capitalfm.com/sitemap.xml
sitemap https://www.capitalfm.com/sitemap-news.xml
sitemap https://www.capitalfm.com/sitemap_category.xml