virginradiodubai.com
robots.txt

Robots Exclusion Standard data for virginradiodubai.com

Resource Scan

Scan Details

Site Domain virginradiodubai.com
Base Domain virginradiodubai.com
Scan Status Ok
Last Scan2024-05-31T13:33:32+00:00
Next Scan 2024-06-30T13:33:32+00:00

Last Scan

Scanned2024-05-31T13:33:32+00:00
URL https://virginradiodubai.com/robots.txt
Redirect https://www.virginradiodubai.com/robots.txt
Redirect Domain www.virginradiodubai.com
Redirect Base virginradiodubai.com
Domain IPs 34.250.153.99
Redirect IPs 18.164.154.20, 18.164.154.30, 18.164.154.51, 18.164.154.58
Response IP 18.165.171.17
Found Yes
Hash 86d65ecd936a036af9022e47003d862b58743c7b29682e18b5f05d0ead8473ac
SimHash 6b381c32ca12

Groups

*

Rule Path
Disallow /_hp/
Disallow /music/artist/
Disallow /en/music/artist/
Disallow /searchresults/

Other Records

Field Value
crawl-delay 8

Other Records

Field Value
sitemap https://www.virginradiodubai.com/sitemap.xml