api.classicfm.com
robots.txt

Robots Exclusion Standard data for api.classicfm.com

Resource Scan

Scan Details

Site Domain api.classicfm.com
Base Domain classicfm.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-03-23T07:43:05+00:00
Next Scan 2024-06-21T07:43:05+00:00

Last Successful Scan

Scanned2023-11-25T00:31:46+00:00
URL https://api.classicfm.com/robots.txt
Redirect https://www.classicfm.com/robots.txt
Redirect Domain www.classicfm.com
Redirect Base classicfm.com
Domain IPs 81.20.53.3
Redirect IPs 81.20.53.3
Response IP 81.20.53.3
Found Yes
Hash 3b5e5b8f7b60a23cb0ed373ab1291f301029536b00a044d6409c21dd2f49fd7b
SimHash ea00dc40ceb3

Groups

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /preview/
Disallow /mobile/
Disallow /radio/player/

Other Records

Field Value
sitemap https://www.classicfm.com/sitemap.xml