hot1039fm.com
robots.txt

Robots Exclusion Standard data for hot1039fm.com

Resource Scan

Scan Details

Site Domain hot1039fm.com
Base Domain hot1039fm.com
Scan Status Ok
Last Scan2024-07-03T10:08:59+00:00
Next Scan 2024-07-10T10:08:59+00:00

Last Scan

Scanned2024-07-03T10:08:59+00:00
URL https://hot1039fm.com/robots.txt
Redirect https://www.hot1039fm.com/?robots=1
Redirect Domain www.hot1039fm.com
Redirect Base hot1039fm.com
Domain IPs 104.21.3.96, 172.67.153.124, 2606:4700:3031::6815:360, 2606:4700:3034::ac43:997c
Redirect IPs 104.21.3.96, 172.67.153.124, 2606:4700:3031::6815:360, 2606:4700:3034::ac43:997c
Response IP 104.21.3.96
Found Yes
Hash acf4e7c54b814ce03f53b6e2913fa26d516b7a49e75905cafaa5048cd25b47c1
SimHash 61095c90a795

Groups

twitterbot

Rule Path
Disallow /calendar/action*
Disallow /events/action*
Disallow /wp-admin
Disallow /wp-login.php
Allow /wp-admin/admin-ajax.php
Allow /wp-content/themes/blacklab/assets/*?
Allow /syndicated-article/*?

Other Records

Field Value
crawl-delay 30

facebookexternalhit

Rule Path
Allow *

*

Rule Path
Disallow /calendar/action*
Disallow /events/action*
Disallow /wp-admin
Disallow /syndicated-article/*?
Disallow /wp-login.php
Allow /wp-admin/admin-ajax.php
Allow /wp-content/themes/blacklab/assets/*?

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.hot1039fm.com/sitemap.xml