jog.fm
robots.txt
Robots Exclusion Standard data for jog.fm
Resource Scan
Scan Details
Site Domain | jog.fm |
Base Domain | jog.fm |
Scan Status | Ok |
Last Scan | 2024-11-03T03:19:35+00:00 |
Next Scan | 2024-11-10T03:19:35+00:00 |
Last Scan
Scanned | 2024-11-03T03:19:35+00:00 |
URL | https://jog.fm/robots.txt |
Domain IPs | 104.21.4.120, 172.67.132.13, 2606:4700:3031::ac43:840d, 2606:4700:3037::6815:478 |
Response IP | 104.21.4.120 |
Found | Yes |
Hash | 36d1f060e192fb7b5e01a14fff1e1223fc734ec5e3390224bbda9b185028db14 |
SimHash | aa948b8db760 |
Groups
*
Rule | Path |
---|---|
Disallow | /units/metric/ |
Disallow | /auth/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Comments