songlyrics.fi
robots.txt

Robots Exclusion Standard data for songlyrics.fi

Resource Scan

Scan Details

Site Domain songlyrics.fi
Base Domain songlyrics.fi
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-26T18:47:57+00:00
Next Scan 2024-11-24T18:47:57+00:00

Last Successful Scan

Scanned2023-08-03T17:28:16+00:00
URL https://songlyrics.fi/robots.txt
Domain IPs 104.26.10.29, 104.26.11.29, 172.67.71.76, 2606:4700:20::681a:a1d, 2606:4700:20::681a:b1d, 2606:4700:20::ac43:474c
Response IP 104.26.10.29
Found Yes
Hash 88df6f5ee93c0acd7fca555ec3fc0c8680c6c0a3489cfd2cea0e992e70f6d852
SimHash 68445d15d194

Groups

googlebot

Rule Path
Disallow

slurp

Rule Path
Disallow

msnbot

Rule Path
Disallow

twitterbot

Rule Path
Disallow

googlebot

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

adsbot-google-mobile

Rule Path
Disallow

adsbot-google-mobile-apps

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.songlyrics.fi/sitemap.php