news-fr.hometalk.com
robots.txt

Robots Exclusion Standard data for news-fr.hometalk.com

Resource Scan

Scan Details

Site Domain news-fr.hometalk.com
Base Domain hometalk.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-29T23:11:06+00:00
Next Scan 2024-06-27T23:11:06+00:00

Last Successful Scan

Scanned2023-12-01T22:53:39+00:00
URL https://news-fr.hometalk.com/robots.txt
Domain IPs 104.22.6.219, 104.22.7.219, 172.67.39.159, 2606:4700:10::6816:6db, 2606:4700:10::6816:7db, 2606:4700:10::ac43:279f
Response IP 104.22.6.219
Found Yes
Hash 343f83716fa92fd74569d4a31e32adb2ef849cada46d12dd390c94c86a0c1a07
SimHash 01459a60c711

Groups

adsbot-google

Rule Path
Disallow

grapeshot

Rule Path
Disallow

gptbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.hometalk.com/sitemap.xml