3rdya.com
robots.txt

Robots Exclusion Standard data for 3rdya.com

Resource Scan

Scan Details

Site Domain 3rdya.com
Base Domain 3rdya.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-05-16T12:32:27+00:00
Next Scan 2025-08-14T12:32:27+00:00

Last Successful Scan

Scanned2023-04-05T08:59:11+00:00
URL https://3rdya.com/robots.txt
Domain IPs 104.21.72.73, 172.67.176.98, 2606:4700:3032::6815:4849, 2606:4700:3034::ac43:b062
Response IP 104.21.72.73
Found Yes
Hash 438a055e41ddcd4fc08e949b860058a6313820c8db7ef8e97cafac7d328b7171
SimHash 2814de925703

Groups

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

teoma

Rule Path
Disallow

nutch

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

baiduspider

Rule Path
Disallow

naverbot

Rule Path
Disallow

yeti

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

psbot

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://3rdya.com/sitemap.xml