trending.com
robots.txt

Robots Exclusion Standard data for trending.com

Resource Scan

Scan Details

Site Domain trending.com
Base Domain trending.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan5/23/2025, 10:51:58 AM
Next Scan 7/22/2025, 10:51:58 AM

Last Successful Scan

Scanned3/25/2025, 10:43:11 AM
URL https://trending.com/robots.txt
Domain IPs 172.66.40.112, 172.66.43.144, 2606:4700:3108::ac42:2870, 2606:4700:3108::ac42:2b90
Response IP 172.66.43.144
Found Yes
Hash 58285a70bf1205ec417fc76e28d3ed9d89d451f5bf67f93dac481351f0f516c9
SimHash 1954c162cb91

Groups

*

Rule Path
Disallow

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

verity/1.1

Rule Path
Disallow /