feed2know.com
robots.txt

Robots Exclusion Standard data for feed2know.com

Resource Scan

Scan Details

Site Domain feed2know.com
Base Domain feed2know.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-07T02:19:48+00:00
Next Scan 2025-06-05T02:19:48+00:00

Last Successful Scan

Scanned2024-01-19T14:50:16+00:00
URL https://feed2know.com/robots.txt
Domain IPs 104.21.71.95, 172.67.144.91, 2606:4700:3035::ac43:905b, 2606:4700:3037::6815:475f
Response IP 172.67.144.91
Found Yes
Hash 894aee9ad76754025ffdb24214c53557fb6d1e877e4a7cb775bc57c25823f9d6
SimHash d05dd340e790

Groups

*

Rule Path
Disallow
Disallow /index.php?m=api*
Disallow /template/*

semrushbot

Rule Path
Disallow /

my-tiny-bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /