backtail.tw
robots.txt

Robots Exclusion Standard data for backtail.tw

Resource Scan

Scan Details

Site Domain backtail.tw
Base Domain backtail.tw
Scan Status Ok
Last Scan2025-04-04T04:53:06+00:00
Next Scan 2025-05-04T04:53:06+00:00

Last Scan

Scanned2025-04-04T04:53:06+00:00
URL https://backtail.tw/robots.txt
Domain IPs 104.21.25.251, 172.67.134.244, 2606:4700:3032::ac43:86f4, 2606:4700:3034::6815:19fb
Response IP 104.21.25.251
Found Yes
Hash f390857b1280c9c59af6752d7dd065546341bddd862eaabe782c8e53fe29d05d
SimHash d81414024390

Groups

*

Rule Path
Disallow /embed/*

semrushbot

Rule Path
Disallow *

sogou

Rule Path
Disallow *

scrapy

Rule Path
Disallow *

bytespider

Rule Path
Disallow *