onion-net.com.tw
robots.txt

Robots Exclusion Standard data for onion-net.com.tw

Resource Scan

Scan Details

Site Domain onion-net.com.tw
Base Domain onion-net.com.tw
Scan Status Ok
Last Scan2025-10-04T10:05:50+00:00
Next Scan 2025-11-03T10:05:50+00:00

Last Scan

Scanned2025-10-04T10:05:50+00:00
URL https://onion-net.com.tw/robots.txt
Redirect https://www.onion-net.com.tw/robots.txt
Redirect Domain www.onion-net.com.tw
Redirect Base onion-net.com.tw
Domain IPs 104.26.4.152, 104.26.5.152, 172.67.74.249, 2606:4700:20::681a:498, 2606:4700:20::681a:598, 2606:4700:20::ac43:4af9
Redirect IPs 104.26.4.152, 104.26.5.152, 172.67.74.249, 2606:4700:20::681a:498, 2606:4700:20::681a:598, 2606:4700:20::ac43:4af9
Response IP 104.26.4.152
Found Yes
Hash deead3c748c5c00d9aabefcac13a83fbd9a736c23f373cb8cfee96d714ce7959
SimHash 6b1740d5c3b3

Groups

*

Rule Path
Disallow /ajax/

facebookexternalhit

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.onion-net.com.tw/sitemap.xml
sitemap https://www.onion-net.com.tw/news-sitemap.xml