spyine.com
robots.txt

Robots Exclusion Standard data for spyine.com

Resource Scan

Scan Details

Site Domain spyine.com
Base Domain spyine.com
Scan Status Ok
Last Scan2025-03-23T10:55:53+00:00
Next Scan 2025-04-22T10:55:53+00:00

Last Scan

Scanned2025-03-23T10:55:53+00:00
URL https://spyine.com/robots.txt
Domain IPs 104.21.85.139, 172.67.206.111, 2606:4700:3034::6815:558b, 2606:4700:3037::ac43:ce6f
Response IP 104.21.85.139
Found Yes
Hash f7eda132a38481de8df2dca6f63912056e29e131681a3a367ad2509a9e0bc1db
SimHash 097457d02b75

Groups

baiduspider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /demo
Disallow /support
Disallow /control
Disallow /wp-admin
Disallow /wp-content/cache
Disallow /*?filter_by*
Disallow */feed/*

Warnings

  • 2 invalid lines.