flixxy.es
robots.txt

Robots Exclusion Standard data for flixxy.es

Resource Scan

Scan Details

Site Domain flixxy.es
Base Domain flixxy.es
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-11T21:16:01+00:00
Next Scan 2024-12-10T21:16:01+00:00

Last Successful Scan

Scanned2022-11-17T03:02:36+00:00
URL http://flixxy.es/robots.txt
Response IP 74.208.236.171
Found Yes
Hash 53b3c8073a7f8733749b463bca88b923d69d4a0e976b507db017898bfb2984c9
SimHash 6650d4e1731d

Groups

*

Rule Path
Disallow /olive/
Disallow /300x250.htm
Disallow /300x250alt.htm
Disallow /728x90alt.htm
Disallow /728x90omakasenoborder.htm
Disallow /noscript-message.htm
Disallow /error400.html
Disallow /error403.html
Disallow /error404.html
Disallow /error500.html

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 6

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 6

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 6

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 6

ssllabs

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 12

proximic

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2