floor8.com
robots.txt

Robots Exclusion Standard data for floor8.com

Resource Scan

Scan Details

Site Domain floor8.com
Base Domain floor8.com
Scan Status Ok
Last Scan2024-11-02T11:49:08+00:00
Next Scan 2024-11-09T11:49:08+00:00

Last Scan

Scanned2024-11-02T11:49:08+00:00
URL https://floor8.com/robots.txt
Redirect https://www.floor8.com/robots.txt
Redirect Domain www.floor8.com
Redirect Base floor8.com
Domain IPs 35.83.190.225, 44.241.188.24
Redirect IPs 13.35.210.19, 13.35.210.40, 13.35.210.61, 13.35.210.94, 2600:9000:2816:2200:f:8f3b:1200:93a1, 2600:9000:2816:5800:f:8f3b:1200:93a1, 2600:9000:2816:6400:f:8f3b:1200:93a1, 2600:9000:2816:7a00:f:8f3b:1200:93a1, 2600:9000:2816:8e00:f:8f3b:1200:93a1, 2600:9000:2816:9a00:f:8f3b:1200:93a1, 2600:9000:2816:ca00:f:8f3b:1200:93a1, 2600:9000:2816:cc00:f:8f3b:1200:93a1
Response IP 13.35.210.61
Found Yes
Hash 0597cbe3b3af99893eaad5ca6bde311f92b3bd0b094e2673d88aa412bd1c3f7e
SimHash 815023146427

Groups

*

Rule Path
Disallow */xposts/

*

Rule Path
Disallow */reader/

*

Rule Path
Disallow /ads/

*

Rule Path
Disallow */editor/*
Disallow */posts/*/edit$

*

Rule Path
Disallow */posts/*/publish$

*

Rule Path
Disallow */singlepage/pipe/*
Disallow */singlepage/uncached_pipe/*
Disallow */singlepage/epipe/*

*

Rule Path
Disallow */reads/*/read$

*

Rule Path
Disallow /matches/
Disallow /es/partidos/
Disallow /it/partite/
Disallow /de/spiele/
Disallow /zh-CN/*

*

Rule Path
Disallow /ping
Disallow */sessions
Disallow */admin/*
Disallow */management
Disallow */castr
Disallow */unfeature$
Disallow */unfeature/*

*

Rule Path
Disallow /videos/
Allow /channels/videos/

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • allow adsense crawler access to all pages