tilde.club
robots.txt

Robots Exclusion Standard data for tilde.club

Resource Scan

Scan Details

Site Domain tilde.club
Base Domain tilde.club
Scan Status Ok
Last Scan2024-10-02T00:40:50+00:00
Next Scan 2024-11-01T00:40:50+00:00

Last Scan

Scanned2024-10-02T00:40:50+00:00
URL https://tilde.club/robots.txt
Domain IPs 142.44.150.184, 2607:5300:203:b92b::115
Response IP 142.44.150.184
Found Yes
Hash aa4253f259f6bcb52071429773e85589aef6708bcabd10b1b9b40552763a224f
SimHash 831d05525fc8

Groups

mojeekbot

Rule Path
Allow /~xwindows/

qwantify

Rule Path
Allow /~xwindows/

wibybot

Rule Path
Allow /~xwindows/

search.marginalia.nu

Rule Path
Allow /~xwindows/

searchmysitebot

Rule Path
Allow /~xwindows/

duckduckbot

Rule Path
Allow /~xwindows/

ia_archiver

Rule Path
Allow /~xwindows/

googlebot

Rule Path
Allow /~xwindows/$
Allow /~xwindows/index.html$
Disallow /~xwindows/

bingbot

Rule Path
Allow /~xwindows/$
Allow /~xwindows/index.html$
Disallow /~xwindows/

yandexbot

Rule Path
Allow /~xwindows/$
Allow /~xwindows/index.html$
Disallow /~xwindows/

yandexfavicons

Rule Path
Disallow /~xwindows/

megaindex.ru

Rule Path
Disallow /~xwindows/

amazonbot

Rule Path
Disallow /~xwindows/

linespider

Rule Path
Disallow /~xwindows/

bytespider

Rule Path
Disallow /~xwindows/

ccbot

Rule Path
Disallow /~xwindows/

neevabot

Rule Path
Disallow /~xwindows/

petalbot

Rule Path
Disallow /~xwindows/

semrushbot

Rule Path
Disallow /~xwindows/

ahrefsbot

Rule Path
Disallow /~xwindows/

dataforseobot

Rule Path
Disallow /~xwindows/

dotbot

Rule Path
Disallow /~xwindows/

barkrowler

Rule Path
Disallow /~xwindows/

mj12bot

Rule Path
Disallow /~xwindows/

builtwith

Rule Path
Disallow /~xwindows/

webprosbot

Rule Path
Disallow /~xwindows/

dataprovider

Rule Path
Disallow /~xwindows/

*

Rule Path
Allow /~xwindows/$
Allow /~xwindows/index.html$
Disallow /~xwindows/