Log In Sign Up

conwaylife.com
robots.txt

Robots Exclusion Standard data for conwaylife.com

Resource Scan

Scan Details

Site Domain conwaylife.com
Base Domain conwaylife.com
Scan Status Ok
Last Scan2024-11-04T09:14:03+00:00
Next Scan 2024-11-11T09:14:03+00:00

Last Scan

Scanned2024-11-04T09:14:03+00:00
URL https://conwaylife.com/robots.txt
Domain IPs 104.225.208.27
Response IP 104.225.208.27
Found Yes
Hash bc1d5f85996a9780d3427e6f978acae48adc4187d9292bc83024e1a05bdb66d0
SimHash 1a595d05f342

Groups

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

yandex

Rule Path
Disallow /forums/*
Disallow /wiki/*
Disallow /patterns/all.zip
Disallow /book/patterns/all.zip
Disallow /book/patterns/early_life/all.zip
Disallow /book/patterns/still_lifes/all.zip
Disallow /book/patterns/oscillators/all.zip
Disallow /book/patterns/spaceships/all.zip
Disallow /book/patterns/glider_synthesis/all.zip
Disallow /book/patterns/periodic_circuitry/all.zip
Disallow /book/patterns/stationary_circuitry/all.zip
Disallow /book/patterns/glider_guns/all.zip
Disallow /book/patterns/universal_computation/all.zip
Disallow /book/patterns/self_support_spaceships/all.zip
Disallow /book/patterns/universal_construction/all.zip
Disallow /book/patterns/0e0p/all.zip
Disallow /*.txt$
Disallow /*.mc$
Disallow /*.rle$
Disallow /*.zip$

Other Records

Field Value
crawl-delay 120

yandexbot

Rule Path
Disallow /forums/*
Disallow /wiki/*
Disallow /patterns/all.zip
Disallow /book/patterns/all.zip
Disallow /book/patterns/early_life/all.zip
Disallow /book/patterns/still_lifes/all.zip
Disallow /book/patterns/oscillators/all.zip
Disallow /book/patterns/spaceships/all.zip
Disallow /book/patterns/glider_synthesis/all.zip
Disallow /book/patterns/periodic_circuitry/all.zip
Disallow /book/patterns/stationary_circuitry/all.zip
Disallow /book/patterns/glider_guns/all.zip
Disallow /book/patterns/universal_computation/all.zip
Disallow /book/patterns/self_support_spaceships/all.zip
Disallow /book/patterns/universal_construction/all.zip
Disallow /book/patterns/0e0p/all.zip
Disallow /*.txt$
Disallow /*.mc$
Disallow /*.rle$
Disallow /*.zip$

Other Records

Field Value
crawl-delay 120

megaindex

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

brandwatch

Rule Path
Disallow /

applebot

Rule Path
Disallow /forums/posting.php
Disallow /patterns/all.zip
Disallow /book/patterns/all.zip
Disallow /book/patterns/early_life/all.zip
Disallow /book/patterns/still_lifes/all.zip
Disallow /book/patterns/oscillators/all.zip
Disallow /book/patterns/spaceships/all.zip
Disallow /book/patterns/glider_synthesis/all.zip
Disallow /book/patterns/periodic_circuitry/all.zip
Disallow /book/patterns/stationary_circuitry/all.zip
Disallow /book/patterns/glider_guns/all.zip
Disallow /book/patterns/universal_computation/all.zip
Disallow /book/patterns/self_support_spaceships/all.zip
Disallow /book/patterns/universal_construction/all.zip
Disallow /book/patterns/0e0p/all.zip
Disallow /*.txt$
Disallow /*.mc$
Disallow /*.rle$
Disallow /*.zip$

Other Records

Field Value
crawl-delay 120

petalbot

Rule Path
Disallow /forums/posting.php
Disallow /patterns/all.zip
Disallow /book/patterns/all.zip
Disallow /book/patterns/early_life/all.zip
Disallow /book/patterns/still_lifes/all.zip
Disallow /book/patterns/oscillators/all.zip
Disallow /book/patterns/spaceships/all.zip
Disallow /book/patterns/glider_synthesis/all.zip
Disallow /book/patterns/periodic_circuitry/all.zip
Disallow /book/patterns/stationary_circuitry/all.zip
Disallow /book/patterns/glider_guns/all.zip
Disallow /book/patterns/universal_computation/all.zip
Disallow /book/patterns/self_support_spaceships/all.zip
Disallow /book/patterns/universal_construction/all.zip
Disallow /book/patterns/0e0p/all.zip
Disallow /*.txt$
Disallow /*.mc$
Disallow /*.rle$
Disallow /*.zip$

Other Records

Field Value
crawl-delay 120

ahrefsbot

Rule Path
Disallow /book/conway_life_book.pdf
Disallow /forums/posting.php
Disallow /patterns/all.zip
Disallow /book/patterns/all.zip
Disallow /book/patterns/early_life/all.zip
Disallow /book/patterns/still_lifes/all.zip
Disallow /book/patterns/oscillators/all.zip
Disallow /book/patterns/spaceships/all.zip
Disallow /book/patterns/glider_synthesis/all.zip
Disallow /book/patterns/periodic_circuitry/all.zip
Disallow /book/patterns/stationary_circuitry/all.zip
Disallow /book/patterns/glider_guns/all.zip
Disallow /book/patterns/universal_computation/all.zip
Disallow /book/patterns/self_support_spaceships/all.zip
Disallow /book/patterns/universal_construction/all.zip
Disallow /book/patterns/0e0p/all.zip
Disallow /*.txt$
Disallow /*.mc$
Disallow /*.rle$
Disallow /*.zip$

Other Records

Field Value
crawl-delay 300

googlebot

Rule Path
Disallow /forums/posting.php
Disallow /*.txt$
Disallow /*.mc$
Disallow /*.rle$
Disallow /*.zip$

*

Rule Path
Disallow /forums/posting.php
Disallow /patterns/all.zip
Disallow /book/patterns/all.zip
Disallow /book/patterns/early_life/all.zip
Disallow /book/patterns/still_lifes/all.zip
Disallow /book/patterns/oscillators/all.zip
Disallow /book/patterns/spaceships/all.zip
Disallow /book/patterns/glider_synthesis/all.zip
Disallow /book/patterns/periodic_circuitry/all.zip
Disallow /book/patterns/stationary_circuitry/all.zip
Disallow /book/patterns/glider_guns/all.zip
Disallow /book/patterns/universal_computation/all.zip
Disallow /book/patterns/self_support_spaceships/all.zip
Disallow /book/patterns/universal_construction/all.zip
Disallow /book/patterns/0e0p/all.zip
Disallow /*.txt$
Disallow /*.mc$
Disallow /*.rle$
Disallow /*.zip$
Back to top