Log In Sign Up

goillusions.com
robots.txt

Robots Exclusion Standard data for goillusions.com

Resource Scan

Scan Details

Site Domain goillusions.com
Base Domain goillusions.com
Scan Status Ok
Last Scan2025-03-28T14:52:24+00:00
Next Scan 2025-04-04T14:52:24+00:00

Last Scan

Scanned2025-03-28T14:52:24+00:00
URL https://goillusions.com/robots.txt
Redirect https://www.goillusions.com/robots.txt
Redirect Domain www.goillusions.com
Redirect Base goillusions.com
Domain IPs 104.21.26.61, 172.67.135.144, 2606:4700:3031::ac43:8790, 2606:4700:3035::6815:1a3d
Redirect IPs 104.21.26.61, 172.67.135.144, 2606:4700:3031::ac43:8790, 2606:4700:3035::6815:1a3d
Response IP 104.21.26.61
Found Yes
Hash 46602f97ea8f468f676c098cf97adbe377502e3c78989994fbe7747ed1fa07db
SimHash 2b5349e9cd62

Groups

ia_archiver

Rule Path
Allow /

teoma

Rule Path
Allow /

msnbot

Rule Path
Allow /

googlebot

Rule Path
Allow /

slurp

Rule Path
Allow /

abachobot

Rule Path
Allow /

abcdatos botlink

Rule Path
Allow /

cabot

Rule Path
Allow /

amibot

Rule Path
Allow /

aspseek

Rule Path
Allow /

findlinks

Rule Path
Allow /

baiduspider

Rule Path
Allow /

becomebot

Rule Path
Allow /

bigcliquebot

Rule Path
Allow /

bigmirspider

Rule Path
Allow /

confuzzledbot

Rule Path
Allow /

boitho.com-dc

Rule Path
Allow /

pompos

Rule Path
Allow /

kit-fireball

Rule Path
Allow /

fyberspider

Rule Path
Allow /

galaxybot

Rule Path
Allow /

geonabot

Rule Path
Allow /

goforitbot

Rule Path
Allow /

http://www.almaden.ibm.com/cs/crawler

Rule Path
Allow /

irlbot

Rule Path
Allow /

localcombot

Rule Path
Allow /

mj12bot

Rule Path
Allow /

heinrichdermiragorobot

Rule Path
Allow /

holmes

Rule Path
Allow /

omniexplorer_bot

Rule Path
Allow /

psbot

Rule Path
Allow /

sitidibot

Rule Path
Allow /

spidermonkey

Rule Path
Allow /

sygolbot

Rule Path
Allow /

szukacz

Rule Path
Allow /

turnitinbot

Rule Path
Allow /

voilabot

Rule Path
Allow /

appie

Rule Path
Allow /

bruinbot

Rule Path
Allow /

yandex

Rule Path
Allow /

*

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://www.goillusions.com/sitemap.xml
Back to top

Comments

  • Alexa
  • Ask
  • Bing
  • Google
  • Yahoo!
  • Abacho
  • ABCdatos.com
  • Amfibi
  • Amidalla
  • ASPseek.com
  • Automatischen Sprachverarbeitung
  • Baidu
  • Become.com
  • BigClique
  • Bigmir.net
  • Blue.lu
  • Boitho
  • dir.com
  • Fireball
  • FyberSearch
  • Galaxy
  • Geona
  • GoForIt
  • IBM
  • IRL
  • Local.com
  • Majestic-12
  • Mirago.de
  • Morfeo / Centrum
  • Omni-Explorer
  • Picsearch
  • SitiDi.net
  • SpiderMonkey
  • Sygol
  • Szukacz
  • Turnitin.com
  • Voila.fr
  • Walhello
  • WebArchive
  • Yandex
  • Others
Back to top