Log In Sign Up

sorabji.com
robots.txt

Robots Exclusion Standard data for sorabji.com

Resource Scan

Scan Details

Site Domain sorabji.com
Base Domain sorabji.com
Scan Status Ok
Last Scan2024-10-04T13:11:06+00:00
Next Scan 2024-10-11T13:11:06+00:00

Last Scan

Scanned2024-10-04T13:11:06+00:00
URL https://sorabji.com/robots.txt
Domain IPs 158.69.224.10
Response IP 158.69.224.10
Found Yes
Hash 7ff83b3020a6f3b56ed5bad578f8fe30e11498e07fee5a7d0872519204463179
SimHash 081c674fdecc

Groups

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /receipts

the knowledge ai

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

ias_crawler

Rule Path
Disallow /

daum

Rule Path
Disallow /

*

Rule Path
Disallow /flaneur
Disallow /yo
Disallow /pictures
Disallow /foundphotos
Disallow /weather/?config
Disallow /weather/
Disallow /*.png$
Disallow /weather/images/hw3image/
Disallow /pictures/*.jpg$
Disallow /pictures/*/*.jpg$
Disallow /wanderlic/*.jpg$
Disallow /wanderlic/*/*.jpg$
Disallow /wanderlic/*.JPG$
Disallow /wanderlic/*/*.JPG$
Disallow /foundphotos/*.jpg$
Disallow /foundphotos/*/*.jpg$

linkdexbot/2.2

Rule Path
Disallow *

linkdexbot/2.1

Rule Path
Disallow *

linkdexbot/2.0

Rule Path
Disallow *

femtosearchbot

Rule Path
Disallow *

vegi bot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

urlappendbot

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

*

Rule Path
Disallow /mobi/
Disallow /c/cemeteries
Disallow /p/pictures/
Disallow /p/
Disallow /stalk/
Disallow /myfoundphotos/

*

Rule Path
Disallow /a/

*

Rule Path
Disallow /pictures/Typos/

*

Rule Path
Disallow /*--Warnings*.html
Disallow /*-Warnings*.html
Disallow /*AIRPORT-*.html
Disallow /*48-hour-forecast.html
Disallow /*?config*

genieo

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /weather

semrushbot

Rule Path
Disallow /pictures

integromedb

Rule Path
Disallow /

istellabot

Rule Path
Disallow /weather

meanpathbot

Rule Path
Disallow /

yyspider

Rule Path
Disallow /

psbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

integromedb

Rule Path
Disallow /

toscrawler

Rule Path
Disallow /

acoon

Rule Path
Disallow /

proximic

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

discoverybot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

sistrix

Rule Path
Disallow /

seoengbot

Rule Path
Disallow /

lemurwebcrawler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

covario-ids

Rule Path
Disallow /

yandex
yandexmobilebot

Rule Path
Disallow /

yandex

Rule Path
Disallow /pictures/

yandeximages

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /pictures/

yandexblogs

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

bender

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin
Disallow /m/1/
Disallow /1/
Disallow /m/mobile/
Disallow /bible/
Disallow /l/law/
Disallow /t/treo/
Disallow /d/dictionary/
Disallow /pictures/webcams/
Disallow /jazz/
Disallow /_/
Disallow /pictures/2000/
Disallow /weather/privacy.html
Disallow /zebra/
Disallow /pictures/Televisions/
Disallow /pictures/Panoramics/
Disallow /pictures/5057_Broadway/
Disallow /pictures/Canon_ELPH_APS/
Disallow /a/ads/
Disallow /weather/us/i/
Disallow /pictures/main.php/
Disallow /1/i/
Disallow /c/cds/

jikespider

Rule Path
Disallow /

blekkobot

Rule Path
Disallow /

*

Rule Path
Disallow /pictures/main.php?g2_view=core.UserAdmin*
Disallow /pictures/main.php?g2_view=comment*
Disallow /pictures/main.php?g2_view=slideshow*
Disallow /pictures/main.php?g2_view=map*
Disallow /pictures/main.php?g2_view=ecard*
Disallow /pictures/main.php?g2_controller=favourites*
Disallow /pictures/c/*
Disallow /pictures/key/*
Disallow /pictures/popular?*g2_page*
Disallow /pictures/updates?*g2_page*
Disallow /pictures/main.php?*g2_rating*
Disallow /pictures/admin*
Disallow /pictures/srss/
Disallow /pictures/rss
Disallow /pictures/*?$

bubing

Rule Path
Disallow /
Back to top

Comments

  • I like to think (and
  • the sooner the better!)
  • of a cybernetic meadow
  • where mammals and computers
  • live together in mutually
  • programming harmony
  • like pure water
  • touching clear sky.
  • I like to think
  • (right now, please!)
  • of a cybernetic forest
  • filled with pines and electronics
  • where deer stroll peacefully
  • past computers
  • as if they were flowers
  • with spinning blossoms.
  • I like to think
  • (it has to be!)
  • of a cybernetic ecology
  • where we are free of our labors
  • and joined back to nature,
  • returned to our mammal
  • brothers and sisters,
  • and all watched over
  • by machines of loving grace.
  • "All Watched Over by Machines of Loving Grace"
  • -Richard Brautigan, 1967
  • Disallow: /wayd/
Back to top

Warnings

  • 2 invalid lines.
Back to top