hackerspaces.org
robots.txt

Robots Exclusion Standard data for hackerspaces.org

Resource Scan

Scan Details

Site Domain hackerspaces.org
Base Domain hackerspaces.org
Scan Status Ok
Last Scan2024-06-13T16:03:28+00:00
Next Scan 2024-07-13T16:03:28+00:00

Last Scan

Scanned2024-06-13T16:03:28+00:00
URL https://hackerspaces.org/robots.txt
Domain IPs 212.12.52.48
Response IP 212.12.52.48
Found Yes
Hash 4e8f10d8959de132fb9b2c75ff60da5e1221d7dfa6da44867e75b49e1f78e877
SimHash 1a56114b8fc2

Groups

*

Rule Path
Disallow /w/
Disallow /wiki/Special%3ASearch
Disallow /wiki/Special%3ARandom
Disallow /wiki/Special%3AViewXML
Disallow /wiki/Special%3ASearchByProperty

semrush

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mbcrawler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrush*

Rule Path
Disallow /

semrush*

Rule Path
Disallow /

adsbot*

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

gowikibot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

wget

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

*

Rule Path
Allow /w/load.php?
Disallow /w/
Disallow /index.php/Semantic-mediawiki.org%3AAbout
Disallow /index.php?title=Semantic-mediawiki.org%3AAbout
Disallow /wiki/Semantic-mediawiki.org%3AAbout
Disallow /index.php/Impressum
Disallow /index.php?title=Impressum
Disallow /wiki/Impressum
Disallow /wiki/Talk%3A
Disallow /wiki/Talk%3A
Disallow /wiki/User_talk%3A
Disallow /wiki/User_talk%3A
Disallow /wiki/Semantic-mediawiki.org_talk%3A
Disallow /wiki/Semantic-mediawiki.org_talk%3A
Disallow /wiki/File_talk%3A
Disallow /wiki/File_talk%3A
Disallow /wiki/MediaWiki%3A
Disallow /wiki/MediaWiki%3A
Disallow /wiki/MediaWiki_talk%3A
Disallow /wiki/MediaWiki_talk%3A
Disallow /wiki/Template%3A
Disallow /wiki/Template%3A
Disallow /wiki/Template_talk%3A
Disallow /wiki/Template_talk%3A
Disallow /wiki/Property_talk%3A
Disallow /wiki/Property_talk%3A
Disallow /wiki/Form_talk%3A
Disallow /wiki/Form_talk%3A
Disallow /wiki/Concept_talk%3A
Disallow /wiki/Concept_talk%3A
Disallow /wiki/smw/schema_talk%3A
Disallow /wiki/smw/schema_talk%3A
Disallow /wiki/Rule_talk%3A
Disallow /wiki/Rule_talk%3A
Disallow /wiki/Print%3A
Disallow /wiki/Print%3A
Disallow /wiki/Print_talk%3A
Disallow /wiki/Print_talk%3A
Disallow /wiki/Demo_talk%3A
Disallow /wiki/Demo_talk%3A
Disallow /wiki/Extension_talk%3A
Disallow /wiki/Extension_talk%3A
Disallow /wiki/Meta%3A
Disallow /wiki/Meta%3A
Disallow /wiki/Meta_talk%3A
Disallow /wiki/Meta_talk%3A
Disallow /wiki/Archive_talk%3A
Disallow /wiki/Archive_talk%3A
Disallow /wiki/Site_talk%3A
Disallow /wiki/Site_talk%3A
Disallow /wiki/Support_talk%3A
Disallow /wiki/Support_talk%3A
Disallow /wiki/Widget_talk%3A
Disallow /wiki/Widget_talk%3A
Disallow /wiki/GeoJson_talk%3A
Disallow /wiki/GeoJson_talk%3A
Disallow /wiki/Module_talk%3A
Disallow /wiki/Module_talk%3A
Disallow /wiki/Translations_talk%3A
Disallow /wiki/Translations_talk%3A
Disallow /wiki/Gadget_talk%3A
Disallow /wiki/Gadget_talk%3A
Disallow /wiki/Gadget_defintion%3A
Disallow /wiki/Gadget_defintion%3A
Disallow /wiki/Gadget_defintion_talk%3A
Disallow /wiki/Gadget_defintion_talk%3A
Disallow /wiki/Special%3A
Disallow /wiki/Special%3A

Comments

  • via totalism.org
  • https://www.semantic-mediawiki.org/robots.txt
  • (only removed "sitemap")
  • robots.txt for https://www.semantic-mediawiki.org
  • Single pages
  • Talk
  • User talk
  • Project talk
  • File talk
  • MediaWiki and MediaWiki talk
  • Template and Template talk
  • Property talk
  • Form talk
  • Concept talk
  • smw/schema talk
  • Rule talk
  • Print and print talk
  • Demo talk
  • Extension talk
  • Meta and Meta talk
  • Archive talk
  • Site talk
  • Support talk
  • Widget talk
  • GeoJson talk
  • Module talk
  • Translations talk
  • Gadget talk
  • Gadget defintion and Gadget defintion talk
  • Special pages
  • fin