semantic-mediawiki.org
robots.txt

Robots Exclusion Standard data for semantic-mediawiki.org

Resource Scan

Scan Details

Site Domain semantic-mediawiki.org
Base Domain semantic-mediawiki.org
Scan Status Ok
Last Scan2024-09-07T21:26:05+00:00
Next Scan 2024-10-07T21:26:05+00:00

Last Scan

Scanned2024-09-07T21:26:05+00:00
URL https://semantic-mediawiki.org/robots.txt
Redirect https://www.semantic-mediawiki.org/robots.txt
Redirect Domain www.semantic-mediawiki.org
Redirect Base semantic-mediawiki.org
Domain IPs 116.203.61.64
Redirect IPs 116.203.61.64
Response IP 116.203.61.64
Found Yes
Hash 9bcf60fb14380e0f1e5a30e2971a75b274ff034de792c2ebd0298e31fa4de422
SimHash 1a5e114b8ed2

Groups

wget

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

*

Rule Path
Allow /w/load.php?
Disallow /w/
Disallow /index.php/Semantic-mediawiki.org%3AAbout
Disallow /index.php?title=Semantic-mediawiki.org%3AAbout
Disallow /wiki/Semantic-mediawiki.org%3AAbout
Disallow /index.php/Impressum
Disallow /index.php?title=Impressum
Disallow /wiki/Impressum
Disallow /wiki/Talk%3A
Disallow /wiki/Talk%3A
Disallow /wiki/User_talk%3A
Disallow /wiki/User_talk%3A
Disallow /wiki/Semantic-mediawiki.org_talk%3A
Disallow /wiki/Semantic-mediawiki.org_talk%3A
Disallow /wiki/File_talk%3A
Disallow /wiki/File_talk%3A
Disallow /wiki/MediaWiki%3A
Disallow /wiki/MediaWiki%3A
Disallow /wiki/MediaWiki_talk%3A
Disallow /wiki/MediaWiki_talk%3A
Disallow /wiki/Template%3A
Disallow /wiki/Template%3A
Disallow /wiki/Template_talk%3A
Disallow /wiki/Template_talk%3A
Disallow /wiki/Property_talk%3A
Disallow /wiki/Property_talk%3A
Disallow /wiki/Form_talk%3A
Disallow /wiki/Form_talk%3A
Disallow /wiki/Concept_talk%3A
Disallow /wiki/Concept_talk%3A
Disallow /wiki/smw/schema_talk%3A
Disallow /wiki/smw/schema_talk%3A
Disallow /wiki/Rule_talk%3A
Disallow /wiki/Rule_talk%3A
Disallow /wiki/Print%3A
Disallow /wiki/Print%3A
Disallow /wiki/Print_talk%3A
Disallow /wiki/Print_talk%3A
Disallow /wiki/Demo_talk%3A
Disallow /wiki/Demo_talk%3A
Disallow /wiki/Extension_talk%3A
Disallow /wiki/Extension_talk%3A
Disallow /wiki/Meta%3A
Disallow /wiki/Meta%3A
Disallow /wiki/Meta_talk%3A
Disallow /wiki/Meta_talk%3A
Disallow /wiki/Archive_talk%3A
Disallow /wiki/Archive_talk%3A
Disallow /wiki/Site_talk%3A
Disallow /wiki/Site_talk%3A
Disallow /wiki/Support_talk%3A
Disallow /wiki/Support_talk%3A
Disallow /wiki/Widget_talk%3A
Disallow /wiki/Widget_talk%3A
Disallow /wiki/GeoJson_talk%3A
Disallow /wiki/GeoJson_talk%3A
Disallow /wiki/Module_talk%3A
Disallow /wiki/Module_talk%3A
Disallow /wiki/Translations_talk%3A
Disallow /wiki/Translations_talk%3A
Disallow /wiki/Gadget_talk%3A
Disallow /wiki/Gadget_talk%3A
Disallow /wiki/Gadget_defintion%3A
Disallow /wiki/Gadget_defintion%3A
Disallow /wiki/Gadget_defintion_talk%3A
Disallow /wiki/Gadget_defintion_talk%3A
Disallow /wiki/Special%3A
Disallow /wiki/Special%3A

Other Records

Field Value
sitemap https://www.semantic-mediawiki.org/s/sitemap-index-semantic-mediawiki.xml

Comments

  • robots.txt for https://www.semantic-mediawiki.org
  • Single pages
  • Talk
  • User talk
  • Project talk
  • File talk
  • MediaWiki and MediaWiki talk
  • Template and Template talk
  • Property talk
  • Form talk
  • Concept talk
  • smw/schema talk
  • Rule talk
  • Print and print talk
  • Demo talk
  • Extension talk
  • Meta and Meta talk
  • Archive talk
  • Site talk
  • Support talk
  • Widget talk
  • GeoJson talk
  • Module talk
  • Translations talk
  • Gadget talk
  • Gadget defintion and Gadget defintion talk
  • Special pages