gramps-project.org
robots.txt

Robots Exclusion Standard data for gramps-project.org

Resource Scan

Scan Details

Site Domain gramps-project.org
Base Domain gramps-project.org
Scan Status Ok
Last Scan2024-09-19T10:43:00+00:00
Next Scan 2024-10-19T10:43:00+00:00

Last Scan

Scanned2024-09-19T10:43:00+00:00
URL https://gramps-project.org/robots.txt
Domain IPs 104.21.38.78, 172.67.220.23, 2606:4700:3035::ac43:dc17, 2606:4700:3036::6815:264e
Response IP 172.67.220.23
Found Yes
Hash d2781065d8528560b606f195bcbb973663c5ee38892c110f9cecf781d2afe711
SimHash 626a49c8ece0

Groups

*

Rule Path
Disallow /bugs/
Disallow /cgi-bin/
Disallow /download/
Disallow /cdrom
Disallow /apple
Disallow /files/
Disallow /library/
Disallow /samples/
Disallow /docs/
Disallow /xml/
Disallow /wiki/index.php?diff=
Disallow /wiki/index.php?oldid=
Disallow /wiki/index.php?title=Help
Disallow /wiki/index.php?title=Image
Disallow /wiki/index.php?title=MediaWiki
Disallow /wiki/index.php?title=Special%3A
Disallow /wiki/index.php?title=Template
Disallow /wiki/index.php?limit=
Disallow /wiki/skins/
Disallow /wiki/index.php/Gramps_5.0*
Disallow /wiki/index.php/*%3AGramps_5.0*
Disallow /wiki/index.php/Gramps_4.*
Disallow /wiki/index.php/*%3AGramps_4.*
Disallow /wiki/index.php/Gramps_3.*
Disallow /wiki/index.php/*%3AGramps_3.*
Disallow /wiki/index.php/Gramps_2.*
Disallow /wiki/index.php/*%3AGramps_2.*

turnitinbot/2.0

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

webmeup

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot/1.1

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fyberspider

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

Comments

  • Robots.txt file created by Trevor Rhodes 30 May 2006
  • Modified by Nick Wallingford 27 June 2011
  • Modified by Brian McCullough 7 October 2020
  • For domain: https://www.gramps-project.org
  • All robots will spider the domain
  • Testing to ban all robots and crawlers
  • User-agent: *
  • Disallow: /

Warnings

  • 2 invalid lines.