Log In Sign Up

librarytechnology.org
robots.txt

Robots Exclusion Standard data for librarytechnology.org

Resource Scan

Scan Details

Site Domain librarytechnology.org
Base Domain librarytechnology.org
Scan Status Ok
Last Scan2024-11-16T12:31:30+00:00
Next Scan 2024-12-16T12:31:30+00:00

Last Scan

Scanned2024-11-16T12:31:30+00:00
URL https://librarytechnology.org/robots.txt
Domain IPs 64.150.187.62
Response IP 64.150.187.62
Found Yes
Hash a878d6c605b783562ddc1a988db5aa1bb937370e9a8ff894c02193f6817f0afa
SimHash fb045332e8a0

Groups

gptbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

scooperbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

domcopbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

semantic-visions

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

*

Rule Path
Disallow /messages/send.pl
Disallow /libraries/map.pl
Disallow /map.pl
Disallow /displayindex.pl
Disallow /lwc-displaylibrary.pl
Disallow /ltg-displaytext.pl
Disallow /bib-processquery.pl
Disallow /news/search.pl
Disallow /list/
Back to top

Other Records

Field Value
sitemap https://librarytechnology.org/SiteMap.xml
Back to top