• W-E-B-S-I-T-E, Find Out What It Means To Me

    July 22, 2009

    Integration by certified su / CC-BY

    Inte­gra­tion by cer­ti­fied su / CC-BY

    It’s inter­est­ing how many peo­ple don’t really under­stand the con­cept of open source. Peo­ple often describe free­ware as open source, or they’ll describe free web-based appli­ca­tions as open source, or appli­ca­tions with APIs that allow for mashups. There are arti­cles all the time, on some of the most pop­u­lar web­sites, that rec­om­mend free soft­ware but don’t dis­tin­guish pro­grams the authors gives away for free from soft­ware that is actu­ally open source.

    For a pro­gram to be open source, it has to meet two basic qualifications

    1. The author has to pro­vide full access to its source code
    2. The soft­ware has to be accom­pa­nied by a license that pro­tects the con­tri­bu­tions and rights of the community.

    Per­haps what peo­ple asso­ciate most closely with open source — free soft­ware — is its price tag. How­ever, it is often pointed out that open source soft­ware is usu­ally free like a puppy or a kit­ten: there may be no cost asso­ci­ated with acquir­ing it, but there’s more involved than just the ini­tial cost. As with soft­ware you pay for, it takes time and money to inte­grate new soft­ware into an exist­ing com­put­ing envi­ron­ment. The dif­fer­ence between open source projects and soft­ware pur­chased from com­mer­cial ven­dors is that ven­dors profit from the time users spend on inte­gra­tion and workarounds (the sto­ries they share on mail­ing lists and at user con­fer­ences add value to the com­mer­cial prod­uct) while fixes con­tributed to an open source project are owned by any­one who wants to make use of the soft­ware and are pro­tected by its open source license. That’s why open source means more than just the zero on its price tag: the most essen­tial ele­ment of open source is that the data is yours. Not just the data you entrust to the soft­ware, but the soft­ware itself. You are not reliant on the pro­gram­mer who cre­ated it or the com­pany that con­trols its license: you can alter it your­self or hire some­one else to alter it for you.

    Of course, the ini­tial price mat­ters. When libraries buy pro­pri­etary soft­ware, they aren’t just pay­ing pro­gram­mers to write code, sys­tem admin­is­tra­tors to make sure com­put­ing infra­struc­ture is work­ing prop­erly, and man­agers to pro­vide the pro­gram­mers and sys­tem admin­is­tra­tors with meet­ings and time­lines. They’re also pay­ing for the company’s over­head expenses (such as the salaries of the sales­peo­ple who sell them the soft­ware) as well as the company’s profit margin.

    What if libraries hired every sin­gle pro­gram­mer, sys­tems admin­is­tra­tor, and sys­tems man­ager away from library soft­ware ven­dors — let’s say at exactly the same salaries they’re mak­ing now — and also pur­chased all their code and reli­censed it as open source? The pool of employ­ees mak­ing library soft­ware wouldn’t be any big­ger, but the over­all expenses for cre­at­ing library soft­ware (less the one-time cost of pur­chas­ing the code) would be the same. Except it wouldn’t, because libraries would no longer be pay­ing for sales and other expenses or foot­ing the bill for ven­dors’ profit margins.

    I’m not sug­gest­ing this is going to hap­pen. Libraries aren’t orga­nized enough to scoop up every techie at every library tech­nol­ogy com­pany, and even if they were, the com­pa­nies aren’t going to sell their intel­lec­tual property.

    No, I’m not sug­gest­ing it’s going to hap­pen; I’m sug­gest­ing that it is hap­pen­ing. I’m sug­gest­ing that, within a few years, libraries’ soft­ware expen­di­ture dis­tri­b­u­tions will have changed. Rather than pay­ing out­side com­pa­nies to employ library pro­gram­mers, soft­ware devel­op­ers will work directly for libraries. The code will be dif­fer­ent, it will be bet­ter, and it will be open source. And, if library soft­ware is like other soft­ware, there’s a good chance that a lot of the code will be con­tributed by vol­un­teers — peo­ple who aren’t even employed by libraries, but are inter­ested in the prob­lems and pos­si­bil­i­ties pre­sented by cre­at­ing soft­ware for library users and employees.

    where library software development money goes

    This is what hap­pened with web server soft­ware, the pro­grams that deliver code to web browsers (such as Fire­fox): open source soft­ware, espe­cially the soft­ware released by the Apache Foun­da­tion, dom­i­nates the web server mar­ket. It also appears to be hap­pen­ing with web browsers them­selves (Fire­fox again, though Google’s open source Chrome is off to a good start) and with the oper­at­ing sys­tems, pri­mar­ily Linux, that run the com­put­ers on which web server soft­ware runs.

    Once open source soft­ware is good enough, and has a good enough sup­port sys­tem, there aren’t any par­tic­u­larly com­pelling rea­sons to use pro­pri­ety soft­ware. Even­tu­ally, peo­ple come around to that real­iza­tion, whether they care about the under­ly­ing code or not. The issues are that “good enough” is in the eye of the beholder and “even­tu­ally” can take an awfully long time.

    A Quick Sur­vey: Nam­ing Names

    When I took on the task of cre­at­ing a new web­site for the Collingswood Pub­lic Library, I looked at the soft­ware options that were avail­able to me. I was famil­iar with some of them from my jobs at other libraries, and it’s not hard to fig­ure out what soft­ware libraries are run­ning or to inves­ti­gate what they’re doing with it: it’s mostly just a ques­tion of vis­it­ing their web­site. In my opin­ion, the lead­ing open source options seemed good enough — per­haps no bet­ter than the pro­pri­etary soft­ware that dom­i­nates the mar­ket, but also no worse and, more impor­tantly, the open source soft­ware seemed to be improv­ing more quickly.

    In my opin­ion, there are seven open source soft­ware projects worth considering

    There’s some apples-and-oranges going on here, in that some of these pack­ages are just com­po­nents of a web­site and require other soft­ware in order to do every­thing a library web­site needs to do (such as inven­tory man­age­ment). Other pack­ages cover the entire process.

    Ever­green and Koha cover the entire process. Some peo­ple call them Inte­grated Library Sys­tems, though I wish they wouldn’t.

    Black­light, Kochief, and VuFind pro­vide usabil­ity improve­ments for peo­ple stuck with exist­ing library web­sites. Some peo­ple call them Dis­cov­ery Layer Inter­faces and a few peo­ple would prob­a­bly still refer to them as Online Pub­licly Acces­si­ble Cat­a­logs. If you know any of these peo­ple per­son­ally, please ask them to cut it out.

    SOPAC is still known to some as a Con­tent Man­age­ment Sys­tem, and Scrib­lio is still occa­sion­ally referred to as a Blog­ging Engine, though they’re also some­times lumped in with Black­light, Kochief, and VuFind because, like these three, most libraries would prob­a­bly choose to use them in con­junc­tion with a sys­tem that assists with tasks like cat­a­loging and circulation.

    For us, and for most libraries that use library-specific soft­ware to han­dle their inven­tory, these were all viable options. The library where I work uses Inno­v­a­tive Inter­faces’ Mil­len­nium, so these pack­ages already work with it, could be adapted to work with it, or could replace it entirely.

    Built from Scratch, on a Frame­work, or on an Application

    One of the many advan­tages of open source soft­ware is that it’s often accre­tive: once one group of devel­op­ers fig­ures some­thing out, they tend to share it. Other devel­op­ers are then free to build soft­ware on top of it, and these devel­op­ers gen­er­ally share their improve­ments. Netscape opened the code from its browser and devel­op­ers turned it into Mozilla. Other devel­op­ers turned Mozilla into Fire­fox, which has been used as, among other things, the basis for a music player (Song­bird) and scriptwrit­ing soft­ware (Celtx). This kind of thing hap­pens all the time.

    For some uses, it’s nice to work with soft­ware that’s built from scratch. Other times, it’s nice to work with soft­ware that’s built on top of a frame­work — code designed specif­i­cally so that other code can be built on top of it. And some­times it makes sense to work with soft­ware that takes soft­ware appli­ca­tions and adapts them to spe­cific needs.

    Both Ever­green and Koha were built from scratch, which makes sense: when they were started, there really weren’t any frame­works for them to use. VuFind is built on the Apache Foundation’s Solr project (which helps it opti­mize search), but its inter­face was built from scratch. Again, when VuFind was started, there weren’t any frame­works that made sense for it to use. If it were started today, it prob­a­bly would use a frame­work, though that’s just speculation.

    VuFind is part­ner­ing with Black­light in stan­dard­iz­ing Solr for library search. Black­light also makes use of a frame­work, per­haps the best known among web devel­op­ers: Ruby on Rails. Like VuFind and Black­light, Kochief uses of Solr, but its inter­face is built using Django, a com­peti­tor to the Rails framework.

    There are two projects that make use of exist­ing appli­ca­tions: SOPAC is built on Dru­pal and Scrib­lio is built on Word­Press. Both Dru­pal and Word­Press are well known and widely used. To pick just library exam­ples, ALA­Con­nect and LIS­News use Dru­pal; Jes­samyn West, Jenny Levine, Karen Schnei­der, and Mered­ith Farkas use Word­Press (and so do many — per­haps most — other suc­cess­ful library blog­gers who run their own software).

    In gen­eral, like most users I’m fairly agnos­tic when com­par­ing soft­ware that’s built from scratch to soft­ware that’s built on a frame­work or an appli­ca­tion, but this infor­ma­tion was use­ful to me in this instance because I really know and like Word­Press, the soft­ware behind sev­eral projects I’ve devel­oped or helped to develop, includ­ing In the Library with the Lead Pipe. As with Dru­pal, Ruby on Rails, and Django, Word­Press has a large and sophis­ti­cated user com­mu­nity. By choos­ing these appli­ca­tions and frame­works, the devel­op­ers for Black­light, Kochief, SOPAC, and Scrib­lio are mak­ing it eas­ier for tech­ni­cally inclined peo­ple to under­stand what they’re doing and also mak­ing use of a large group of pro­gram­mers and users who are help­ing them to develop their library web­site soft­ware, even though they prob­a­bly have no idea they’re doing it. By improv­ing the under­ly­ing soft­ware, they’re improv­ing all the pro­grams built on top of the frame­work or application.

    Lan­guage

    Although I may be the world’s worst pro­gram­mer, I still con­sider the pro­gram­ming lan­guage used in build­ing the soft­ware for one of my web­sites. Pref­er­ences tend to be idio­syn­cratic, and mine are no excep­tion, but I try to be as objec­tive as I can. For instance, I limit my choices to the lan­guages that are pop­u­lar (accord­ing to sur­veys like the TIOBE Top 20 or Pro­gram­ming Lan­guage Pop­u­lar­ity) and that are typ­i­cally used to build web­sites: Java, Perl, PHP, Python, and Ruby (all of which are open source). Lan­guages (and frame­works) tend to be pop­u­lar, and to add more devel­op­ers, because they’re fun to use in devel­op­ing soft­ware. Also, when a lan­guage is pop­u­lar and fun to use, there tends to be larger group of pro­gram­mers who will help you, or who you can hire, if you run into trouble.

    Com­bin­ing my lan­guage pref­er­ences with the pre­vi­ous con­sid­er­a­tion (built from scratch, on a frame­work, or on top of an appli­ca­tion), here’s my ordered list

    1. PHP/WordPress
    2. PHP/Drupal
    3. Python/Django
    4. Ruby/Rails
    5. Python (from scratch)
    6. Ruby (from scratch)
    7. PHP (from scratch)
    8. Perl (from scratch)
    9. Java (from scratch)

    This doesn’t dis­qual­ify any of the con­tenders. Here’s how they fit into my list

    • PHP/WordPress: Scrib­lio
    • PHP/Drupal: SOPAC (and also some of the eXten­si­ble Cat­a­log project, though this project is not yet avail­able for use or testing)
    • Python/Django: Kochief
    • Ruby/Rails: Black­light
    • Python (from scratch): N/A
    • Ruby (from scratch): N/A
    • PHP (from scratch): VuFind
    • Perl (from scratch): Ever­green (though it’s being extended in other lan­guages) and Koha
    • Java (from scratch): N/A, though the eXten­si­ble Cat­a­log already makes use of Java, and OLE, which is still in the plan­ning stages, may make use of Java as well, though I’m mostly just spec­u­lat­ing on this point. My dis­in­ter­est in Java, which I’ll admit is mostly just sec­ond hand, also helps to explain why I like Moo­dle (PHP) for edu­ca­tional web­sites bet­ter than its open source com­peti­tor, Sakai, which is built on Java.

    Doc­u­men­ta­tion

    One of the advan­tages that com­mer­cial, pro­pri­etary soft­ware often enjoys over its open source com­peti­tors is doc­u­men­ta­tion. This makes sense from a com­mer­cial per­spec­tive: write the doc­u­men­ta­tion, point cus­tomers to it, and you can save on cus­tomer ser­vice. The catch is that doc­u­men­ta­tion for com­mer­cial soft­ware is often hid­den from search engines, so find­ing an answer to a ques­tion about com­mer­cial soft­ware often means nav­i­gat­ing the vendor’s doc­u­men­ta­tion or send­ing a mes­sage to its mail­ing list. At a pre­vi­ous employer, we were con­trac­tu­ally oblig­ated to con­strain employee access to Inno­v­a­tive Inter­faces’ doc­u­men­ta­tion. While Innovative’s infor­ma­tion was well writ­ten, the search engine that was built into it was awful, so find­ing answers was often frus­trat­ing. The plan, when I left, was to buy a spe­cial­ized server we could use to run our searches through an access-restricted Google search.

    Open source devel­op­ers often seem more inter­ested in improv­ing the soft­ware than in writ­ing doc­u­men­ta­tion. It’s also a sep­a­rate skill from writ­ing code; peo­ple who are good at pro­gram­ming, and enjoy it, are not always the same peo­ple who are good at, and enjoy, writ­ing doc­u­men­ta­tion. As projects grow, peo­ple inter­ested in writ­ing doc­u­men­ta­tion tend to get involved — and they make their dis­cus­sions pub­lic. Users and devel­op­ers post their thoughts about issues they encounter and they link directly to the doc­u­men­ta­tion, which means search engines become one of the best resources in under­stand­ing a fea­ture or solv­ing a prob­lem with open source software.

    The pro­gram­ming lan­guages I’ve cited all have excel­lent doc­u­men­ta­tion, as do the frame­works and the appli­ca­tions. Among the full-service web­site soft­ware, Koha, the older of the two, has fuller and more user-friendly doc­u­men­ta­tion, at least in my opin­ion; Evergreen’s is good and improv­ing, but doesn’t yet appear to be as pol­ished or acces­si­ble as Koha’s.

    Among the other projects, VuFind and Black­light prob­a­bly have the best doc­u­men­ta­tion — cer­tainly enough to get you started, and SOPAC, though the newest of the bunch, has done a very good job with the basics, though as of this writ­ing it is open about the absence of doc­u­men­ta­tion for its more advanced features.

    I’m prob­a­bly hard­est on Scrib­lio because it’s the project I know best, but Scriblio’s doc­u­men­ta­tion lags behind its peers and even rel­a­tively basic ques­tions often need to be answered on the mail­ing list. To Scriblio’s credit, these ques­tions do get answered, but its lack of doc­u­men­ta­tion is prob­a­bly Scriblio’s most notable short­fall (for instance, as of this writ­ing its inter­nal record for­mat, Mar­cish, is not yet doc­u­mented on its web­site). Among the list of major open source library web­site soft­ware projects, Scrib­lio is ahead of only Kochief, which is in the ear­li­est stages of the doc­u­men­ta­tion process.

    Sta­bil­ity: Lead­er­ship, Com­mu­nity, Funding

    When com­mer­cial soft­ware ven­dors go out of busi­ness, they often take their soft­ware with them (unless they sell it to another com­pany or, like Netscape, decide to release it as open source). That’s not a dan­ger with open source soft­ware: as long as some­one has a copy of the code, it remains avail­able. I’m not aware of any sig­nif­i­cant open source projects that have sim­ply dis­ap­peared. How­ever, plenty of open source projects seem to die off when their devel­op­ers stop mak­ing time for them. While it’s pos­si­ble to revive stag­nant projects or take them in another direc­tion (Word­Press, for instance, was a rein­vig­o­ra­tion of b2/cafelog), it’s still advis­able to look for projects that have a strong, sta­ble com­mu­nity — espe­cially for some­thing as impor­tant as the soft­ware that pow­ers your website.

    As with doc­u­men­ta­tion, sta­bil­ity is not really an issue for any of the lan­guages, frame­works, or appli­ca­tions I’ve men­tioned. How­ever, it seems like it may be more of an issue for the library-specific projects.

    Koha and Ever­green are closely asso­ci­ated with pri­vate com­pa­nies that offer con­sult­ing for these projects. Josh Fer­raro, one of Koha’s early adopters in the United States and the release man­ager for Koha 3.0, cre­ated Lib­Lime in 2005 in order to focus on pro­vid­ing sup­port for Koha users in North Amer­ica (Koha was released in 2000 and has a long­stand­ing, active com­mu­nity in New Zealand and Europe; read­ing its well doc­u­mented his­tory and learn­ing about its unsung heroes are good ways way to learn how open source projects evolve). While Koha is as strong as its devel­oper com­mu­nity — cur­rently at about 90 devel­op­ers, which is quite good — it seems likely that LibLime’s suc­cess and Koha’s will be inter­twined for some time.

    Unfor­tu­nately, there may be rea­sons to be con­cerned about Lib­Lime. Most of what I’ve heard is just rumor, though in the last few days the Lib­Lime website’s man­age­ment team page ceased to dis­play pho­tographs and blurbs about two of its mem­bers, Debra Denault (Senior Vice Pres­i­dent, Oper­a­tions) and Galen Charl­ton (Vice Pres­i­dent, Research and Devel­op­ment, and the man­ager for the newest Koha release, ver­sion 3.2). Lib­Lime also pulled its promised fund­ing from the code4lib con­fer­ence ear­lier this year rather sud­denly and unex­pect­edly, or so it seemed to me. There could have been a non-financial rea­son for this deci­sion, or it could have been a con­ser­v­a­tive move (the con­fer­ence took place right after the sud­den 2008 – 2009 downturn).

    Just to be clear: I’m doing my best not to pass on gos­sip as fact, espe­cially about a com­pany whose employ­ees I’ve met, respect, and like very much — and who funded a pre­sen­ter, Aaron Swartz, when I found out last minute that ALA wouldn’t waive Aaron’s reg­is­tra­tion fee for the Mid­win­ter in Philadel­phia (even though he was address­ing our dis­cus­sion group for free and pay­ing for his own travel expenses). And I’m not sug­gest­ing that either Lib­Lime or Koha is in trou­ble. Lib­Lime is an impor­tant con­trib­u­tor to Koha, but even among “pay for sup­port” orga­ni­za­tions, Koha is big­ger than Lib­Lime. Still, just as it’s worth under­stand­ing what’s going on with auto­mo­bile man­u­fac­tur­ers before you buy a new car, it’s worth get­ting to know a bit about the groups who are work­ing on your web­site soft­ware, whether they’re pri­vate com­pa­nies or open source communities.

    Ever­green, which was ini­tially released by a con­sor­tium of Geor­gia libraries as the PINES cat­a­log, saw sev­eral of its ini­tial devel­op­ers go on to found Equinox Soft­ware, a com­pany that con­sults on Ever­green instal­la­tions. Equinox has hired extra­or­di­nar­ily tal­ented peo­ple, they’re hir­ing (which is always a good sign), and they have tal­ented vol­un­teers con­tribut­ing code back to the project. To bring this back to the model I sketched out in the intro­duc­tion, most of these “vol­un­teers” are employed by libraries, not by Equinox/Evergreen.

    The rest of the projects have what could be con­sid­ered a sin­gle point of fail­ure: if their lead devel­oper or spon­sor­ing depart­ment were to aban­don the project, they would likely lose a great deal of momen­tum. I believe, in each case, they would even­tu­ally regain that momen­tum or I would not have included them in this sur­vey, but it seems clear to me that the other five projects are poten­tially less sta­ble than Ever­green or Koha.

    Based on its code updates, VuFind appears to be adjust­ing well to its tran­si­tion from being someone’s pri­mary respon­si­bil­ity to being a community-based project. Andrew Nagy founded VuFind while work­ing for the library at Vil­lanova Uni­ver­sity (VuFind is a pun on VU). He has since moved on to Seri­als Solu­tions, where he is one of the lead­ers of its Sum­mon prod­uct. VuFind has received a Mel­lon Award and pro­fes­sional sup­port is avail­able through Lyra­sis, both of which are encour­ag­ing. How­ever, it would be nice to see a new release (VuFind’s lat­est release is its first release can­di­date for ver­sion 1.0, which came out on Octo­ber 15, 2008) and, Lyra­sis, though large and diver­si­fied, is under­go­ing its own changes, so VuFind could find itself with no orga­ni­za­tion other than its orig­i­nal devel­op­ers offer­ing com­mer­cial sup­port.

    Black­light and Kochief are sim­i­lar to VuFind, or at least to where it was when it was mostly a Vil­lanova project: Black­light is being sup­ported pri­mar­ily by the Uni­ver­sity of Vir­ginia library and Kochief pri­mar­ily by the Drexel Uni­ver­sity library. Both look great and are under active devel­op­ment, but nei­ther has a large base of installed users. This is sig­nif­i­cantly mit­i­gated by their use of pop­u­lar lan­guages and frame­works, but lack of sup­port by Vir­ginia or Drexel (at this point mostly Drexel’s Library Sys­tems Devel­oper, Gabriel Far­rell) would be major blows to these projects.

    As far as insti­tu­tional sup­port, Scrib­lio and SOPAC are a study in con­trasts. Scrib­lio isn’t tech­ni­cally based at a library: Casey Bis­son, its lead devel­oper, works as an Infor­ma­tion Archi­tect at Ply­mouth State Uni­ver­sity, but he works cen­trally, not just for the library. He has, how­ever, secured fund­ing for Scrib­lio from the Mel­lon Foun­da­tion and also joint fund­ing from the NEH/IMLS. Mean­while, SOPAC’s devel­op­ment has been funded by two of the finest and best funded pub­lic libraries in the coun­try, Ann Arbor and Darien, lead devel­oper John Bly­berg’s for­mer and cur­rent employ­ers. Nei­ther Scrib­lio nor SOPAC yet have large devel­oper com­mu­ni­ties or installed user bases, and both remain highly reliant on their lead developers.

    Self-Hosted or Outsourced

    One of the advan­tages of open source web­site soft­ware is the empow­er­ing feel­ing of down­load­ing the soft­ware and run­ning it on servers you con­trol. How­ever, it’s also use­ful to have the option of pay­ing some­one knowl­edge­able to run the soft­ware on their servers: as men­tioned above, sys­tem admin­is­tra­tion is a career and an expense unto itself. Some soft­ware offers the best of both worlds: go to Word​Press​.org and you can down­load Word­Press and install it on your own servers; go to Word​Press​.com and you can sign up for a free web­site that’s pow­ered by Word­Press soft­ware, but works much like Blog­ger or any other hosted soft­ware. In exchange, you give up a cer­tain amount of con­trol, but for many peo­ple it’s a wel­come tradeoff.

    Lib­Lime and Equinox spe­cial­ize in their projects and offer host­ing for them at what I con­sider rea­son­able prices. Scrib­lio has a free host­ing option that it is slowly rolling out to smaller libraries — an equiv­a­lent ser­vice to the Word​Press​.org/​W​o​r​d​P​r​e​s​s​.​com web­site option. For us, that was a big attrac­tion. We give up some con­trol, but tak­ing server admin­is­tra­tion tasks and expenses out of the equa­tion is a huge net win.

    To the best of my knowl­edge, there are no ded­i­cated VuFind, Black­light, Kochief, or SOPAC hosts, though there are com­pa­nies that spe­cial­ize in PHP, Rails, Django, and Dru­pal. For instance, Palos Verdes Library Dis­trict, which just released its SOPAC-based web­site, hired Crafty­Space to guide its imple­men­ta­tion. Help is avail­able for run­ning and host­ing any of these projects, but for now man­aged host­ing is most closely tied to Koha, Ever­green, and Scriblio.

    Choos­ing Scriblio

    For me, the ini­tial deci­sion to use Scrib­lio and the ongo­ing deci­sion to stick with it are both dif­fi­cult and obvi­ous. I really like using Word­Press and know it well — I cre­ated a very basic Scrib­lio site even before I had my first inter­view for my cur­rent job, and set­ting it up took just a few hours — and I really like Casey Bis­son as a per­son and as a web devel­oper: our visions for libraries are awfully sim­i­lar. For instance, Scrib­lio cre­ates uni­fied web­sites: for Scrib­lio libraries, the cat­a­log and the rest of the web­site look alike and run on exactly the same soft­ware. What closed the deal for us was Scriblio’s abil­ity to pull in fund­ing and its deci­sion to turn some of that fund­ing into free host­ing for CollingswoodLib​.org (and sim­i­lar libraries).

    Scrib­lio isn’t per­fect, but I’m very com­fort­able with Scrib­lio and excited about where it’s head­ing. While I’ll be hap­pier when there’s a larger devel­oper com­mu­nity, more inter­nal inter­est in stan­dards, and bet­ter doc­u­men­ta­tion, I have the abil­ity to help make these changes. In par­tic­u­lar, as one of Scriblio’s early adopters, I bear more than a lit­tle respon­si­bil­ity for not hav­ing done more to improve its doc­u­men­ta­tion; rem­e­dy­ing this sit­u­a­tion is high on my to do list. How­ever, per­haps the main prob­lem I have with Scrib­lio is that my sat­is­fac­tion with it dimin­ishes my inter­est in get­ting more direct expe­ri­ence with the other soft­ware I could be using for our website.

    If I were a more tal­ented pro­gram­mer, I’d prob­a­bly choose Kochief because I’m most inter­ested in learn­ing Python and Django. I’ve also com­mented on my admi­ra­tion for Gabriel Far­rell else­where on this web­site. Black­light would prob­a­bly be my next choice if I knew what I was doing: plenty of pro­gram­mers I admire are fans of Ruby and Rails. If I were more inter­ested in PHP, or was inter­ested in hir­ing a devel­oper, I’d strongly con­sider VuFind. Its user inter­face is attrac­tive and pol­ished, and a lot of good think­ing and good work has gone into this project.

    If I had more money to spend on imple­men­ta­tion and train­ing, I’d hire Lib­Lime to host Koha and migrate our data, or Equinox to migrate us over and host us on Ever­green. My hope, which I try to make real via advo­cacy, is that a larger entity than Collingswood—Cam­den County, VALE, the New Jer­sey State Library—will make this deci­sion and include us as part­ners. From what I’ve seen, I strongly pre­fer Koha and Ever­green web­sites to what Mil­len­nium offers. As for choos­ing between the two, I’m not yet able to do it and don’t see any rea­son to decide just yet, though I have learned enough to decide that I don’t yet want us to aban­don Mil­len­nium on our own. When the time comes to migrate our data, both projects will have changed, plus we’ll be mak­ing the move along­side part­ners. For­tu­nately, Koha and Ever­green are both great and get­ting bet­ter. I’ll decide later which one I most hope to use.

    If I were to leave Scrib­lio tomor­row, the project I’d likely leave it for would be SOPAC. While I pre­fer Word­Press to Dru­pal, it’s mostly because I’ve been work­ing on smaller projects: Dru­pal was ini­tially devel­oped with more com­plex web­sites in mind, while Word­Press was ini­tially devel­oped to han­dle sim­pler sites. They’ve been con­verg­ing for years, as Word­Press has got­ten bet­ter at big­ger sites and Dru­pal has got­ten bet­ter at smaller sites, but there’s still a per­cep­tion — one I admit to not hav­ing tested in a few years—that Dru­pal is bet­ter at han­dling larger web­sites. I also like the fact that SOPAC, like Scrib­lio, cre­ates more uni­fied web­sites (why is it that most libraries still sub­ject their users to a web­site that includes the cat­a­log only as an adjunct?) and that SOPAC has Darien Library as its pri­mary fund­ing source and John Bly­berg as its lead devel­oper. Plus, it’s attrac­tive, flex­i­ble, and fairly easy to imple­ment: all in all, a deserv­ing win­ner of LITA’s 2009 Brett But­ler Award.

    For now, I’m happy with Scrib­lio. It meets our basic needs and is steadily improv­ing. Per­haps the best endorse­ment I can offer for Scrib­lio, at least for smaller, pub­lic libraries like Collingswood, is my endorse­ment of its com­peti­tors. We use Scrib­lio in spite of its com­pe­ti­tion, not because of it.

    Thanks to Casey Bis­son, Nicole Engard, and Gabriel Far­rell for read­ing an early draft of this arti­cle, and to my ItLwtLP col­league, Derik Bad­man, for help­ing me with its final ver­sion.

    You might also be inter­ested in:

32 Comments

  • […] I thor­oughly rec­om­mend read­ing the whole thing here. […]

  • Owen says:

    I’m curi­ous why you don’t like “Inte­grated Library Sys­tem.” Do you pre­fer “Library Man­age­ment Sys­tem?” It seems to me it’s nec­es­sary to have a way of dis­tin­guish­ing between an ILS/LMS and more stand­alone or add-on OPAC software.

  • Kyle says:

    Here’s an inter­est­ing state­ment:

    there’s a good chance that a lot of the code will be con­tributed by vol­un­teers — peo­ple who aren’t even employed by libraries, but are inter­ested in the prob­lems and pos­si­bil­i­ties pre­sented by cre­at­ing soft­ware for library users and employ­ees.

    I hope it hap­pens, I really do. It would be great for the Open Source com­mu­nity to step up and sup­port an insti­tu­tion that has shared its resources freely for decades, we do share a phi­los­o­phy that way. I won­der if what you’re seek­ing, an OS ILS

    A great point:

    As projects grow, peo­ple inter­ested in writ­ing doc­u­men­ta­tion tend to get involved — and they make their dis­cus­sions pub­lic. Users and devel­op­ers post their thoughts about issues they encounter and they link directly to the doc­u­men­ta­tion, which means search engines become one of the best resources in under­stand­ing a fea­ture or solv­ing a prob­lem with open source soft­ware.

    To me this is eas­ily the best char­ac­ter­is­tic of OS projects, the momen­tum that grows within its devel­oper and user-base that moti­vates peo­ple to help each other through open and acces­si­ble doc­u­men­ta­tion and tuto­ri­als. It really is key.

    An exten­sive post, but I read every word. Thanks!

    ~kyle~
    @thecorkboard

  • Kyle says:

    You can ignore this trail­ing sen­tence :)
    “I won­der if what you’re seek­ing, an OS ILS…”

    ~Kyle~

  • Emily Ford says:

    Nice arti­cle! I have the same ques­tion Owen has. Can you tell us more about your grouch with the term “inte­grated library sys­tem” for Koha and Evergreen?

    Also, would you mind spend­ing some time think­ing about and respond­ing to the fol­low­ing: how can we suc­cess­fully advo­cate for open source in insti­tu­tional envi­ron­ments that are, um, less than “open?” (Uni­ver­si­ties, research insti­tutes, other orga­ni­za­tions that have cen­tral­ized web sites, etc.)

  • […] 7 Open Source Library Soft­ware to Consider…07.22.09 22 07 2009 Here is an excerpt from a very use­ful post by Brett Bon­field on In the Library With a Lead Pipe titled W-E-B-S-I-T-E, Find Out What It Means To Me: […]

  • Great arti­cle! Full of plenty of use­ful information.

  • ranti says:

    Nice arti­cle! It’d be inter­est­ing to do a cost analy­sis between pay­ing com­mer­cial com­pa­nies for their pro­gram­mer time vs. hav­ing our own pro­gram­mer. Insti­tu­tion like ours might need to include the over­head as well (ben­e­fits, health insur­ance, etc.)

  • John says:

    Really, really good and com­pre­hen­sive post, Brett. I could use this as the basis of any dis­cus­sion on OS cat­a­logs, and indeed I will. Thanks.

  • […] a great post, actu­ally more of a long essay or arti­cle, on open source library soft­ware projects.  W-E-B-S-I-T-E, Find Out What It Means To Me (great title, but cer­tainly more lim­ited than the post’s topic) cov­ers a wide range of […]

  • David Talley says:

    Add my thanks to the oth­ers for a thought­ful cat­a­log. I won­der a lit­tle, how­ever, about your premise that libraries can cap­ture all of the over­head and profit that com­mer­cial soft­ware ven­dors have pock­eted in the past. Can libraries man­age teams of devel­op­ers as effec­tively as pro­fes­sional soft­ware com­pa­nies can? I see the sense behind this exten­sion of a library’s man­age­ment skillset, but I’m not sure it’s going to work out as well in prac­tice as we might imag­ine it in the­ory. Just as doc­u­men­ta­tion is its own skillset, so is IT project man­age­ment. Do libraries risk dilut­ing and defus­ing their focus on their cen­tral mis­sion as they reset pri­or­i­ties toward devel­op­ing those tech skills? Con­tract­ing for a hosted instal­la­tion of an OS sys­tem is a way around part of this dilemma, but I’d be inter­ested in thoughts about man­ag­ing the cod­ing projects themselves.

  • jessamyn says:

    Very nice and thor­ough arti­cle. Every time I go to a library con­fer­ence and see the big ven­dor types wiht their fancy booths, free drinks and other schwag I think that this is money that we spend on ILS stuff that is not returned to us in terms of fea­tures or fixes. I bet sell­ing is an even larger part of that lit­tle graph you made than most peo­ple imagine.

  • @Owen and Emily: My pri­mary issue with the jar­gon is that it seems to be insti­tu­tion­al­iz­ing deci­sions that no longer make sense. Ama­zon has a web­site. We have an alpha­bet soup of soft­ware that’s get­ting bet­ter, but still doesn’t come close to com­pet­ing with the user expe­ri­ence Ama­zon offers. If we were to start from scratch, I sus­pect that we’d come up with some­thing more uni­fied, such as the new OCLC web-scale ser­vice promises to be. And per­haps we still will. Andrew Pace, who is lead­ing this project for OCLC, pre­vi­ously man­aged NCSU’s Endeca imple­men­ta­tion, a web­site inno­va­tion that helped to serve as a blue­print for sev­eral of the open source projects I refer to in this arti­cle (from the Kochief web­site: “Kochief began with Casey Durfee’s Open Source Endeca in 250 lines or less pre­sen­ta­tion at the code4lib 2007 con­fer­ence, where he claimed to pro­vide faceted fea­tures sim­i­lar to the Endeca and AquaBrowser expe­ri­ences using Solr and Django.”)

    @Kyle: I agree about the great point above. I wish I could take credit for it, but it’s a com­ment Casey Bis­son made after read­ing my first draft.

    @Emily re: advo­cat­ing for open source: What have you tried so far? What worked? What didn’t?

    @Ranti: although they tend to be pretty dry, it might be worth check­ing out some Total Cost of Own­er­ship (TCO) studies.

    @John: Thanks. I hope you’ll pub­lish as many of those dis­cus­sions as time allows.

    @David: John (Bly­berg, above) is bet­ter qual­i­fied to com­ment on this than I am, though I think SOPAC speaks vol­umes by proxy. Other than the libraries already men­tioned in this arti­cle, some other exam­ples of libraries who appear to be doing a nice job with their teams of devel­op­ers include NCSU, the Library of Con­gress (it’s almost two years old, but I still love this post about the soft­ware they use inter­nally), the Uni­ver­sity of Rochester (home of the eXten­si­ble cat­a­log), and Michi­gan (their Labs project is really cool).

    @Jessamyn: the thing that breaks my heart is when I talk to the sales­peo­ple them­selves. They’re almost all bright, knowl­edge­able, hard­work­ing, and help­ful. They’d make great librar­i­ans. But instead we pay them to sell us access to soft­ware (or arti­cles) we rent rather than own.

  • Why you don’t con­sider Perl web frame­works like Cat­a­lyst, Jifty or CMS like WebGUI, Krang?

  • Nate Curulla says:

    Great Arti­cle! But keep in mind with regard to Koha that there are other options in the pay for sup­port cat­e­gory, so if the one ven­dor men­tioned here may look like they are hav­ing issues it should not reflect upon the sta­bil­ity of Koha. It only shows that Koha is an ever-evolving prod­uct that attracts com­pe­ti­tion. Both ByWa­ter Solu­tions LLC and PTFS Inc. are two pay for sup­port ven­dors that have recently entered the mar­ket, and more will con­tinue to come along. I believe that Koha is more depen­dent on the suc­cess of the com­mu­nity more so than on the suc­cess of it’s sup­port companies.

  • @Alexandr: The list wasn’t meant to be a com­pre­hen­sive inven­tory of all the cool lan­guages, frame­works, and appli­ca­tions I’d like to work with, it was meant to reflect what’s actu­ally hap­pen­ing, or what I think seems likely to hap­pen, in open source library web­site soft­ware. In addi­tion to the Perl web frame­works you men­tion, I also left out Sina­tra, Joomla, Plone, a bunch of inter­est­ing PHP and Python frame­works, etc. The point of the exer­cise was to make sure peo­ple con­sider the under­ly­ing code in any web­site deci­sion they make.

    @Nate: Agreed. I wrote, “Lib­Lime is an impor­tant con­trib­u­tor to Koha, but even among ‘pay for sup­port’ orga­ni­za­tions, Koha is big­ger than Lib­Lime,” and ‘pay for sup­port’ in that sen­tence links to a list of ven­dors that includes ByWa­ter and PTFS. How­ever, Lib­Lime is at the top of that list, and Lib­Lime employ­ees have been release man­agers for the last two Koha ver­sions as well as the doc­u­men­ta­tion man­ager for both releases (and I think Koha’s doc­u­men­ta­tion is one of its best assets). Even if, as I played around with in the intro, libraries sud­denly swooped in and hired every Lib­Lime employee, I think it’s clear that Koha would con­tinue to be a great soft­ware project, though I also believe that LibLime’s absence would be a sig­nif­i­cant blow to the com­mu­nity. That’s all I was try­ing to say: “it seems likely that LibLime’s suc­cess and Koha’s will be inter­twined for some time.”

  • Monica Schultz says:

    Great Arti­cle! I’m an OSS advo­cate and believe funds are bet­ter spent on pro­gram­ming to offer any ser­vice you wish rather than mak­ing some­one else rich. OSS has been around for a very long time and hope that libraries can see the ben­e­fits of OSS though this comes with a cul­ture change which I’m hope­ful will hap­pen in Cal­i­for­nia sooner than later :o)

  • Chris Cormack says:

    Hi there,
    Id like to add my voice to Nate’s.
    I’m Chris Cor­mack from Cat­a­lyst and we pro­vide Koha sup­port too.
    (Ive been work­ing on Koha since 1999)

    Hope­fully some of the other peo­ple will chime in to help pro­vide some reassurance.

  • Dan Scott says:

    Bib­Li­bre is another com­pany that con­tributes sub­stan­tial devel­op­ment effort to Koha and offers sup­port ser­vices. Always nice to have inter­na­tional per­spec­tives from com­pa­nies like Bib­Li­bre and Catalyst.

    I could quib­ble and note that Ever­green runs on the Open­SRF frame­work (JSON over XMPP for scal­able Web ser­vices in 2005… just a few years ahead of Google Wave’s sim­i­lar tech­nol­ogy), and that C is just as entrenched as Perl in Evergreen’s core — but all in all you’ve done a good job of knit­ting this all together.

  • Nicolas Morin says:

    Gee, Dan Scott was faster than myself telling you that my com­pany exists ;-)
    Indeed : Bib­Li­bre has been cod­ing stuff in Koha, and sup­port­ing libraries run­ning Koha for a long time. Our own Paul Poulain first sent a patch in 2002 and we now have a staff of 8 mostly work­ing on Koha-related stuff.
    Your point was well made though: Koha has a com­mu­nity that’s strong enough, and big enough, that it will out­last any indi­vid­ual com­pany going belly up, ours or any other.
    And to answer @jessamyn : we don’t go to con­fer­ences with fancy booths. It’s costly, and more often than not a loss of time too. But we do travel a lot to actu­ally meet librar­i­ans in libraries, and ben­e­fit from word of mouth : you have a good ILS, you do good work, you’re open to new ideas and new projects. That’s what works for us.

  • Hi there. I’m a mem­ber of soft​ware​.coop and a past release main­tainer for Koha. We pro­vide Koha instal­la­tion, sup­port and devel­op­ment ser­vices and I’ve done a lot of pro-bono hack­ing on it in the past (SQL injec­tion pre­ven­tion stands out in my mind as a par­tic­u­larly long and dull one that we funded our­selves), in line with the core coop­er­a­tive prin­ci­ple of com­mu­nity benefit.

    I know we’ve been over­shad­owed in recent years, but now that the credit crunch is affect­ing capital-based com­pa­nies more than coop­er­a­tives, we’re start­ing on the come­back road. Even with­out us, I don’t think Koha’s suc­cess is depen­dent on any one com­pany: com­pa­nies have joined and left the Koha com­mu­nity over time.

    That said, we’ve been try­ing to encour­age a broader com­mu­nity than one dom­i­nated by a few sup­port com­pa­nies, but librar­i­ans haven’t really wanted to get involved. Is this chang­ing? Do librar­i­ans care more about sus­tain­able com­mu­nity in these uncer­tain times?

    Of course, as a mem­ber of a tech worker coop­er­a­tive, I’d love to see the OCLC co-op get­ting involved with Koha to rep­re­sent their mem­ber libraries, or some other library co-ops get­ting heav­ily involved. Can you help to make it happens?

  • Susan ONeal says:

    A thor­ough, updated review of open source for libraries– much appre­ci­ated and I hope has a large audi­ence. BTW, you may not know of three pub­lic library Koha projects in NJ. Two live instal­la­tions are High­land Park PL, which used an out-of-the box Koha and Lib­Lime for migra­tion and sup­port; E Brunswick PL, which went live last week, and my library, Mid­dle­town Town­ship PL, which plans to go live in Sep­tem­ber. E. Brunswick and MTPL have part­nered together with PTFS in MD for project migra­tion, sup­port and a pretty hefty [$$ and #] amount of devel­op­ment, which we are very excited to be able to share with the Koha com­mu­nity. In our sit­u­a­tion, we required self-check out, com­puter time mgt, and a tele­phone noti­fi­ca­tion sys­tem to be inte­grated with Koha and since these are not robust enough in the library open source “mar­ket” our plan is to inte­grate pro­pri­etary sys­tems with Koha. I think this is some­thing that open source pro­po­nents need to acknowl­edge as both pos­si­ble and prac­ti­cal in the short term. Finally a com­ment on the post above that asked the ques­tion “Do librar­i­ans care.…” Of course we care and the oppor­tu­nity to get involved [I can see from per­sonal obser­va­tion of my staff] has regen­er­ated sev­eral long careers in librar­i­an­ship. I’d ask the tech com­mu­nity to ask librar­i­ans what we can drop from our ser­vice plate so that we can devote more time to open source. It’s all been an “add-on” to cus­tomer demanded ser­vices– so we are pretty exhausted these days. How­ever, the energy of the Koha com­mu­nity to push for prod­uct excel­lence and improve col­lab­o­ra­tion– as evi­denced in meet­ings such as this year’s Koha­Con in Plano TX keeps inspir­ing us and rein­forc­ing that our deci­sion to go open source is not only the best one we’ve made since self-check out [2004] but the one with the most long term global impact on library oper­a­tions since around the late 1970’s.

  • John says:

    In response to David above–

    Yes, the deci­sion to ini­ti­ate and sup­port an open source devel­op­ment project is one that should not be taken lightly. Darien Library chose to make a com­mit­ment to SOPAC on the basis of sev­eral cri­te­ria. 1) No other prod­uct exists that will do what we wanted. 2) We incor­po­rated the design an imple­men­ta­tion of SOPAC into our exist­ing ser­vice model. 3) SOPAC, as a prod­uct, fills a giant, gap­ing hole in the next-gen cat­a­log mar­ket and we were very con­fi­dent that we would be able to pull together a devel­op­ment group to share in the devel­op­ment bur­den in the long-term.

    With regards to the third point, that is exactly what has hap­pened – to the extent that com­mer­cial sup­port is now avail­able for SOPAC through Crafty­space, who has com­mit­ted back to the project some very valu­able work. Bib­li­bre (men­tioned ear­lier) has also con­tributed back to the project (they did the scut-work for inter­na­tion­al­iza­tion sup­port, and a French trans­la­tion). Add to that, active devel­op­ment work being done at three other libraries beyond Darien and it becomes appar­ent that SOPAC is a very healthy OS project.

    Beyond that, your argu­ment that these pur­suits dilute our core mis­sion makes some assump­tions about what our core mis­sion is that I might not nec­es­sar­ily agree with.

  • David Dorman says:

    Here are addi­tional OS library soft­ware that did not get men­tioned in the arti­cle. You would do your read­ers a ser­vice by giv­ing these appli­ca­tions some atten­tion in a future article.

    IRSpy (reg­istry soft­ware for main­tain­ing Z39.50/SRU gate­ways; devel­oped by Mike Taylor)

    Metaproxy (metasearch mid­dle­ware; devel­oped by Index Data)

    OPALS (an ILS; devel­oped by MediaFlex)

    Pazpar2 (metasearch mid­dle­ware; devel­oped by Index Data)

    YAZ fam­ily of pro­grams (tools for build­ing Z39.50/SRU appli­ca­tions; devel­oped by Index Data)

    Zebra (db server & index­ing engine; devel­oped by Index Data)

    David

  • It’s great to hear from the OSS com­mu­nity. As I wish I’d made more explicit in my post, I want OSS to suc­ceed and I believe that it will, in part, because of the com­pa­nies that are avail­able to sup­port it.

    I haven’t changed any text in the com­ments above, but I’ve made some com­ments con­form with how we try to han­dle links (cri­te­ria: our read­ers’ con­ve­nience, acces­si­bil­ity, and fair­ness). As of now, only the first men­tion of a com­pany is linked, and I’ve gone back and added links to the com­pa­nies that pro­vide Koha sup­port even if the com­menter did not.

    The com­pa­nies listed on the Koha “pay for sup­port” page I linked to in the orig­i­nal arti­cle but which have not yet been men­tioned are: Strate­gic Data; Turo Tech­nol­ogy LLP (see link to the Soft­ware Coop, above); CALYX infor­ma­tion essen­tials; inLi­bro; OpenLX; Pak­istan Library Automa­tion Group; National Cen­tre for High-Performance Com­put­ing; Tamil; Sabi­net; Nuc­soft OSS Labs; Anant Cor­po­ra­tion; and Lib­Soul.

Subscribe to comments for this post:

XHTML: You can use these tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>
Powered by WordPress | Original Theme by mg12 Edited by Derik. | Valid XHTML 1.1 and CSS 3