Moving on

After nearly ten years at Dresdner Kleinwort, I shall be leaving the bank at
the end of this week. It’s been a wonderful time: I’ve had the opportunity
to work with many truly talented people, been given the freedom to
experiment with real innovation in technology and its application,
experienced being part of a close and resilient culture over a decade of
tumult and change. But now it’s time to move on. My thanks to all concerned.

I’ve never worked for a competitor in my life, either by accident or design.
That trend serendipitously continues, and from 1st October I am taking over
as CIO, Global Services, BT.

My best wishes to all at Dresdner Kleinwort, especially to those who have
worked with me, supported me and encouraged me. You know who you are.

Things others have been able to do because of their blog

Here’s a story by Mark Frauenfelder showing how he found a set of books he was looking for via his blog. Once again it is a case of the conversational richness that a blog community represents, how natural-language amorphous requests and queries resolve themselves beautifully “given enough eyeballs”.

Of course I appreciate the skill, talent and expertise of professionals in libraries, bookshops, archives and what-have-you. Of course I appreciate the intellectual horsepower and creativity of search tools and techniques.

But I also appreciate the collective power of community in resolving the more amorphous and “provisional” queries that we have. The provisional aspect of blogs extends beyond statements and views and reaches into questions and searches and finds.

If anyone else has stories to tell about the sheer joy of using community to find things and solve problems, please do share them. I think it’s worth collecting and documenting on an opensource basis.

Continuing with search, retrieval, indexing and archival

The British Library launched a new IP manifesto sometime Monday at a “fringe” event forming part of the annual Labour Party conference in the UK. You can also find further information on all this via this story on BBC News.

Here’s an extract from the IP manifesto:

As the Library prepares for legal deposit of digital
items we are discovering that DRMs can pose a real,
technical threat to our ability to conserve and give
access to the nation’s creative output now and in
the future. Contracts can also prevent users’
legitimate access to databases. In fact, twenty eight
out of thirty licences offered to the British Library
and selected randomly were found to be more
restrictive than rights that currently exist within
copyright law. It is of concern that, unchecked, this
trend will drastically undermine public access, thus
significantly undermining the strength and vitality
of our creative and education sectors.
â–  DRMs are given close to total legal protection
within the UK, with no practical processes allowing
for legal circumvention in the interests of disabled
access, long-term preservation or where the DRM
prevents fair-dealing use.
â–  DRMs do not have to expire, and can effectively
prevent the work entering into the public domain at
the expiry of the copyright period.
â–  Licences, rather than contracts of sale, are emerging
as the key transaction method in the digital
environment. The majority of these licences deliver
lower-level access and copying rights than are
available under existing copyright law.
We recommend that contract and DRMs /TPMs
are not allowed to undermine the longstanding
limitations and exceptions such as fair dealing in
UK law.
Fair dealing access and library privilege should
apply to the digital world as is the case in the
analogue one.
A book or its digital copy are both equally valid
and relevant research items yet there are different
opinions on the applicability of fair dealing.
Without clarity, access to material by researchers
and the public could be eroded as a price is
increasingly attached to more and more granular
levels of knowledge.

I think it’s a step in the right direction, but my concerns continue. It is good to know that new and better tools are coming along, that libraries and archivists are getting more and more engaged, but I do not see enough understanding of the mashup culture, of co-creation and of the way Generation M thinks.

Continuing with the “livebrarian” theme

I guess my last post intrigued quite a few people, judging by the number and nature of the comments. In some ways we come back to the Nurture Versus Nature theme, and to the meaning of “expertise”. [An aside, I am still ploughing through The Cambridge Handbook of Expertise and Expert Performance, all 900 pages of it, including the index. If you’re interested in the issues surrounding expertise, it looks well worth a read. More later.]

Four themes stand out from the comments:

  • One, that the web has many bad librarians: bad in the context of their anchors and frames, bad in the context of their biases and gatekeeping, bad in the context of the expertise they possess (or not, as the case may be)
  • Two, that the profession of librarianship has understood the need to change with the times, and that they are looking at the web and to the web quite seriously
  • Three, the time dimension associated with the World Live Web is one that has magical possibilities and horrendous potential for problems as well
  • Four, we need to look at the social space and engagement and experience as closely as we look at the classification and finding and retrieval, and within this we need to understand more about the relationships and trust bonds between searcher and find-enabler

So thank you everyone for your comments, I continue to be blessed. Let me try and take some parts of the argument a bit further.

First on gatekeeping and expertise and Damn Fools.

Paul Miller gave me some very useful insights into what librarians are doing today. I was particularly taken with this:

The library of Library 2.0 exults in integrating the consistency and cohesiveness of formal classification systems with the more fluid granularity of the folksonomy.

There’s the rub. How to take historical taxonomies and ontologies and mold them into such a shape that they can be enriched by the Wisdom of Crowds, while managing to keep out the Madness of the self-same Crowds. Capture the passion, connect with the perseverance and patience, discard the Damn Fools and their biases and anchors and frames.

This can be done. This will happen. But only if we allow the passion of the amateur to flourish at the same time as the professionalism of the “expert”. There’s a Long Tail aspect somewhere in this, where we need to move out of the Hit Culture and understand that Search and Find become real when you deal with the outliers, the low-frequency requests and responses. That’s where expertise comes into its own. In the niches, in the nooks and crannies.

Paul Simmons had some very interesting thoughts about “unused” pieces atrophying and being greyed out, whether it’s software functionality or links or information or books or whatever. There’s something about the idea that I like, that intrigues me, yet I push back. Because it’s to do with the time dimension. There may be some things that come into play only once in a blue moon, but that doesn’t make them less important. In fact at blue moon time they may be critical, far more important than anything else. I think that holds true for software, for links, for information. And for books.

I fully accept Stephen Smoliar’s points about the role of credentials and of domain knowledge in conversations, and those of John Dodds and Anant in similar vein. My point was more to do with keeping the barriers to entry as low as possible, so that the folksonomy is also allowed to flourish. This is not easy to do, but should be easier with the web and with modern tools. Much of this is borne out in Paul Miller’s piece and the pdf he links to.

John Dodds’ other point about the paucity of fluid multidimensional skills required by a “livebrarian” is also of particular interest to me. With the tools we have today, we can attach time and location and context information much more “richly”, thereby improving the whole search process, something that Simon Hollins referred to in an earlier comment. We have the technology.

Once we move into an n-language n-data-type n-discipline-or-genre n-location model, I think we will also need to move into an n-person-distributed-librarian model. We have many historically disenfranchised people, some illiterate, some unable to see or speak or hear, some unable to move, many unable to understand more than one language. The web allows us to re-enfranchise everyone, but only if we get the “livebrarian” right.

Which means we have one more social shift to deal with, that of moving from deterministic request-response to probabilistic and context-aware and heuristic.

The Livebrarian becomes an aggregated “recommender”, seeking to use both formal as well as folksonomic information, enrich the request with context and location, then summarise the recommendation for the searcher. I cannot help but think that this is best done by providing wetware librarians with software assistance and peer-generated collaboratively-filtered information.

What I have seen so far in web-enabled “Ask and I shall give you advice” services is less than promising. Even Damn Fools are better. Which is why I am glad that the profession of librarianship takes this issue seriously, their domain expertise is necessary. But it is not sufficient, not until we get the value of the Wisdom of Crowds and the movement away from the Hit Culture.

I haven’t yet had the opportunity to try out Dan Pett‘s recommendation on Enquire.

Paul Anderson‘s comment on the futility of polarised debate with respect to all this is also important. We need to be comfortable with grey when pushed towards black and white. We need to be comfortable with Analogue when we are pushed towards zero and one. We need to be comfortable with Mu.

Often polarisation takes places as a pendulum response to an entrenched situation. Over time, the polarisation becomes less intense and a sustainable change takes place. Isn’t that how paradigms shift?

A coda. When I was a kid I used to read Dennis The Menace by Hank Ketcham. I found it hilarious. And in this context, two of the strips come to mind:

In one, Dennis is standing in the middle of a shopping mall. He gets asked by a friendly policeman if he was lost. And he replies “I’m not lost. I’m here. It’s my parents who are lost”.

In the second, Dennis is looking at a dictionary. When told that he needs to know how to spell a word in order to find the word, he looks bemused and says “But then what do I use to find out how to spell it?”. Or words to that effect.

I think we should also look at our children and at Generation M, to see how they search and how they find. They don’t have our biases and corruptions. Or expertise :-)

More later.

More musing about search: The role of the “livebrarian”

Following my recent post about search, there were some very interesting comments. Some suggested the emergence of new tools that are better at helping us find what we are looking for, by providing richer context and colour to the information. Some suggested that as we get better at defining who we are and what we are doing, as we get better at role and context definition, we will get better at finding things. Some suggested that the fault, dear reader, is not in our stars (or other wild cards) but in ourselves; that we should get better at defining what it is we are looking for. Some likened search to library visits, and moved from there to the role of librarians and the social engagements that take place, and on to the motives.

Great comments for which I am truly grateful, and there is work for me to do in following them up.

But in the meantime. I’ve been musing.

There are a number of critical differences between the physical libraries of yore and the digital library that is the web. I think there is a way of categorising them:

  • Time. Libraries are static. The web is live.
  • Shape. Libraries have books and magazines and CDs and DVDs and tapes and a few other things. The web has all of these, sound, picture, video, text.
  • Location. Libraries are physically located in particular places. The web is everywhere and global.
  • Scale. Libraries contain a discrete and finite number of items. The web is infinite.
  • Classification basis. Libraries rely on Dewey and its extensions. The web relies on tags.
  • Nature. When you take a book out of a library, it is with you and not with the library. When you take something out of the web, it is still there.
  • Speed of change. Libraries measure their purchases and their culling and their weeding in months. The web does it in seconds.

I could go on, but that’s not the point.

The point is that the web is live.

So we need livebrarians. Part bookseller, part journalist, but primarily librarian. Librarian of something that is live.
And guess what? We have livebrarians. All over the place. Every webmaster is a livebrarian, every blogger is a livebrarian, every creator of “UGC” is a livebrarian.

  • They do a number of librarian-like tasks which may not be that well understood or appreciated.
  • They categorise, using tags. This helps others find them.
  • They point out where things are by linking to them.
  • They go out looking for new things and make sure that the new arrivals are shown as such.
  • They take care of the old things and prune the stock as needed.
  • They even review things and comment on them, much like you have “staff picks” in libraries and bookshops

The libraries we have are new, a different paradigm. The tools we have are not yet fully fit-for-purpose, we’re still building out the library. But the tools are getting better. The librarians we have are a different breed, but they exist.

And our readers are different as well. Now they can tear things out of books, scribble on them, mix the pages up, throw them up in the air to see if they land buttered side first.

And they can write as well.

Kids are allowed to make noise. In fact everyone’s allowed to make noise. There are no SILENCE signs in the web.

We have to get better at using the tools we have. Particularly with tags and with microformats.

We have to get better at telling people what new tools we need. Because we’re the authors, we’re the borrowers, we’re the lenders and we’re the librarians. If not us who?

And we have to ensure that our new libraries have no termites or woodworm or silverfish or damp or dry rot.

Otherwise called bad IPR and bad DRM.