There is much discussion going on in semantic technology circles about how to determine authority. It has reminded me of my Reference Services course with A.J. Anderson at Simmons College GSLIS.
When I was in library school we were taught how to ascertain the authority and provenance of our sources, to ensure we were providing our patrons with the most trusted sources of information we could find. It was about RESPECT and HONOR; about doing the right thing. It was not about algorithms. No mathematically derived number will match the passion of a dedicated human, intent on finding the best source of information available with the resources at hand, with the mindset that s/he is there to provide impeccable SERVICE and if possible EDUCATE the patron.
That being said, how can we define algorithms that let us use the machine to support the human's effort? I look for integrity in my sources, but define its attributes a little differently than others in computer science fields I think.
- Is the source complete - whole/intact?
- Is the source broad and shallow (an overview) or narrow and deep (comprehensive coverage of a single or few topics.)
- Is the source there when I need it? (On the web - is the URI persistent/no "Page Not Found" errors. In print - this is why libraries have reference sections from which you cannot borrow!)
- Is the source factual - research-based, critical, op/ed?
- Is the author of the information well-suited to present on the topic? Degreed? Real-world experience of any tenure? How much experience? Participates in open discussions on the subject? Regularly published in the same or related fields? Highly regarded by peers qualified to make such a judgment? Unbiased by funding sources?
- Does the source reference other materials of the same AND differing research results or opinions?
Frequently though, despite all of this effort, at the end of a search I will find myself selecting the "right" source much the same way as the experts in Malcolm Gladwell's Blink did - I trust my instincts. Why? Because I don't often have all of the data I need to determine if a source passes the above tests.
I'd like to see an app that indexes and visualizes these elements for me - an app that visualizes what each individual determines is their own definition of integrity. Perhaps having good reviews by others of a similar knowledge/experience level as themselves on a topic is important. Perhaps having the opinions of friends is important.
I'd like an app in which each of these components is plug-n-play, not pre-determined for me like Google's 200 part algorithm.
Of course, I'll make the effort to use it.
In the meantime, please tell me in the comments what matters to you when determining authority, trust or integrity of an information source. I'm genuinely curious to learn and want to help move the dialog along.
[Interestingly, this Google search provides some excellent information on how librarians recommend you determine authority. Check them out and see if you can determine if these resources have integrity!]
