Draft 2 for ‘symbol manipulation session’

When presenting the keynote address at the World Library Summit in Singapore in 2002, Doug Engelbart remarked on his impression of the computer when he first came across it. This was in the era when computers were still used simply to compute, to crunch numbers. He said:

symbols

“I saw that we have a tool that does not just move earth or bend steel, but we have a tool that actually can manipulate symbols and, even more importantly, portray symbols in new ways, so that we can interact with them and learn. We have a tool that radically extends our capabilities in the very area that makes us most human, and most powerful.”

symbols are connections

Symbols get their meaning and power from their connection to something else, often other symbols–symbols get their power from the way they connect–a letter of the alphabet has little meaning without connecting to other letters, and words have little meaning without other words.

This connective aspect of text is massively important and in the digital environment the connective aspect can be powerfully extended. Not just through the common blue-underlined link. Doug spoke of implicit links, link types, high resolution linking, backlink databases and more.

connections need addresses to connect

I would like to highlight one aspect of connections for a minute: Addressability.

What we point to must exist in some location, somewhere addressable.

Everything hinges on this: To point, to connect, what you are pointing at must be addressable.

You can’t even open a document if you cannot point to it. That’s the most basic interaction in our modern graphical user interface.

I don’t think it’s an exaggerating to say that with knowledge work everything is made more powerful through more powerful pointing, or constrained by more limited pointing.

citations

This sounds quite abstract I’m told so I would like to illustrate with one very concrete case:

When my beautiful boy Edgar is a bit older I expect we will experience an argument with him where his justification for something will be “because that’s what she said”. Yes, I expect he will start using citations… The citation in this case having only the most tenuous link to the source; he simply asserts and points to a source. A source which may very much deny what was asserted and the source may very well be unavailable.

analog citing

When I was young I was taught to cite by referring to a book, since books were authored and therefore authoritative of course. The way I would link what I was quoting was through meticulously listing what book I was referring to, in other words the author, title, year of publication and edition and perhaps the publisher and so on. I would then note the page number so that my teacher or whoever else might read my paper would be able to check the citation, by going to the library, finding the right section for the book, then the book itself and then by opening it to the said page and finding the text I was referring to.

Of course this did not happen all that much–books cited were either books assigned by the teacher and if I cited something my teacher had not read the chances she would actually look up the citation was minimal. This was a dirty secret of academia but now that we live in a world of links it is super-quick and easy to check on citations right?

digital citing

Yes. If the link is to an open web page, that is to say not behind a pay wall and the link is still active. And even then, it will only open the document, it will not allow you to point to a specific section as you could with a paper book where you could point to a page number. If someone has explicitly taken the effort to add a pointing target to the point where you needed it, called an anchor tag, you could, if you know how to find the anchor tag, link to the specific section of the document.

However, if you wanted to refer to a specific page or section in a digital book you had purchased on your Kindle or in the iBooks Store you would be out of luck. The means through which Amazon and Apple address content in ‘their’ books is proprietary and we have no means of accessing it. We have no way to point to it.

If you want to point to a section in a PDF, well, that’s just pure fantasy at this point.

I would say exacerbates that dirty little secret of academia. If an academic writes a citation to something you are already read you can evaluate its relevance and veracity. If it’s to something new, a book or a PDF you have not read, all the king’s horses and all the king’s men cannot put the link back together again. The link is lost, not much more useful than a toddler asserting that “he said, she said”.

inter-operability

The same goes for inter-system communications. If you don’t know what you are pointing at then you are just waving your arms around in the dark.

addressability enables pointing and interaction

In closing, digital interaction hinges on addressability and in the digital realm this is something we have to construct, it is not inherent as it is in the physical world.

Without local addressability we cannot open a file, we can not move a word around the screen.

Without wide addressability we cannot reliably refer to each others work, each others thoughts. We cannot move around in our information. We cannot even annotate without being able to somehow point to what we are annotating and if we can, how great would it be to search only one’s annotations across any corpus of knowledge and to string citations along with them?

And as with our fingers pointing around in the room, the higher degree of flexibility and finesse we have, the more power we have in our interactions.

This is not a technical issue, this is a socio-technical issue. This is an issue we can and must work on together.

session explorations

In this session we will explore aspects of symbol manipulation and of connection interaction in addressable space.

We will look at how can we build digital environments where we can move around freely and employ all kinds of basic and advanced tools to interact with the connections of our knowledge

Who do we want to become? Interactive or passive? More connected or more isolated?

The development of our tools and the underlying infrastructures while largely determine the answers to these questions and we will develop the the tools and their supportive infrastructures based on who we want to become.

So I ask our panellists: Who do we want to become and what do we need to do to enable this to happen?

Founder of The Liquid Information Company, which makes the Liquid | Flow text interaction tool and the macOS word processor Liquid | Author: www.liquid.info