Search engines: filling the googleholes

In the article “Digging for Googleholes” on Slate, Steven Johnson talks about some of the reasons why you might not be able to find information using the “all-knowing” Google:

“Search for ‘apple’ on Google, and you have to troll through a couple pages of results before you get anything not directly related to Apple Computer?and it’s a page promoting a public TV show called Newton’s Apple. After that it’s all Mac-related links until Fiona Apple’s home page. You have to sift through 50 results before you reach a link that deals with apples that grow on trees: the home page for the Washington State Apple Growers Association. To a certain extent, this probably reflects the interest of people searching as well as those linking, but is the world really that much more interested in Apple Computer than in old-fashioned apples?”

Some of the arguments he uses are spurious. The one I quoted, for example, is like complaining that your friendly local librarian gave you a book on computers when went up to them and just said “apple.” Without more specific information, a human isn’t going to know you wanted to know about fruit. Google may have the knowledge of thousands of librarians at its fingertips, but it still can’t read your mind.

However, this does highlight the issue that Google (and other search engines) don’t make it clear how much information you have to specify before they’ll bring back a relevant set of search results. If you enter one term, you’ll often get back a lot of useless junk. But if you enter twenty words, you might get nothing back at all. Is it better to enter ten words and get a single, highly targeted page that matches them all; or five words to get a single page of results, with the benefit that you can scan the list and see which one is most promising?

(As a side note, I wonder how many words (on average) are sufficient to narrow down a query to a single page of results?)

Searching is a skill that has to be learned. You don’t step into a typical university library and expect to be able to dig up the most relevant information about Mesopotamian goat-herding in an eyeblink. Unless you’ve spent time learning how to use a library, you probably wouldn’t even know where to start. It is often said that knowing how to find information is just as, if not more useful than knowing the information itself. In our information-rich world, this skill is only going to become more important.

Google provides a good, simple starting point, so that even novice searchers should be able to find something. At the other end of the bell curve you have people skilled enough to act as the human back-end for Google Answers. What about the people in the middle, though? Do they even know about all the advanced searching techniques you can use? How will they find out about them? Will they have the time to spend coming to grips with them? The “advanced search” link on most search engines is easily overlooked, and when you get to the advanced page, it is usually orders of magnitude more complex than the simple search.

Personally, I think that Google is as good as we’ve got right now. But I do reckon there’s lots of scope for improvement. And I wouldn’t bet too heavily against Microsoft pulling it off. They have a history of targeting the middle ground of computing, and making it the default option. (And then proceeding to make good money from it.)

Related Links

The ultimate hot sauce

I’m a big fan of hot foods. A very big fan. Unfortunately Abi isn’t, and Alex is still too young to properly appreciate my badass voodoo chili. So when I’m in the mood for something spicy, I usually make a plain version and sex up my own portion with some hot sauce.

Sambal OelekI used to use sambal oelek for this purpose. A small jar of sambal is a standard condiment on the tables of Chinese-Indonesian restaurants in the Netherlands. If you get a take-away, you’ll be asked if you want a little sachet of sambal to go with it. Sambal tastes great in chili, and is lovely in scrambled eggs. But it has three drawbacks. First of all, it is still relatively hard to find good sambal here in Britain. Secondly, it tends to be a bit salty. Depending on the dish, you might not want that kind of additional seasoning. And finally, sambal is a mash of peppers rather than a sauce. It still contains whole seeds and small chunks of pepper, which can sometimes detract from the presentation of your dish. (Also, I find sambal a bit mild these days.)

Encona West Indian Original Hot Pepper SauceOne of the biggest brands in hot sauces in Britain is Encona, who make a selection of different flavours. I’ve tried two of them, their “West Indian Original Hot Pepper Sauce”, and their relatively new “Cajun Hot Pepper Sauce”. The West Indian sauce is made from the exceedingly hot scotch bonnet pepper. It has a powerful up-front burn, with a slightly fruity aftertaste. It can add a lot of heat to a dish with very little sauce, but because it front-loads the burn it kills a lot of the flavour from your main ingredients. I’ve tried it in chili, pasta sauces and soups, and although it has plenty of fire, it’s about as subtle as a brick to the head.

Their Cajun sauce is made from cayenne peppers (my favourite), and has a more easy-going taste. It has a much rounder, wider burn that fills your mouth much more gradually. But it is also very, very sweet, and that can have an adverse effect on the flavour of the dish you’re trying to spice up. It’s not as hot than the West Indian sauce, so although you have to add more sauce to raise the flames (which makes it easier to control the heat), you’re also adding more extraneous flavour to your dish. Which of these two sauces you’d be better off with will depend on the type of food you’re cooking, and on your personal preference for heat.

Dan T's Inferno White Hot Cayenne Pepper SauceBut I’ve been saving the best for last. Sambal isn’t the ultimate hot sauce, and neither are the Encona varieties. The best hot sauce I have ever tasted has got to be Dan T’s Inferno White Hot Cayenne Pepper Sauce. It has a deep, full-mouth burn that arrives slowly and lingers. It has a rich, dark flavour that maintains the classic zing of the cayenne pepper, but also adds depth and maturity to its spicy exuberance. The texture is smooth, with a tiny amount of dark red and orange grit that buries itself deep in the crevasses between your tongue’s taste buds. It is capable of raising a sweat in small quantities, but even larger amounts don’t kill the flavour of your original dish. It opens up a wormhole into an alternate dimension of fiery gastronomic pleasure.

It is, in short, amazing.

It also seems to have vanished from all supermarket shelves here in Edinburgh. I’ve tried Asda, Safeway, Sainsbury’s and Tesco. None of them have it. I bought my original bottle from one of them, I’m sure, but now it’s gone! The Encona Cajun sauce just isn’t an adequate replacement, but where else can I get it? I haven’t found an on-line source for it here in the UK yet, either. If you see Dan T’s in your supermarket, or if you find an on-line merchant selling it, please let me know!

Related Links

A gardening state of mind

Much though I hate gardening, it does get me out into the sunlight and the fresh air, and it gets me working with my hands rather than with my head. What happens then is that my minds starts wandering. It came up with a couple of interesting bits and pieces today:

Country names

Isn’t it funny how countries with adjectives in their names never seem to live up to those adjectives for any length of time? For example, the People’s Republic of China, the Democratic Republic of the Congo, the United Kingdom of Great Britain and Northern Ireland. Okay, so Northern Ireland remains a pretty accurate description. But I reckon that generally, countries should stick to old-fashioned, purely locale-based nation names. To do anything else is clearly tempting fate.

Cyberspace

William Gibson and other cyberpunk authors envisioned “cyberspace” as a separate environment, where people would exist as avatars of their real-world selves, wandering around in a 3D environment. But that’s not the way it’s turning out. It looks to me like cyberspace is just going to be an extension of the real world. Web sites, weblogs, chat rooms, instant messaging, texting on mobile phones…we don’t need a separate avatar to navigate these information spaces.

Cyberspace right now is made up of a series of windows on the real world, that allow us to see views, or facets, or aspects of people elsewhere. We don’t see the whole person, just the side of themselves they choose to expose to that particular window. Cyberspace is thus more like science-fictional hyperspace (or wormholes), existing purely to enable very fast point-to-point links, rather than being a habitable space in its own right.

Fiction

While uprooting a particularly vicious thistle larger than myself, a few disparate ideas that had been floating around in my head for a couple of years synthesized themselves into something that could make an interesting short story. This is the first time I’ve felt inclined to write any fiction in quite some time.


Maybe I should spend more time gardening. No, scratch that. Silly idea. I don’t think it’s the garden that makes the difference, I think it’s being away from the computer. Now that I’ve spent some time getting our garage tidied up, What I really ought to do is get my drums set up again. I’m feeling the need to hit some skins.

Web droppings

When will our leaders take responsibility?

“Let us say one thing. If we are wrong we will have destroyed a threat that, at its least, is responsible for inhuman carnage and suffering. That is something I am confident history will forgive.” (from Tony Blair’s speech to heads and spokesmen for major US corporations US Congress, Thursday 17 July 2003)

How much disgust can I express at a prime minister who comes up with a quote like this to justify a war? A letter in the Guardian today does a good job:

“Tony Blair is sounding more and more like a policeman who, having been found out being selective with the evidence, argues that the suspect was a career criminal and deserved to go down anyway.”

I would add that saying “history will forgive” us if we were wrong about Iraq having weapons of mass destruction (I use the words “us” and “we” consciously: I, along with every voter in Britain, share the blame for this disgrace) is the statement of a colossally arrogant man who believes that he has right on his side by definition. He claims he was right, but even if he is “proved” wrong, then history will overrule the doubters and call him right retroactively.

It’s the statement of a man who will not accept responsibility for his actions. Because all he has to do is wait out any crisis, and history will absolve him of any blame. It’s the statement of a zealot, spoken in the most seductive tones of the language of hate and atrocity.

History will forgive us. God will forgive us. Our reward lies in the afterlife. Kill the infidels.

No. I’m not an expert on forgiveness, but Abi and I have had many discussions on the matter. Forgiveness requires you to take responsibility for your actions, and to show remorse for them.

The Bush and Blair regimes are showing extreme determination not to take responsibility for the evils of their international policies. Despite the war supposedly being at an end, American and British servicemen are still being killed in Iraq. Hundreds of prisoners are still being kept in limbo in Camp Delta on Cuba with no charges having been brought against them. And back here in Britain, a top government scientist appears to have killed himself after being hounded as a scapegoat over allegations that he had spoken to the BBC in order to blow the whistle on certain “facts” in the government’s dossier on Iraq’s weapons capabilities.

Okay, so the foreign office appears to be doing something about some of the British prisoners at Camp Delta, but that still leaves hundreds of others that we are turning our backs on. If you have a British passport, then maybe we can help you. If not, then we’re quite content to let you rot.

This is not the position of a government that is even willing to acknowledge the possibility that they may be held to account over these human rights abuses.

As for the US position on Camp Delta, and how it enjoys special status because it lies outside the boundaries of US law… Fuck that. No, really. Camp Delta is controlled by the US military. Who controls the US military? The US Executive branch. Who can hold the US Executive branch to account for their crimes? The US Judiciary. The chain of responsibility is right there. Claiming that normal US laws about due process don’t apply in Guantanamo is tantamount to saying that the US military are a bunch of mercenaries who operate on their own recognizance, with no oversight, no charter, and no rule other than “might makes right.”

If that’s the case, what is there to stop them from holding the rest of the world to ransom over any perceived slight to their pride and supremacy? Or better yet, turning their sights on the US itself, and deposing its rulers?

I knew it was a mistake to start watching and reading the news again. It just makes me angry, depressed, and frustrated. It sickens me to see our so-called leaders deflecting responsibility to protect their own careers and the backs of their cronies. Unless they consider the possibility that they may be wrong, and take action to mitigate the consequences of their actions, history will not–can not–forgive them. Instead, they will be held up as a shameful example to future generations, a testament to lessons not learned, and a warning against the Sisyphean damnation of eternal repetition.