What Will Be In The Ice Cream Sandwich?

image
It may lack a pen cursor, but the responsive line you can create demonstrates the Galaxy Note's potential as a drawing tool

I am eating an ice cream sandwich, thinking about Ice Cream Sandwich. This is either a complete coincidence, or my subconscious is taking the piss.

I refer of course to the next version of the Android operating system. Each one is named alphabetically after a dessert, because the people at Google maybe drink a little bit too much at lunchtime. So the main current version of Android is known as Gingerbread, the one they brought out specifically for tablets is called Honeycomb.

Ice Cream Sandwich is meant to reunify the line, to combine the features of both phone and tablet versions and scale well to screens of any size. So far it’s available on few devices except the Galaxy Nexus, but it’s promised soon for Samsung’s other large-screened Galaxy phones like the fantastically popular S II – and of course the Note.

As I’ve mentioned, us Note owners in particular are champing at the bit for ICS. It seems such a desirable match for a device that also combines features of phone and tablet. And if leaks are anything to go by, it will introduce all-round improvements to performance and the interface. Not that there’s a lot wrong with the Note as it is; if there were no ICS waiting in the wings I’d probably be quite satisfied with Gingerbread. The main frustration is knowing it’s there, being dangled. The release date has slipped so much now that Samsung have promised a compensatory “Premium Suite” along with it, which includes a more developed pen-based note taking app and – wait for it – an exclusive level of Angry Birds.

Well and good, but for me there is a major disappointment.

A thing that could really improve the Note’s pen is a pointer, tracking the pen tip as it moves above the screen. The hardware allows for this; it’s precisely the same as that recommend for Windows pen input. On the Tablet PC and its descendants, the pen’s position above the screen – not on it – moves the pointer in the same way a mouse would; actually touching the screen with the pen is equivalent to a mouse click.

This is made possible by the clever Wacom technology employed. The pen has a radio circuit inside it. It isn’t powered by any battery though, but by radio itself – it simply resonates to a signal broadcast by a grid behind the screen. The same grid detects this echo, and thereby tracks the pen’s position. Pressing the pen’s button, or touching the screen with its pressure-detecting tip, simply modifies the signal returned.

This is excellent for drawing, because with an electronic pen there will almost always be some calibration issue – the potential for a difference between where the pen tip touches the screen and where the mark it makes appears – even if it is only parallax caused by the thickness of the screen glass. But if you use a pen and screen system like Tablet PC or Wacom’s Cintiq, you soon learn to watch not the tip of your pen, as you would if you were drawing on paper, but the cursor that tracks it on the screen. That way there is no calibration issue, your line appears precisely where you expect.

Samsung’s S Pen however follows the same paradigm as finger input. The screen is – seemingly – unaware of the pen’s position until it touches it. But Ice Cream Sandwich, being conceived to run on a much wider range of hardware, has native support for digital pens which includes being able to respond to “hover” events. It must therefore be aware of the pen’s exact position above the screen – and could be displaying it.

So it would be nice to see a little dot tracking the pen in S Memo, the Note’s inbuilt drawing app. But going by videos of a leaked version of the upcoming firmware, it seems alas it is not to be. Perhaps Samsung consider it too big a break with the touch-input paradigm. It’s a shame though, because the potential seems to be there.

Will we see developers taking on the challenge? A drawing program with a pointer could be a killer app for the Note range of phones and tablets. Especially if it also had the other features most sought after by artists: Layers of course, a good painting engine that creates convincing brush and pen strokes (like the one from the open source MyPaint project), and selection and fill tools.

Anyone feel like coding that?

alas

The Phone That Should Have Been King

But boy, could it multitask. Sixteen apps running simultaneously on the N900’s task management screen. And sixteen is just the most you can show without scrolling. Like a PC, there is no upper limit except available memory.

Two years ago Nokia’s future was going to be Maemo, a cutting-edge operating system based on Linux with a sleek interface to replace the veteran Symbian OS. The phone that would bring it was the N900. This had the same processor as the rival iPhone 3GS, plus a much better screen and camera, neat slide-out keyboard, a kickstand and great stereo speakers for watching video, and even features the iPhone lacks to this day like real multitasking and a memory card slot.

As Nokia had been and was still the leading maker of smartphones, you might imagine a pent-up market of loyal customers gagging for a device that would show that upstart Apple. Yet when it arrived they stayed away in droves. The N900, very arguably the most advanced and capable phone yet made, was a magnificent, absolute, utter market failure.

What the hell went wrong? More than one thing, clearly. A phone with that much going for it could surely have survived one weakness, maybe even two or three, and still gone on to be a big seller.

Four though is pushing it.

Nokia N900, dial mode.
Not its best angle

The other week I showed it to an iPhone-using friend. She was interested, but asked – quite innocently – “Why is it so thick?” It’s true, it’s as thick as a brick. Downright chubby. Though its other dimensions are almost identical to the iPhone 3GS, it’s half again as deep. Is that such a bad thing? Thickness is actually a practical advantage in a phone, there’s little chance of cracking this one in your pocket. But such arguments weigh little in the scales of fashion. People have to be slim, therefore our phones have to be slim too – that seems to be about all the logic there is to it.

An even more damaging shortfall though was the strange absence of multitouch. Perhaps Nokia had too little experience with the necessary screen technology, but launching the N900 without a modern interface was like naming a ship “Abandon”. A resistive screen with a stylus for tapping little icons was an interface from obsolescent Windows Mobile and historic Palm devices. Nobody wanted one now.

Nobody, except a few freaks such as myself. Resistive is far better suited to drawing than the capacitive type of screen used for multitouch. Capacitive requires a large contact area with the surface, making precise detail impossible. Plus it lacks any dimension of pressure sensitivity, while resistive screens can be highly responsive to changes in the pen press.

Combined with pressure-aware Linux drawing applications like MyPaint, this ‘outdated’ resistive interface allowed realistic pen-like or brush-like drawing strokes. This made the N900 the best phone ever created for art,¹ a powerful but sensitive digital sketchbook you could carry in a pocket. Many of the cartoons appearing on this blog were done with it – pencilled, inked, coloured, lettered and uploaded without ever seeing paper or PC. You can even edit images with GIMP, a program with capabilities comparable to the full desktop version of Adobe Photoshop.

But the very thing that most endeared it to me was a huge turn-off to the wider public.

English: Nokia N900 communicator/internet tabl...
Looks better this way

Then there was the lack of apps. As Apple were first to realise, shopping is part of the experience now. A phone is nothing without stuff you can buy for it. There are some very good apps available for Maemo – but almost none to buy. Its Open Source Software roots meant that people were keen to contribute useful stuff. With a little tweaking it could even run apps built for desktop Linux. But that actually worked against a market for the Maemo platform. Professional app developers were discouraged by having to compete with free.

And this cultural clash, Open Source on one hand and commerce on the other, created other unforeseen problems. If you’ve got an issue with a community-developed program, to whom do you complain?

You don’t. In the cooperative world of OSS you file a bug report, documenting the issue and the circumstances that produce it. Which is lovely, but customers who’ve paid money for a fancy phone hardly expect to have to help out as well.

English: The Nokia N900 showing system informa...
Terminal: Fatal

Nor do they expect tech support that tells them to open a terminal window and enter Linux commands. That isn’t actually as intimidating as it might sound, but “Buy this and soon you’ll be learning Linux” is not the sort of slogan that say Apple would use. Or indeed anyone who wanted to sell anything.

And yet… It was so damn promising. If they had moved quicker to smooth off the edges of Maemo, if something like the N9 had arrived a year earlier – while people were still actually waiting for it – it might have been a hit instead of a peculiar footnote². Instead, Nokia paid brutally for not getting their collective arse in gear.

But, it was a remarkable achievement and a fascinating experiment. Even when it’s no longer my primary phone I’ll keep the N900 around, especially for travel, as an incredibly miniaturised PC. They can be picked up new on Ebay for under $200 now, I recommend them highly.

 

___________________________________________________________________

  1. Though Samsung were later to make the impossible dream come true by putting an actual Wacom digitizer on a phone.
  2. A footnote to the footnote: There are rumours that Nokia have quietly continued their Linux-based development – just not for smartphones. Dubbed Meltemi, a descendent of Maemo is rumoured to be the future replacement for the S40 “dumbphone” system that has done so well for them for so long, and could be used to bring smartphone-like features to low-cost devices. That might prove competitive against the rising tide of (frequently awful) cut-price Androids. A sad end for the noble Maemo maybe, but it could save Nokia’s bacon – and of course make them less dependent on Microsoft. Who’s to say that a Linux smartphone will not rise again?