Thursday, July 2, 2015

Do androids trip on electric acid?

Have a look at some of these images and take note of whatever adjectives come to mind.  If other people's responses are anything to go by, there's a good chance they include some or all of "surreal", "disturbing", "dreamlike", "nightmarish" or "trippy".  Particularly "trippy".

These aren't the first computer-generated images to inspire such descriptions.  Notably, fractal images have been described in psychedelic terms at least since the Mandelbrot set came to general attention, and the newer, three-dimensional varieties seem particularly evocative.  The neural-network generated images, however, are in a different league.  What's going on?

Real neural systems appear to be rife with feedback loops.  In experiments with in vitro neuron cultures -- nerve cells growing in dishes with electrodes attached here and there -- a system with no other input to deal with will amplify and filter whatever random noise there is (and there is always something) into a clear signal.  This would be a "signal" in the information theory sense of something that's highly unlikely to occur by chance, not a signal in the sense of something conveying a particular meaning.

This distinction between the two senses of "signal" is important.  Typically a signal in the information theory sense is also meaningful in some way.  That's more or less why they call it "information theory".  There are plenty of counterexamples, though.  For example:
  • tinnitus (ringing of the ears), where the auditory system fills in a frequency that the ear itself isn't able to produce
  • pareidolia, where one sees images of objects in random patterns, such as faces in clouds
  • the gambler's fallacy, where one expects a random process to remember what it has already done and compensate for it ("I've lost the last three hands.  I'm bound to get good cards now.")
and so forth.  The common thread is that part of the brain is expecting to perceive something -- a sound, a face, a balanced pattern of "good" and "bad" outcomes -- and selectively processes otherwise meaningless input to produce that perception.

In the generated images, a neural network is first trained to recognize a particular kind of image -- buildings, eyes, trees, whatever -- and the input image is adjusted bit by bit to strengthen the signal to the recognizer.  The code doing the adjustment knows nothing about what the recognizer expects.  It just tries something, and if the recognizer gives it a stronger signal as a result, it keeps the adjustment.  If you start with random noise, you end up with the kind of images you were looking for.  If you start with non-random input, you get a weird mashup of what you had and what you were looking for.

Our brains almost certainly have this sort of feedback loop built in.  Real input often provides noisy and ambiguous signals.  Is that a predator behind those bushes, or just a fallen branch?  Up to a point it's safer to provide a false positive ("predator" when it's really a branch) than a false negative ("branch", when it's really a predator), so if a predator-recognizer feeds "yeah, that might be a four-legged furry thing with teeth" back to the visual system in order to strengthen the signal, survival chances should be better than with a brain that doesn't do that.  A difference in survival chances is exactly what natural selection needs to do its work.

At some point, though, too many false positives mean wasting energy, and probably courting other dangers, by jumping at every shadow.  Where that point is will vary depending on all sorts of things.  In practice, there will be a sliding scale from "too complacent" to "too paranoid", with no preset "right" amount of caution.  Given that chemistry is a vital part of the nervous system's operation, it's not surprising that various chemicals could move such settings.  If the change is in a useful direction, we call such chemicals "medicine".  Otherwise we call them "drugs".

In other words -- and I'm no expert here -- it seems plausible that we call the images trippy because they are trippy, in the sense that the neural networks that produced them are hallucinating in a manner similar to an actual brain hallucinating.  Clearly, there's more going on than that, but this is an interesting result.


When testing software, it's important to look at more than just the "happy" path.  If you're testing code that divides numbers, you should see what it does when you ask it to divide by zero.  If you're testing code that handles addresses and phone numbers, you should see what it does when you give it something that's not a phone number.  Maybe you should feed it some random gibberish (noting exactly what that gibberish was, for future reference), and see what happens.

Testing models of perception (or of anything else), seems similar.  It's nice if your neural network for recognizing trees can say that a picture of a tree is a picture of a tree.  It's good, maybe good enough for the task at hand, if it's also good at not calling telephone poles or corn stalks trees.  But if you're not just trying to recognize pictures, and you're actually trying to model how brains work in general, it's very interesting if your model shows the same kind of failure modes as an actual brain.  A neural network that can hallucinate convincingly might just be on to something.

Saturday, May 2, 2015

The invisible oceans

Life as we know it needs water.  Two conclusions that don't follow from that premise: Life needs water, and where there is water, there must be life.  Nonetheless, in our present ignorance, the best bet for finding other life is to find water.  Liquid water, that is.

Over the past few years there has been a steady stream of discoveries of likely liquid water in our solar system.  Jupiter's moons Ganymede and Europa probably each have more than Earth does, even though both are considerably smaller than Earth.  Enceladus (a small moon of Saturn) probably contains significant amounts.  The planet asteroid dwarf planet Ceres also shows possible signs of an ocean.  Pluto and Charon might also.  We should know more about them in a few months as I write this.  In the case of Pluto and the moons, tidal flexing generates the heat that keeps the water liquid.  The case of Ceres is less clear, so from here on I'll restrict discussion to the moons.

What these masses of water all have in common, of course, is that they lie deep beneath the surface.  Tens of kilometers, at least.  Some, at least are also salty enough to conduct electricity well, as evidenced by their interaction with magnetic fields.  It's not clear what kind of pressure they are under, or what their range of temperatures is, except that they are likely sandwiched between layers of ice, or maybe between ice and rock, or maybe in alternating layers of various forms of ice (yes, there is more than one kind).  They will thus be literally ice cold in at least some regions, though they are probably considerably warmer in other places.  They certainly receive no sunlight.

Could life evolve under such conditions?  Who knows?  Personally I'd be reluctant to rule it out.  We've found life in all kinds of unlikely habitats on Earth, and in any case we just don't know that much about how life develops.  So suppose it did develop on one of these moons.  What would it be like, and what would be our chances of encountering it?


The first question is whether there is enough in these oceans to get microbial life going.  The short answer: no idea.  We don't know very much at all about the chemical composition of these oceans, though we can make some informed guesses, and again we don't know very much at all about how microbial life on Earth developed, though we can make some informed guesses about that, too.

It's pretty clear that there will be various impurities in the ocean water, so there might well be potential for some sort of self-replicating, information-carrying polymer, similar to RNA, to develop.  There is an outside source of heat from tidal flexing, and there will be temperature gradients as a result [perhaps as much as 40K over a few hundred kilometers], so the laws of thermodynamics don't rule anything out.  Let's assume that microbial life of some sort can develop.

The path from single-cell organisms to colonies of single-cell organisms to colonies of single-cell organisms with different forms (but the same genetics) to something we may as well call a multicellular organism is reasonably clear, although at least in the case of life on Earth it seems to have taken a good long time to develop.

Since we're totally speculating, let's assume there are multicellular organisms analogous to our own sea creatures, but possibly very different in form.  Again, in reality there might be nothing at all, or only single-celled organisms, or some sort of microbe without clearly defined cells at all, or who knows what.

What kinds of features might these critters have?
  • Some sort of chemical sense analogous to smell or taste seems like a good bet.  It's almost a defining property of life that it will respond to chemical stimuli in some way or another.  Microbes do.  Animals of all sizes do.  Even plants and fungi do.  I wouldn't necessarily call a slime mold constituent detecting another's chemical signal "taste" or "smell" but ... some sort of chemical sense.
  • For similar reasons, a temperature sense seems likely.
  • Food webs, predator/prey relationships, mutualism, parasitism, commensalism, amensalism and any number of other relationships among organisms are pretty much inevitable when there is more than one kind of organism.
  • Some way of shuffling genetic material as with sexual reproduction.  A source of variability beyond random mutation can be useful in surviving long-term in harsh, ever-changing environments.  Even microbes do this to at least some extent.
  • Various ways of physically manipulating objects ... tentacles, pincers, pseudopods, maybe even something resembling hands
  • Some sort of nervous system for communicating signals, including sensations from the senses, from one part of the body to another
  • Sociality in at least some species.  We're assuming there are multicellular organisms, which is not so different from sociality at the cell level.  This is the next level: sociality among multicellular organisms.  Sociality requires some means of communication between organisms.  Chemical signals and sound seem like plausible candidates.
So far we have a world comprising organisms of various sizes and forms, some herding/schooling together, some hunting others, with the ability to grab things and move them around ... much like life as we know it, except quite likely totally different.

But then, we assumed many important premises based on experience with life as we know it, particularly cells, and we assumed that evolution would follow essentially the same rules as here.  The second assumption, at least, seems pretty reasonable, but who knows?


It's natural to think such an ocean would be dark and all its inhabitants blind, but maybe not.  Plenty of deep-sea creatures find it useful to have eyes and even to produce light.  Light-producing molecules are not that complex.  There are ones that require only carbon, hydrogen and oxygen, so we don't need to assume phosphorous or sulfur, just some source of carbon in the water, which is probably inevitable.

The evolutionary pathway to light and sight is not so clear, though.  On Earth there is a source of light independent of life and it's not surprising that eyes would evolve in the sunlit portion of the ocean, at least.  In naturally pitch-dark oceans, there would have to be some source of light, as a side-effect of something else, before light-detecting cells and organs become useful.

So let's assume it's dark.  Being visual animals, we might assume that that's a big deal, but maybe not.  There are plenty of other ways to get a good picture of the world without seeing it.  In particular, hearing will be important.

Sound carries well in water, and given that the whole world is constantly flexing, there ought to be at least some natural sources of sound.  Unlike the case of vision, it's almost inevitable that organisms that are reasonably large and able to move and to move things will end up making some noise doing so.  This all suggests it would useful to be able to hear.  If it's useful to hear, it becomes useful to be able to make sounds, both for communication and possibly for active sonar.

So we have a dark, noisy and probably fairly cold place teeming with organisms of various shapes and sizes, and schools of this and that all trying to eat and not be eaten.  Will we ever see it?  All we'd have to do to see it is fly a probe a billion kilometers or so and have it dig through kilometers of ice.  Keeping in mind that at the surface temperatures we're looking at, ice acts more like any other mineral than the softish stuff you can chew (to the horror of your dentist).


Since we're speculating, let's say that something we would recognize as an intelligent species develops.  Are they likely to come visit?

Humanity went into space driven by (among other things) the curiosity inspired by the sun, moon, stars and planets.  Even if you don't buy that, you have to admit that we could at least see the sun, moon, stars and planets without any technological help.  Our hypothetical ocean-dwellers could live indefinitely with no clue that there was a solar system out there, or anything else at all.  They would have no direct way of knowing that the parent planet, or even the surface of their own moon, existed.

Even the existence of gravity might be the subject of intense debate.  These moons are relatively small.  The surface gravity of Ganymede, for example, is about 0.1g.  If you're considerably beneath the surface the influence of gravity decreases since you also have matter above you, but that's probably not a major factor at the scales we're dealing with.  If our own oceans are any clue, most things will be near neutral buoyancy.

Put that together and you have a general tendency for most living things to float around in an ocean layer dozens of kilometers deep (thick?) and thousands of kilometers around.  Some inanimate things would tend to drift, very slowly, toward the inner surface (that is, sink).  Others would tend to drift, very slowly, toward the outer surface (that is, float).  This would not be nearly so easy to sort out as the general tendency of things to fall quickly to the ground on Earth.

Figuring out that the world is round would be a significant accomplishment.  The major cues the Greeks used -- ships sinking below the horizon, lunar eclipses, the position of the noontime sun at different latitudes -- would not be available.  The most obvious route left is to actually circumnavigate the world.  And figure out that you did it.

I'm very reluctant to say "such and such would be impossible because ...", but I think it's safe to say that a number of things we take for granted living on the solid surface of a planet with an atmosphere transparent in many wavelengths would be a lot harder in these worlds.  On the other hand, if an inhabitant ever did make it to space, they'd probably have a much better intuitive feel for it than we do.



There's one major factor I haven't mentioned here, that's been cited as a reason that no underwater species could ever develop technology.  Fire doesn't work.  Without fire, a host of things become much harder, if not impossible, including metal extraction and heat engines (steam, internal combustion, etc.).  Underwater rocketry also seems like a stretch, though jet propulsion is not a problem (the difference is that jet propulsion uses the medium one is traveling through, while a rocket creates its own exhaust).

From an earthbound perspective, knowing about our technologies, it's easy to say what familiar technologies probably wouldn't work in such a world, at least not the way they work here.  It's harder, though, to say what unfamiliar technologies could work.  This makes it tempting to say things like "There's no way that life in Ganymede's oceans could contact us.  They wouldn't even have fire."

But we've had, depending on how you count, at least thousands of years to figure technology out.  Depending on how things develop, particularly the transition from single-celled to multi-celled organisms, our hypothetical counterparts might have had tens of thousands, or millions of years.  Or no time at all since they haven't gotten far enough yet.

So what's at least possible in such a world?  Here are some wild, sketchily-informed guesses:

Mathematics: "Can mathematics develop?" seems very much the same as "Can intelligent life develop?", if only as a matter of definition.  If it can't handle at least some form of mathematical thought, can we really call it intelligent? Let's assume that these sea creatures have learned not only to count, but to "think abstractly", whatever that means.  While we're at it, let's assume something we would recognize as a language.

Writing: It's unlikely that anyone is going to whip out a ballpoint pen and write on the back of a napkin, so we need to define "writing" a bit more abstractly.  What we're really after is a permanent means of recording language in via discrete symbols, that is, in digital form.  This doesn't require much, for example, some sort of solid material that can be manipulated and will hold its form.  For example, it doesn't seem unlikely that there could be something resembling rope, which would enable something like the quipu.

Physics: If our critters have mathematical ability and curiosity, they will begin to notice and codify basic facts about their physical world.  Fluid dynamics would be an obvious subject of study, along with some aspects of thermodynamics, particularly at water/ice boundaries.  Electromagnetism, or at least magnetism, is not out of the question.

On the other hand, Newtonian mechanics might take quite a while.  We can ignore wind resistance and get reasonable answers for many problems.  Water resistance is a whole different matter, so it might take quite a while to develop a notion of inertia.  Modern physics -- particle physics, quantum mechanics, relativity, plasma physics, low-temperature physics, etc., requires something like modern technology, of which more in a bit.

Chemistry: This will certainly be tricky.  You can't just pour something in a beaker or dump a solid chemical into a liquid solvent -- at least not without producing the solid chemical in the first place.  But who knows?  If there is life, there are chemical reactions going on all the time naturally.  Perhaps someone learns that a particular gland-y thing from one creature does funny things when you stick a bone-y thing from another creature in it, or that you can use thus-and-such material to isolate a kind of water that acts unusually, and eventually this becomes a systematic body of knowledge.  Not out of the question, and not as much of a leap as astronomy would be, but still doesn't seem like it would be a strong suit.

Biology: Large parts of biology -- cell theory, for example -- require some sort of microscope, but other aspects just require careful observations of other living things.  Evolution is an interesting example.  It's not clear what kind of fossil record there might be, though non-living things would tend to float or sink, but evolution fundamentally requires figuring out that there's a family relationship among seemingly different living things, and realizing that the world is old.  That's certainly not out of the question.

Materials science: Metallurgy requires a supply of metal, which would likely be hard to come by, but one could learn a lot about the properties of the materials around -- tensile strength, hardness, elasticity and even, with more careful observation than we need in our environment, density, heat capacity and such.

Cities: There doesn't seem to be any fundamental reason there couldn't be something we might call  agriculture, and floating cities, at least, forming around it.  Suppose again that there's some sort of rope-like material, and suppose something edible likes to grow on it.  It might then be natural to build largish structures and garden them.  This in turn would provide a reason to stay close instead of wandering off, and along come civilization and its discontents.

Fire: At some point a technological species needs to figure out how to do things that don't happen easily in the natural world.  For us, you could argue it was extracting metals sometime in prehistory, or maybe harnessing steam, or maybe something in between.  For an undersea world, creating an environment where things could burn would be not only a significant achievement, but a gateway to what we might consider industrial technology.  If they can make fire, then it's hard to think what human technology would be out of reach, because to make fire, you need to recreate an environment not too different from ours.  At the very least you need a bubble of some sort of oxidizing atmosphere.  Once that happens, pretty much everything that seems implausible on the list above becomes possible.


So who knows?  There doesn't seem to be anything in principle keeping life on some extraterrestrial ocean from being able to get to us.  It just requires a long chain of unlikely events.  But then, life is full of those.  If you roll the dice billions of times and you get to keep lucky changes around for the next roll, the extremely unlikely can become quite plausible.  In this case, our chain of events looks something like
  • A self-replicating molecule develops
  • Microorganisms develop
  • Multicellular organisms develop
  • Some of them develop what we might call intelligence
  • These develop a body of mathematical and scientific knowledge
  • From that, they develop what we would recognize as technological tools, including
    • Ways of storing energy and converting it to work
    • Probably some way of creating sizable bubbles of gas, and ways of working inside them
  • One way or another they find their way to the surface (which is much farther away than humanity has ever managed to dig into the Earth's crust)
  • And then they get in contact with us, somehow.
On the other hand, we know we're coming their way (if they're there).  It's going to be quite some time before we can send a probe to their habitat, but there's one other way we could meet up: One of the reasons we believe that Ganymede and other worlds have water: cryovulcanism, that is, liquids coming to the surface through cracks in the crust (the "cryo" part is there because these liquids are a lot colder than the magma we're familiar with).

If water is coming up from the liquid interior of one of these moons, it might well carry something along with it.  With luck, it might be something like a tardigrade that can survive being dried out and frozen.  Or there might just be a fossil bed of life forms that might not have even made it to the surface alive.

Or, maybe, just maybe (and by "just maybe" I mean "almost certainly not, given all the things that would have to go right"), it might be a hardy explorer, wearing some sort of protective suit, struggling against the surface gravity that we would consider negligible, and wondering at the bizarre new world, and ... what's this thing coming at me from the ... what do you even call it without knowing "stars" and "empty space"?

Saturday, March 21, 2015

Fermi and the revenge of the machines

Previously, I argued that the odds of our actually directly detecting an intelligent species from another star system are very low, partly because of the vast distances involved, but also because of timing.  However, there is another possibility besides detecting such a species on their home world: maybe they'll come to us.

"Or maybe we'll come to them", you might counter, and maybe, eventually.  I'm going to leave that aside for now because, while we have some interesting theoretical ideas of how we might reach another star system, at this point they're just that, and the more realistic ones involve moving maybe a ton of payload to a nearby star in somewhere around a human lifetime, and score around a seven on the scale of difficulty I gave earlier.

The amount of energy involved in doing even that is staggering.  By comparison, the New Horizons probe that's currently nearing the Pluto system as I write this was launched on one of the larger rockets ever produced, received a significant gravitational boost from Jupiter, and has been traveling for around ten years.  To get to Proxima Centauri in a small number of decades, you'd need to be traveling around 2000 times as fast.

The energy required goes as the square of the velocity (until you get to relativistic speeds, where it gets much, much worse), so we're looking at 4 million of the rocket that launched New Horizons.  Put another way, the kinetic energy of a one-ton object moving one-tenth the speed of light is comparable to
Actually accelerating such an object to that speed would take considerably more energy.

However, one of the main points of the previous post was that some significant portion of intelligent species would have arisen millions or hundreds of millions of years ago, and another was that there were likely a great many such species scattered throughout the galaxy, not to mention other galaxies.  Maybe billions in our galaxy alone, using not-totally-implausible guesses. Put that together, and there might be a large number of species which have had plenty of time to reach us, and plenty of time to develop the technology to do it.  The timing that undermined our prospects of spotting other life directly actually works in our favor now.

So let's say that some technological species arose ten million years ago and 50,000 light-years away.  If they'd built a craft capable of traveling 1/200 the speed of light, or about 100 times faster than New Horizons, that craft could have reached us by now.  And maybe even have stopped.

Or, it could have reached any of a few hundred billion other stars.  Even if it had launched, say, ten craft a year for a million years, each equipped with a means of navigating to a distant star and then slowing down, the odds would still be about 10,000 to one against one reaching us.


However, there's a scheme that's been floating around for quite a while that would dramatically increase the chances of something eventually getting to us: send self-replicating craft.  This is not something we could do right now but it's quite plausible that we could in the next century or so.  It doesn't seem too much to ask that some civilization, somewhere, with a million or more years of head start, could have done this.

It's an interesting scenario to contemplate.  Weight is critical at these speeds, so the craft will probably carry only the bare minimum it would need.  It would enter a new star system and find a solid planet or moon to set down on.  It would then start digging into the surface (assuming there's no one there to run across it and ask "Hey, what's this?") and gradually assemble raw materials.  From those it would assemble basic tools, use those to assemble more sophisticated tools, and eventually spacecraft parts, which it would then proceed to put together.  Some amount of time later it will have made a copy of itself, which would then take off for a nearby star system, while the original goes on building copies of itself ...


You'd want to be a little careful with this.  If you literally sent a copy to every nearby star system, that would include ones you've already visited (even the home world), and some of those would make their way back to where they started, and start making copies of themselves.  That is, you would get exponential growth, everywhere the probes visit.

The total number of craft might double every few centuries.  If every copy used a ton of raw materials, they would consume the mass of our Moon in about 70 generations of copying, or a few dozen millennia.  In a few million years, probes could eat every planet, planetoid and moon in the galaxy.  Or, at least, every unpopulated one.  Or, at least, the portion of the material of the unpopulated ones that was suited for making the craft.

The polite way to send such probes would be to remember which places you'd already visited and only send copies to new places.  In technical terms, this results in a breadth-first search of the galaxy.  Instead of exponential growth you get cubic, that is, a steadily expanding radius of exploration.  In our scenario of craft traveling 1/200 the speed of light (and not taking too long to build copies), this would cover the whole galaxy in around 20 million years, starting at the edge, or 10 million starting near the center.

In sum, if anywhere in the hundreds of billions of stars in the galaxy 20 million years ago someone had successfully launched a self-replicating interstellar probe, one copy (or more) could have made it to the solar system.  A heady thought, to say the least.


One question that always bothered me about this scenario was "why?"  Even if the various probes could relay information back to the home world (and this is totally handwaving how one would produce a signal strong enough), the finite speed of light becomes a problem.  It's going to take a thousand years to get information back from a system a thousand light years away, and 200,000 from one edge of the galaxy to the other.  Why bother?  I mean, who am I to say how long a lifespan, or attention span, an alien species might have, or what its motivations might be, but still ... it's hard to see the point.

However, you don't have to set out to cover the whole galaxy in order to end up doing it.  Suppose we just wanted to explore our neighborhood of a few thousand stars?  A self-replicating probe would be cheaper and easier than trying to send a probe to every star individually.  In which case, why stop?  If we're interested in data from a star 50 light-years away, why not 60, or 100?  The easiest approach is to just let the probes keep copying.

A bit unsettlingly, it's even easier not to bother screening out already visited systems, that is, letting exponential growth continue unchecked.

In a slightly less scary variant, the probes somehow send messages to each other ("heartbeats", effectively) and only send copies to stars that aren't sending anything.  This way if a probe goes dead, another will eventually take its place and the galaxy will remain completely covered indefinitely.  Among other things, this means that if you're actively trying to get rid of probes, that may turn out to be somewhat difficult -- it only encourages them.


Once we get into galaxy-spanning schemes, we're looking at hundreds of billions of copies.  There are bound to be a few mistakes here and there, and those mistakes may continue to propagate.  The ones that do will continue to make copies, and some of those copies will be imperfect.  "Mistake" here just means "different from the original".   Such a mistake might be innocuous, or it might result in a less worthy probe, or it might even result in an improvement.  One way or another, the population will evolve over time.

So we have something that can use energy in an organized way, reproduce and evolve.  We may as well call that "life".  It's most likely not the same life form as the one that first built it on the original home world, but that seems like a minor point.  It's quite possible that there is life spreading out through the galaxy, or already occupying every corner of it, even while its creators are still confined to a single world, or no longer around at all.  And that life might well have reached us, or even be here now.

This makes the question of "why haven't we noticed" a bit more interesting.

Thursday, November 6, 2014

Language family trees, new and old

For the most part, change in language is gradual,  though with some exceptions.  People do develop new languages quickly, and not only with constructed languages like Esperanto or Klingon.  It can happen naturally in a couple of ways.

When populations with different languages are brought into close contact, it's common for people to work out a "pidgin", a sort of half-language with vocabulary taken here and there from either parent language, but with minimal syntax and grammar.  Or at least that's been a prominent theory.   There's been some revisiting of just how simple pidgins really are.

One way or another, though, the children who grow up hearing the pidgin end up speaking a "creole", which is a full-fledged language with its own grammar and syntax, and distinct from either of the parent languages.  Confusingly enough, these creoles are often referred to as pidgins.  Tok Pisin is a classic example.  It's been around long enough to develop its own dialects.

There are also sign languages that can be traced back to a small community that, as far as anyone can tell, invented its own language spontaneously since they needed to communicate and (obviously) couldn't use any of the spoken languages around.  These are interesting in that they say something about our innate ability to use language, even without being exposed to one.

Unlike pidgins and creoles, which hybridize existing languages, these sign languages are constructed from scratch and, to be clear, they have the same kinds of complex features that spoken languages have, including the use of arbitrary symbols for abstract concepts.  Like any other true sign language, these are not simple gestures and pantomime, and like other languages, sign or not, they too can develop variants and dialects over time.

There are probably other examples along similar lines.  People have been using languages for quite some time, and there have been quite a lot of people over that time.

Nonetheless, the vast majority of the world's thousands of languages trace their lineage back over thousands of years of gradual change, likely all the way back to the exodus from Africa some 50,000 years ago, and beyond.  Why should we think this?

The main reason to is that most of them bear a family resemblance to other languages.  That is, they share features in common with those other languages, and those features indicate a branching pattern of languages diverging repeatedly from earlier forms (but also intermixing and hybridizing, so we don't have a pure "tree structure").  In some cases we can directly trace the development of a language family, for example the Romance languages of Europe (French, Italian, Portuguese, Romansch, Romanian, Spanish and several others, all derived from Vulgar Latin).

By careful comparison of the various features of similar languages, and by clues in the structures of the languages themselves, we can form a fairly precise model of how the various languages developed from a common ancestor over time, in a way that matches up well with written records where they're available, but does not require them.

If we know for a fact that some language families developed over time from a common ancestor, and most of the others show the same kind of resemblances to each other as members of well-documented families, the simplest explanation is that that what looks like a family resemblance is a family resemblance.

This is not to say that we can assert with certainty that, say, Bantu, Swiss-German, Aleut and Japanese share a common ancestor.  Language changes quickly enough that the evidence becomes indistinct as we look at larger and larger families of languages.  The most thorough and successful reconstruction of an ancestral language, Proto-Indo-European, takes us back only five or six thousand years.

To go back further takes careful statistical analysis, and this is not without its problems and controversies.  However, there is no strong evidence that the languages listed above aren't related.  They all seem to follow the same general plan, albeit with markedly different details.  Again, the simplest assumption, until we know better, is that they all trace back to a small number of ancient languages, just as human ancestry traces back to a common ancestor (note that as always, "common ancestor" doesn't mean "first").

Monday, October 13, 2014

There's extinct, and then there's extinct

As a little follow-up to the previous post:

Both Manx and Old English have been extinct (I'll explain the careful phrasing in a bit).  We know exactly when Manx went extinct: with the death of Ned Maddrell on December 27th, 1974.   We can't say when Old English went extinct, and not only because it would have happened hundreds of years ago.

"When did Old English go extinct?" is the same sort of question as "When did Middle English arise?", though it's not the exact same question.  If we were to define some set of speakers as "the first speakers of Middle English" and some other as "the last speakers of Old English", then there was, pretty much necessarily, a period of time where both were alive.  Middle English was alive, by such a reckoning, but Old English wasn't dead yet.

In fact, it's plausible that some number of people could have been said to speak both, depending perhaps on the company and occasion.  As I argued before, what's really going on here is that there is really no clear line to be drawn in cases of continuous change.

On the other hand, when the number of speakers of a language dwindles, it's reasonable to speak of the language going extinct: when the last speaker speaks no more.

The situation may become somewhat better-defined if we consider features of languages.  It's plausible that there was a last time that someone used urum for "our" with a plural noun (in the appropriate grammatical case, etc.), or a first time (probably some time earlier and/or in some other place) that someone said oure in the like situation.

This at least clarifies some of the difficulties of the exercise.  First, features do not arise or disappear everywhere at once.  At some point, there would have been some people who said urum or oure, as the case may be and some who didn't.  At some later point there were fewer who said urum and more who said oure, and eventually, no one was saying urum anymore.  And even that may be an oversimplification.

Second, what set of features we call "Old English" and what set we call "Middle English" is largely arbitrary.  More realistically, as time went on, there were more people speaking English with what we would now regard as Middle English features and fewer speaking with what we would regard as Old English features.

Except that we still retain some features of Old English, for example, the words is, on, to and he from Ã†lfric of Eynsham in the previous post.  When we try to draw a line between Old and Middle English, we're really looking for features unique to each.  We could plausibly say that when there are, say, no longer any people who speak with more of Old English's unique features than Middle English's, Middle English has taken over.  When no one is using that particular set of features at all, we could say that Old English is extinct ... but then we should be careful not to choose any features for that set that do survive.

If this has a sort of unsatisfying feel to it, it's because the whole exercise is of limited use.  At the bottom of all this careful definition is a distinction without a difference.  The real story is that features come and go, with enough differences eventually accumulating that we start to feel that two different sets of features denote different languages.


Now, why did I say "have been extinct" above?  Manx is, it turns out, no longer dead.  There aren't many speakers, and perhaps none who speak exclusively Manx, or few that could be said to speak Manx as their first language, but people are speaking Manx again, with pride.  This is thanks not only to modern Manx speakers, but in part to recordings of Ned Maddrell and others, and to the efforts of the linguists who made those recordings and otherwise worked to preserve a record of the language.

Wednesday, October 1, 2014

Xeno and the history of English

Kids these days.  They don't talk like we did when I was a kid.  I'd give some examples, but they're probably already out of date.  You know what I mean, though.  It's one of the constants of life, the next generation doing things a bit differently from the last.  O tempora o mores.

When trying to make sense of the world's languages, dialects, accents, jargons and such, it's natural to look at differences among speakers, or among groups of speakers.  French speakers speak a different language from Italians.  New Yorkers, for the most part, speak differently from people in Clinch County, Georgia, or County Derry, Ireland.  It's easy, though, to neglect differences in a particular language over time, even though they can be just as significant.

Changes over time are in some ways similar to differences among contemporaries.  If someone were to start speaking, say, the English of Beowulf to a group of modern English speakers, they would likely hear it as just another foreign language.  At that level of remove, there's little chance that a modern speaker would think "That person sounds like they're trying to sound like someone from pre-Norman times, but they're definitely speaking English."

There is, however, one salient property of changes over time: Unlike differences between languages at any given time, they have to be small.  Even if a parent and child speak differently, they still need to understand each other.  Granted, this is generally more important to the older generation.  Kids throughout history have always been quick to invent their own vocabularies and otherwise make themselves more easily understood by each other than by their elders.  Even so, from a linguistic point of view they are speaking essentially the same language.

It takes quite a while for that gradual change to amount to what we would call a new language.  For example, here's a bit of a poem (They flee from me) that I studied in college.  I've modernized the spelling, but otherwise the words are the same
I have seen them gentle, tame, and meek,
That now are wild and do not remember
That sometime they put themself in danger
To take bread at my hand
This was written by Thomas Wyatt in 1535, almost 30 years before Shakespeare was born, but that wouldn't necessarily be your first guess, would it?

As we go back further, change becomes more apparent, but again gradually.  Here's a bit of Chaucer (The Former Age), again with modern spelling, from the late 1300s
No man yet knew the furrows of his land,
No man the fire out of the flint yet found,
Unkorven and ungrobbed lay the vine;
No man yet in the mortar spices ground
OK, a couple of unfamiliar words (unkorven may be translated as "unpruned" and ungrobbed as uncultivated), but then what do bodkin and fardels mean in Hamlet's soliloquy, written about 200 years later?  The word order is a bit weird, but just how do you parse the first lines of The Star-Spangled Banner, written about 400 years later?  Maybe that's just poetry for you.

I'm cheating a bit here by focusing on the written word, because there's ample reason to believe that English was pronounced considerably differently in the 1300s.  But then, contemporary speakers, depending on their dialect, will pronounce the same written words differently as well.  In the case of Chaucer, I'm also cherry-picking a bit.  Some passages of Chaucer sound considerably less familiar, and some contemporaries of Chaucer in other parts of England would be less familiar still.

Continuing our journey back in time, here's a passage from The Peterborough Chronicle, written in 1140:
Tha was England suythe todeled: some helden mid the king.  Some helden mid the empress.  For tha the king was in prison, tha wenden the earls to rich men that he never more should come out, sahtleden mid the empress, brought her into Oxford, iauen her the burgh.
This still seems something like English, but it's getting harder to decide what to clean up as just a matter of spelling, and what's just different.  For example, with is now mid, in line with the other Germanic languages.  Verbs have the -en ending when the subject is plural (as they do in Chaucer as well, though not in the passage I chose).  I could just as well have papered that over and written held instead of helden and, stretching a bit more, went instead of wenden.

That funny word iauen is really just gave: the letters u and v were not distinguished until later, and quite likely the i at the beginning is like the y in yellow, corresponding to an initial g in other dialects, so we get gaven, or plain gave when you lop off the -en.  That tha seems a bit like then and a bit like when, not unlike modern dialects that use what where others would use that.

It's worth noting that this was written with the Norman conquest of 1066 still in living memory, though only just.  Given that, I'm actually a bit surprised there aren't more French borrowings.  The only ones that stick out are prison and empress.

Go back not too much further, before the conquest, and we have something not too much different from the Peterborough Chronicle, but different enough from modern English that trying to smooth over the differences is a lost cause.  Here is Ã†lfric of Eynsham discussing the reflection in grammar of Christian theology.  First a straight transliteration (but with modern punctuation):
Oft ys seo halige þrinnys geswutelod on Ã¾isre bec, swa swa ys on Ã¾am worde Ã¾e God cwæð: 'Uton wyrcean mannan to ure anlicnisse'.  Mid Ã¾am Ã¾e he cwæð 'Uton wyrcean' is seo Ã¾rinnys gebicnod; mid Ã¾am Ã¾e he cwæð 'to ure anlicnisse' ys seo soðe annis geswutelod: he ne cwæð na menfealdlice, 'to urum anlicnissum', ac anfealdlice, 'to ure anlicnisse'.
Here's an attempt to smooth over the spelling differences and such, taking a few more liberties than in the last example:
Oft is the holy threeness geswutelod on this book, so so as the words that God quoth, 'Uton work man to our (an)likeness'.  With Ã¾am Ã¾e he quoth 'Uton work' is  the threeness gebicnod; with Ã¾am Ã¾e he quoth 'to our (an)likeness' is the sooth oneness geswutelod: he ne quoth na manifoldly (many-fold-ly) 'to our (an)likenesses', but one-fold-ly, 'to our (an)likeness'.
(That's sooth, as in soothsayer, meaning 'true', not the modern verb soothe).  And finally, glossing the words that don't seem directly related to modern ones, and updating a few that are,
Often is the holy trinity revealed in this book, just as the words that God said, "Let us make man to our likeness."  With that he said 'Let us make' is the trinity indicated.  With that he said 'to our likeness' is the true unity revealed: he neither said nor plural, 'to our likenesses', but singular, 'to our likeness'.
Even with the words glossed, the word order is a little funky, that "with that" is only approximate and doesn't parse easily, and the ne ... ne ... construct, still used by Chaucer and with traces here and there in Shakespeare, is gone now, the closest remnant being neither ... nor.  The forms of words have changed significantly (halige vs. holy, annis vs. oneness etc.).  There is more and different inflection in the original, both in nouns and pronouns (ure anlicnisse vs. urum anlicnissum, worde as the plural of word) and verbs (ge- ... -od for the past participle instead of just -ed today).

All in all, this is more a translation than a modernization.  Only after a third round of adjustments would Ælfric's English really look like modern English.

Even though the Peterborough Chronicle is in an East Midland dialect that is not a direct ancestor of Chaucer's, and Ælfric spoke a Wessex (West-Saxon) dialect which is, and the writers are writing in considerably different forms, it's not hard to see that these are examples of the same language, but a language which is, overall, changing gradually over time.

Thus even though we can point at plenty of texts and say "This is Middle English", or "This is Old English", there is no time in history we can point at and say "Middle English started here" or "Modern English started here".  As far as anyone at the time was concerned, they were speaking English.  No "Old" or "Middle" or "Modern" about it.

Even if you did pick some set of speakers and say, "the parents spoke Middle English, but the children spoke Modern English", you'd be hard pressed to tell the difference between the two.   There would be much more difference between our Modern English and theirs than between the parents and the children.

Gradual does not mean imperceptible, however.  We can trace the origins of newer words like blog or semiconductor with a fair degree of certainty.  We can remember words and constructions that people don't say much any more (at least in most places), like To whom did she give the book? instead of Who did she give the book to?  Going further back to old written sources, we can get a reasonable idea of when people stopped using -en as a regular plural marker for nouns, though of course that didn't happen all at once.  We can see individual changes happening, it's just that there are so many parts to a language that it takes quite a few -- many more than typically happen in a lifetime -- before we decide to call the result a new language.

Drawing a precise line between an older form of a language and a later form is largely arbitrary, like trying to pick a boundary between green and blue.  You can do it, but wherever you pick, there will be a reasonable argument for picking some slightly different boundary.  Even so, the language has changed and continues to.  You can quite rightly say "no one saw Modern English arise from Middle English," and yet it did.

This is all reminiscent of Xeno's arrow paradox: If an object in a definite place is at rest, and at any given moment a flying arrow is in a definite place, then, it would seem, a flying arrow must always be at rest, so how can it move at all?  Untangling this sort of thing rigorously is the wellspring of the mathematical field of analysis, but for most purposes it's enough to know that the arrow moves anyway, somehow unaware that it's not supposed to be able to do that.

Tuesday, June 17, 2014

Reading University and Mr. Turing's test

The BBC reports that a chatbot called Eugene Goostman has passed the Turing test, marking the first time in history that this has happened.  Or at least, that's what you'd gather from the headline (granted, it doesn't give the name of the chatbot).  The BBC, not having taken complete leave of its senses, explains that this is the claim of the team at the university of Reading that ran the test, and then goes on to cast a little well-deserved doubt on the idea that anything historic is going on.


So what's a Turing test?

Sixty-four years ago, Alan Turing published Computing Machinery and Intelligence, in which he posed a simple question: Can machines think?  He immediately dismissed the question as essentially meaningless and proposed an alternative: Can a machine be built which could fool a person into thinking that it (the machine) was a person?

In Turing's setup, which he called "the imitation game", there would be a judge who would communicate with two players, each claiming to be a person.  The judge and players would communicate via a "teleprinter" or other intermediary, so that it would not be possible to point at one of the players and say "That one's a machine, duh".  Turing goes into quite a bit of detail on points like this that we would take for granted now.  Your favorite instant messaging system is good enough for the task.  On the internet, nobody knows your'e a dog.

Later in the paper Turing makes a pretty audacious claim, considering it was made in 1950 and the supercomputers of the time had somewhere on the order of 16K of memory.  In case you've forgotten how to count that low, that's 1/32 of a megabyte, or about a millionth of the capacity of a low-end smartphone.  Turing's prediction:
I believe that in about fifty years' time [that is, by around the year 2000] it will be possible, to programme computers, with a storage capacity of about 109 [bits], to make them play the imitation game so well that an average interrogator will not have more than 70 per cent chance of making the right identification after five minutes of questioning.
109 bits is about 128 megabytes, not an unusual amount of RAM for a computer in the 2000s and a remarkably good prediction for someone writing in 1950.  Keep in mind that Turing wrote this well before Moore formulated Moore's law, itself a good source of misinterpretations.

Turing was a brilliant scientist.  He helped lay the groundwork for what we now call computer science, played a key role in pwning the German Enigma machine during World War II, and thought deeply about the question of intelligence and how it related to computing machinery.  However, he got this particular prediction spectacularly wrong.

It didn't take fifty years to beat the imitation game.  It took more like fifteen.

In the mid 1960s, Joseph Weizenbaum of MIT wrote ELIZA, which purported to be a Rogerian psychotherapist.  You can play with a version of it here.  To be clear, this program wasn't actually trying to do psychotherapy.  It was more like a parody of a "nondirective" therapist whose goal is to stay out of the way and let the patient do all the meaningful talking.  Was it able to fool anyone?  Yes indeed.  So much so that it inspired Weizenbaum, after seeing people confide their deepest secrets to the program, to write a book about the limitations of computers and artificial intelligence.

ELIZA neatly dodges the difficulties that Turing was trying to present to the developer by making the human do all the thinking.  Say "The kids at school don't like me" and ELIZA won't respond with "I know what you mean.  At my school there was this bully named ..." and give you a chance to probe for things only an actual human who had been to school would know.  It will respond with something like "Why do you think the kids at school don't like you?"  It's a perfectly reasonable response, but it reveals absolutely zilch about what the machine knows about the world.

That's fortunate, because the machine knows absolutely zilch about the world.  It's just taking what you type in, doing some simple pattern matching, and spitting back something based, in a fairly simple way, on whatever patterns it found.  This works great for a while, but you don't have to wander very far to see the man behind the curtain.  Answer "Because I am." to one of its "Why are you ...?" questions, and it is liable to answer "Do you enjoy being?", because it saw "I am X" and tried to respond "Do you enjoy being X?"  Except there is no X in this case.

The Eugene Goostman chatbot likewise dodges the difficult questions, but as far as I can tell it does it by acting flat-out batty.  Its website says as much, advertising itself as "The weirdest creature in the world".  When I first saw the Reading story on my phone, there were transcripts included.  These are somehow missing from the version I've linked to, but there is a snippet of a screenshot:
  • Judge: What comes first to mind when you hear the word "toddler"?
  • Goostman: And second?
  • Judge: What comes to mind when you hear the word "grown-up"?
  • Goostman: Please repeat the word to me 5 times
Sure, if you're told that you're chatting with an eccentric 13-year-old boy with English as a second language, you could take pretty much any bizarre response and say "meh ... sure, that sounds like something a 13-year-old eccentric non-native speaker might say ... close enough."  But so what?

The transcripts I saw on my phone were of a similar nature.  Apparently the Goostman website had run the chatbot online for a while, and you can find transcripts from people's interactions with it it on the web. The online version was soon taken down, perhaps from the sheer volume of traffic or, a cynic might say, because the game was up.

This is not the first time people have mistaken a computer for a human behaving outside the norm.  Not long after ELIZA, in 1972, psychiatrist Kenneth Colby, then at Stanford, developed PARRY (this was evidently still before mixed-case text had become widespread).  Unlike ELIZA, PARRY wasn't basically trolling.  It was a serious attempt to mimic a paranoid schizophrenic and so, if I understand correctly, to learn something about the mind of a person in such a state.

Colby had a group of experienced psychiatrists interview both PARRY and actual paranoid schizophrenics.  He then gave the transcripts to a separate group of 33 experienced psychiatrists.  They identified the real schizophrenics with 48% accuracy -- basically random chance and far below Turing's 70%.  That is, PARRY could fool the psychiatrists about 50% of the time, while Turing only expected 30%.

This was from transcripts they got to read over, not from a quick five-minute exchange.  For my money this is a stronger test than Turing's original, and PARRY passed it with flying colors.  Over forty years ago.  Eugene Goostman fooled 33% of the judges (one suspects that the number of judges was a small multiple of three) in five-minute interviews by spouting malarkey.  Not even carefully constructed paranoia, just random balderdash.  Historic?  Give. Me. A. Break.

By the way, if you're thinking "ELIZA is pretending to be a psychotherapist, PARRY is pretending to be a person with mental issues ... hmm ..." ... it's been done.


Thing is, Turing's test just isn't very good.  In attempting to control for factors like appearance and tone of voice, it limits the communication to language, and printed language at that.  In doing so, it essentially assumes that facility in language is the same as intelligence.

But this is simply false.  A highly-intelligent person can become aphasic, and there are cases in the literature of people who can speak highly-complex sentences with a rich vocabulary, but show no other signs of above-average intelligence.  And, as we've seen, it's been feasible for decades to write a computer program that does a passable imitation of human language without understanding anything at all.  I believe there are also documented cases of humans failing Turing tests, but that's a different issue.

It turns out that we humans have a natural tendency to attribute at least some level of intelligence to anything that looks remotely purposeful.  For example, there is an experiment in which people watch two dots on a screen.  I don't recall the exact details, but I think the following gets the gist:

One dot approaches the other and stops.  It then backs off and approaches again, faster.  The first dot is now touching the second, and both move slowly in the direction the first dot had been going.  Ask a person for a description, and they'll likely say that the first dot was trying to get past the second and finally tried pushing it out of the way.

Throw in language and the urge to attribute intelligence is nearly overwhelming.  "OK", one finds oneself thinking, "it's maybe not completely grammatical, and it doesn't make much sense, but that's got to be because the person talking is a bit ... off, not because they're not intelligent at all.  They can talk, for goodness' sake."

Whether something passes the Turing test in practice comes down more to a judge's ability to set aside intuition and look for artifacts of pattern-matching approaches, like the "Do you enjoy being?" example above.

This assumption that language facility was a good proxy for intelligence ran through a lot of early AI, leading to an emphasis on discrete symbol-smashing.  You have to start somewhere, it's clear that understanding language has a lot in common with other signs of intelligence, and a lot of useful work came out of efforts to develop good symbol-smashing tools, but to some extent this is more like looking for your lost car keys where the light is brightest.  Computers are good at smashing symbols, or more generally, dealing with discrete structures, which would include words and sentences.  That's basically their job.

It's now looking like probability and continuous math have more to do with how our minds actually work.  Being able to communicate in the (more-or-less) discrete medium of language came along relatively late in the evolutionary game, long after other aspects of intelligence, and language itself doesn't behave the way we assumed it did fifty years ago.  Science marches on.

There's another problem with the Turing test, something that looks like a strength at first:  It's free-form.  The judge is allowed to ask any questions that seem appropriate.  There is no checklist of abilities to test for.  If the respondent claims to have trainspotting as a hobby, there's no requirement to find out if they know anything about trains, or their schedules, or the sound of a locomotive or the smell of overheating brakes.

More generally, there is no requirement to test for, say, understanding of metaphor, or the ability to learn a new concept or glark the meaning of a word from context.  There is no requirement to determine if the respondent understands the basic properties of objects, space and time.  And so forth.

To be sure, there's an obvious objection to imposing requirements like this.  It would lead to "teaching to the test".  Contestants trying to pass such a variation of the Turing test would naturally try to build systems that would be able to pass the particular requirements.

But that could well be a good thing.  It's surely better than seeing people grab headlines by writing a bot that spouts gibberish.  As long as the requirements are phrased abstractly we can still leave it up to the judges' ingenuity to decide exactly what metaphor to try or what specific questions to ask about space, time and objects.  At the end of the test we can expect these requirements to be covered, or invalidate the judge's result if they aren't, which we can't with a free-form test.

The particular list I gave doesn't necessarily cover everything we might want to associate with intelligence, but a system that can understand metaphors, space and time, and can learn new concepts, can reasonably said to be "thinking" in a meaningful sense of the word.

Setting explicit requirements would also allow for variant tests that would accept forms of intelligence that were significantly different from ours.  For example, one very important part of being human is knowing what it's like to have a human body.   Being embodied as we are plays a large role in our cognition.  However, it's perfectly possible for something to be intelligent and, for example, not experience tastes and smells (indeed, some number of people have no such experience).

It seems reasonable to instruct the judges "We know this might be a machine.  Don't ask it what things taste like."  In the original Turing test, if the program came up with some plausible explanation for lacking taste and smell, a natural follow-up might be "What's it like not to be able to taste and smell?"  It's not clear that a machine would need to have a good answer to that in order to be intelligent.  If it didn't, the judge might have a good reason to think it was a machine even if it did in fact have some meaningful form of intelligence.  Either way the line of questioning is not helpful as a way of testing for intelligence.  In other words, distinguishing human from machine is not quite the same as distinguishing intelligent from unintelligent.

Hiding behind all this is one more shaky assumption: Something is either intelligent or it isn't.  Even though Turing properly speaks of probabilities of guessing correctly, there is still the assumption that a machine is either successfully imitating a human or it isn't.  Suppose, though, that a machine is really good at some area of knowledge and the judges happen to ask about that area 31% of the time.  That machine would pass the Turing test (in the popular but not-quite-accurate sense), but what does that mean?  Is it 31% intelligent?


I wouldn't lay much of this at Turing's feet.  He was doing pioneering work in a world that, at least as far as computing and our understanding of human cognition are concerned, was starkly different from the one we live in, and yet he managed to hit on themes and concepts that are still very much alive today.  Nor would I blame the general public for taking a claim of a historic breakthrough at face value.

But the claim itself?  Coming from a respected university?  Granted, they seem mostly hyped about the quality of their test and the notion that nothing else so far has passed a "true" Turing test.  But this seems disingenuous.  What we have here is, maybe, a more methodologically faithful version of Turing's test, which was passed by a mindless chatterbot.  The only real AI result here is that a Turing-style imitation-based test can be beaten by clearly unintelligent software.

This is not a new result.

[The Wikipedia article on Eugene Goostman makes a really good point that I never caught: Turing predicted a 30% success rate.  He didn't define that as some sort of threshold for intelligence.  Thus, fooling 30% of the judges doesn't mean that something "passes the Turing test and is therefore intelligent" It's just confirming Turing's prediction about how well machines would be able to win the imitation game.]

Saturday, June 7, 2014

Words and their senses

What does "out" mean?  Well, it's the opposite of "in", whatever that may mean.  Except, not in all cases.  Sure, "I went out the door" means pretty much the opposite of "I went in the door", but "I've got an in at the State Department" means I know someone there and I might be able to use that connection to advantage, while "I have an out at the State Department" means ... maybe it means I have an escape route from my current predicament via the State Department, maybe because of the in I have there?

Just off the top of my head, "out" might mean any of a dozen things:

  1. adj Unconscious ("He's out like a light")
  2. adj No longer holding a position ("She's out as CEO of Frobco")
  3. adj Retired as a batter according to the rules of baseball ("He's out at third")
  4. n An instance of retiring a batter according to the rules of baseball ("That's the third out")
  5. adj Openly known to have a particular sexual orientation ("She's an out bisexual")
  6. v To reveal someone to have a particular sexual orientation ("He outed her as a bisexual")
  7. v To reveal someone to have a clandestine role or identity ("The administration inadvertently outed a CIA agent")
  8. adj Not a member of a particular social group ("They always make me feel so out")
  9. n A potential means of escape from a situation ("In tense negotiations, it's always good to have an out")
  10. adj Not in tune ("I  think your A string is out")
  11. adv Deliberately in a different key and/or time signature from the rest of an ensemble ("Vernon likes to play really out when he solos")
  12. adj Not at home ("Sorry, Mr. Smith is out")
and so forth.  It's easy to come up with more.  I've by no means hit even all the usual senses.  My laptop's dictionary gives nine adverbial senses, nine adjectival senses, one prepositional, three nouns and two verbs.  I've heard of lists of over a hundred senses of the word.  It depends on how finely you want to slice it.  I'll come back to that.

Clearly some of these senses are more closely related than others.  The baseball senses 3 and 4 are clearly related, with the noun sense derived from the adjective.  Senses 5, 6 and 7 are clearly related, the verb sense has got to be derived from the adjective sense, and that must be related to phrases like "the secret is out".  On the other hand, it's hard to see how senses 3 and 4 have much to do with senses 5 - 7.

Nonetheless, the use of "out" (or any other word) is not completely arbitrary.  There is a well-developed linguistic theory behind this (well, probably several, but I happen to like this particular one).  At the core, a word has a small number of well-defined senses.  In the case of "out", there is a boundary enclosing something.  What's enclosed is in.  On the other side is out.  Thus when you go out a door, you are going from the space you were in, into another space (which may also be enclosed -- you can go out of one room and into another).  You can draw a circle on the ground and say someone or something is in the circle or out of it, and so forth.

From these basic senses, we build new senses metaphorically.  We can imagine a boundary between the members of a social group and anyone out of the group.  We can talk about entering or leaving a state of being ("Moishe led us out of slavery"), and so forth.

Crucially, these metaphors are not just literary fancy.  They are directly meaningful and productive (in the linguistic sense that we can spontaneously create new instances of the metaphor).  If a social group has a boundary, we don't just say someone is in the group or out of it.  We can welcome someone in.  We can kick someone out.  We can expand the group.  We can designate an inner circle, and so forth.  If we're feeling more creative, we can say something that sounds more "metaphorical" in the usual sense ("The boundaries of the group were porous.  People floated in and out with the tides.")

In the case of "out" we can start with the basic boundary-oriented sense and build, well, outwards:
  • A container can have something in it, and you can take things out of it
  • If the container holds a fluid, you can pour it out of the container
  • or it can run out (or flow out, our seep out, or pour out)
  • When there's no longer anything in the container, you have run out of whatever was in it (or you're just out of it)
  • Any resource can be considered to be a fluid, so you can run out of time (or say time is running out), run out of money, or energy, or whatever.
  • The resource need not be physical.  You can run out of patience.
  • A burning lamp or candle consumes its oil or wax.  When there's none left -- it has run out -- the lamp or candle has burned out.
  • Likewise, any flame can burn out as it runs out of fuel, for example a rocket can burn out
  • Someone exhausted is burned out
  • An electric light performs the same role as a lamp or candle.  When you shut off the current to it, it is out.
  • A person's consciousness is likened to a light or flame, and an unconscious person is out (sense 1 above).  You can also drift in and out of consciousness, but that's considering a state of being as something bounded -- a separate metaphor.
Coming back toward the core senses
  • A social group or position is a bounded area, metaphorically.
  • As noted above, one can be in or out of a group or position, or leave it (senses 2 and 8; also, being in a job or out of it, leaving a job, etc.)
  • Information can be regarded as a substance (you can share it, hide it, have a lot or a little of it, etc.).  You can't see through an opaque container, but once the information is out of the container (out in the open), others can know it (senses 5-7 ... the secret is out)
  • Obviously, you can be in or out of your home (sense 12)
  • We can speak of some quantity being within or outside of given limits, a special case of a state of being as a bounded area.
  • A note too far from its correct pitch is out of tune (sense 10)
  • A musician diverging from the key and/or time signature of a piece is clearly crossing those limits (sense 11)
  • A difficult situation limits one's potential actions, like being in a confined space.  It's good to have a way out of such a space (sense 9)
That leaves baseball.  The baseball usage derives from the game of cricket, where a batsman stands in his ground, guarding a wicket.  When the wicket falls (for any of a number or reasons I won't even try to enumerate), the batsman is out of his ground, or just out  (well, you can also be out of your ground but not out, for example if you're running between the wickets, but clearly out is related to in/out of one's ground).

So there you have it.  By a series of metaphors and analogies, we can connect seemingly unrelated senses of a word, like senses 1, 4 and 7 above, back to basic, familiar and physically-based concepts.

Of course, if you try hard enough, you can connect anything to anything.  I remember learning the following chain of reasoning as a kid, explaining why fire engines were red, starting with a very basic premise:
  • 1+1 = 2
  • 2+2 = 4
  • 4+4 = 8
  • 8+4 = 12
  • There are 12 inches in a ruler (at least in the US)
  • Queen Mary was a ruler
  • The Queen Mary was a ship
  • Ships sail in the ocean
  • The ocean is full of fish
  • Fish have fins
  • The Finns fought the Russians
  • Russians are red (this was back in the Cold War days)
  • Fire engines are always rushin'
  • And that's why fire engines are red
If only fire engines were still red.

How do we know that this whole sense-extension exercise isn't just another chain of silly reasoning?  A metaphor doesn't just relate anything to anything else.  There are two basic rules:
  • One thing will be more concrete than the other.  E.g., holding a substance in a container is more concrete than holding information in one's mind.
  • The metaphor connects the two things coherently, in multiple places.  You can bring things you know about the more concrete thing to the more abstract thing, at least until the metaphor breaks down.  In an example from a previous post "The stop sign was a fire engine" is not a coherent metaphor, even if both are red.  On the other hand, if you have information in your head, you can give it out.  You can have a lot or a little of it.  You can have information crammed into your head until it's about to explode, and so forth.
Even if the explanation above isn't airtight, I hope I've at least presented a plausible case that the senses in which we use words can be explained reasonably well by this sort of metaphoric extension, plus some other rules covering, for example, how we convert adjectival senses like sense 3 to noun senses like sense 4.  Real linguists have, of course, studied this in much more detail.


How many senses does a word have?  Some, like copernicium or Pinophyta, probably only have one, but even highly technical terms like algebraic can have multiple, related senses, following the same core-with-extensions pattern as anything else.  Some very basic words, like the prepositions or head and go have large numbers even by the relatively conservative standards of dictionaries, particularly when you count idioms like head out or go out.  Most words we commonly use have at least a few widely-used senses, and likely several more specialized senses, particularly if you include slang -- which you always should, if you're really trying to understand a language.

But how finely should we really slice?  Senses 6 and 7 above are very nearly the same thing.  Historically, as far as I'm aware, sense 6 precedes sense 7, but is this because outing someone's orientation is a different thing from outing someone's clandestine role, or because the sense of "revealing something that had been secret" was at first only applied to orientation?

I would lean toward that latter, if only for practical reasons.  Otherwise we would have to consider each application of a word its own sense.  Being out of the position of CEO would be a different sense from being out of the position of vice president, or janitor.

All right, then, but then couldn't we argue that all uses of "out" are just different applications of the basic idea of being outside a boundary?  It seems clear that there's something in common at the core of the various senses above, but saying that they're all just uses of the same basic word leaves something out [ahem].

This is especially apparent if you're trying to paraphrase or translate a word.  In senses 6 or 7, we can use basically the same paraphrase: He revealed her to be bisexual; The administration inadvertently revealed the identity of a CIA agent, and sense 5, apart from using a different part of speech, more or less works.  She's a revealed bisexual sounds a bit funny, but it at least makes sense, as opposed to He's revealed like a light for sense 1, or He's revealed at third for sense 3.  On the other hand The secret is revealed works fine for The secret is out.  The paraphrase test isn't foolproof, but it seems like a good starting point.

From the point of view of metaphors, a sense of a word corresponds to a particular metaphor.  Senses 5-7 and The secret is out use the metaphor of information being a substance in an opaque container.  Sense 1 uses a series of metaphors:  consciousness is a light, lights can be out because lamps and candles have fuel and fuel can run out.  If different paraphrases or translations are different ways of expressing the metaphor, then the paraphrase test makes sense.  In short, if you're applying the same metaphor in a new context, you're using the word in the same sense, and if you're not, you're not.



Sunday, May 11, 2014

Pan proiiciens

Humans have several unique qualities (and many more not-so-unique), but one that may not come readily to mind is that we throw things, and we throw them very well.  No other animal we know of could come remotely close to doing this, or this, or this.  Even an average human's throwing abilities are far beyond anything else in the natural world.  If I said that I'd seen someone throw a ball 50 meters, no one would think twice.  If I said that I'd seen a horse throw a ball 50 meters, the most likely response would probably be "No, you didn't", maybe followed by "How??"

If you think about it, it's actually somewhat surprising that humans would be unique when it comes to throwing things.  It's a very useful skill.  If you can bring down a small mammal with a well-aimed rock, you'll eat much better than if you have to run it down.  Even if you're a very good runner-downer, it still takes way less energy to throw a rock.  Throwing a rock can also get a high-hanging fruit out of a tree (if not easily).  Throwing is a good way to get something you're carrying up onto a high ledge that you can then get to with all your limbs free, and so forth.  You'd think something would have stumbled on it before our ancestors did.

On the other hand, a lot of body plans just aren't that well suited to throwing.  Birds have one set of limbs serving as landing gear and for locomotion when not airborne, and the other given over to wings.  That leaves the head and beak as all-purpose picker-uppers, severely limiting throwing potential.  Birds can throw things by picking them up and then heaving the head and letting go, but not very far or forcefully.

Fish and other sea creatures live in a viscous medium where throwing is not particularly useful.  Most mammals have all four limbs specialized for walking, running, jumping and so forth, leaving them in much the same spot as birds.  Lizards are also pretty well tied to the ground or other surface they're traveling on -- particularly the limbless ones, to say nothing of actual snakes (snakes are closely related to lizards, but there are also some proper lizards that lack limbs).

There's an obvious common thread here: To throw effectively you need a free limb, one not specialized to supporting your weight.  You need hands, as opposed to front feet.  You don't need to be fully bipedal, though that clearly ought to help, but you do need to be able to grab something, stand up on your hind limbs and let fly.

There aren't many animals in that category, but several primates are, by virtue of having hands (and feet, and tails) adapted to grabbing and swinging from tree branches instead of always walking on all fours.  Putting all this together, perhaps it's not so surprising that throwing would have only evolved recently, in a branch of the primate family tree, itself relatively recent.

It is a principle of evolution that behavior tends to change first, and then anatomy follows.  First certain fish started coming up out of the water, whether to escape from other fish who couldn't or to move from a shallow, drying-up pond to a deeper one, or for whatever reason. Later came Tiktaalik and its kin with pectoral fin bones (and other features) better adapted to life out of water.

Once the new niche was established on land, there was plenty of selection pressure to reshape the body for living on land, and eventually lose the older adaptations for water living entirely.  More strictly speaking, the new behavior of coming up on land meant that fish with more land-adapted bodies could have better survival chances.

In the case of primates throwing, it's not that other primates don't throw.  Some species of monkeys are well-known to throw excrement at others of their species, and chimps will throw things as a threat.  It doesn't seem to matter much to them what they throw, but it will generally be branches and occasionally rocks.  Chimps don't show signs of throwing with the same purposes we do, but it's significant that some sort of throwing behavior is established in our near relatives.  It's therefore plausible, though not certain, that it was also established in our common ancestors.

While chimps are known to hunt, and are known to throw things, and are known to be reasonably intelligent, they are not known to throw for purposes of hunting.  This is not completely shocking, considering what they hunt -- small monkeys -- and how they hunt them.  The strategy is to go in as a group, block off escape routes and send one member of the hunting party in for the kill.  Rock throwing would probably not help much in such a situation.  You'd have to encumber a hand carrying a rock up into the trees, and then you'd only have one rock, a bunch of branches in the way, and a monkey that would not be well-inclined to stay still in the path of a hurtling rock.

But imagine a tribe of ancestral chimps a couple of million years ago venturing out of the forest.  These wouldn't be exactly like today's chimps, of course, but today's chimps appear to resemble these ancestors much more closely than we do, so we can consider them ancestral chimps here.  In 1993, William Calvin laid out a hypothesis that a good way for such creatures to get food would be to stake out a water hole and go after the herds that gathered there to drink -- as several other predators do.

Naturally, herds of gazelles and such are adapted to dealing with predators around water holes.  The main strategy is to stampede away, which works well, except that any animal that trips or falls is likely to be trampled by the herd and left behind as an easy meal.  This actually works reasonably well for the herd as a whole (from an individual's view, if you have this behavior you're more likely to be one of the survivors than if you don't), and it works for the hunters as well.  It just doesn't work particularly well for the particular animal left behind.

Now suppose you hit upon a way to make a herd stampede, and at the same time make one of its members stumble and likely be trampled.  That would work even better for you, though again not so well for the unlucky victim.  Calvin's idea is that there's an easy way to do this, that those ancestral chimps could have done with the mental and physical abilities they had: Throw a reasonably-sized rock into the herd.  If it hits one member, that member will stumble, the herd will startle and, with a bit of luck, trample the stumbler.   This doesn't have to happen every time, just enough to make it noticeably easier to get food from the herds gathered at the water hole.

At that point, we're off to the races.  Any change, whether in behavior or anatomy,  that improves throwing force or accuracy, will make for better hunting and better-fed primates.  Richard Young cites paleontological evidence to support a claim that exactly this happened during the past couple million years, that the body, and the hand in particular, became better and better suited to throwing (and to clubbing, another area where we excel).  Doing these well requires a number of changes from the long-fingered, short-thumbed tree-branch-hooking hands of the rest of the chimp family.

Calvin, for his part, speculates that the famous Archeulean hand axe was actually an improved weapon to throw into a herd, as it would be more likely to cut into the prey's hide and cause it to instinctively collapse, making it more likely to be trampled.  As always, this doesn't imply that the hunters were thinking it through in that much detail.  It's enough that throwing a sharp rock works better than throwing one that isn't, and that some in the population had an innate proclivity for chipping away at rocks and so making them sharper.

It's been argued repeatedly that, if we weren't the ones doing the classifying, or weren't so subject to a certain prideful feeling of distinctness from the rest of nature,  we would be classified in the same genus as chimps and bonobos.  Either they would be Homo troglodytes and Homo paniscus, or we would be Pan sapiens.  Under the latter scheme, those savanna-dwelling rock throwers might best be called Pan proiiciens -- throwing Pan, the name Pan being taken from the Greek god of the forest, used to designate the forest-dwelling chimps and bonobos.  Except these particular Pan would be leaving the forest.

Behavior drives anatomical change, but anatomy limits behavior.  Just as only some fish had the right anatomy to even try moving on land, only some animals had the right kind of body to try throwing things.  Primates happened to be close enough, again likely because their hands had already adapted for something else besides walking, something that allowed for grabbing and flinging.  This is a common pattern in evolution.  It used to be called pre-adaptation, but that gives the impression that, for example, primate hands evolved for grabbing tree branches so that they could later evolve for throwing and clubbing.  That's not how it works, so the ungainly but unbiased term exaptation is preferred.

There is another interesting point that Calvin makes.  It's not enough to have the anatomy.  You need to be able to control it.  It takes around a tenth of a second for our bodies to carry out a conscious command.  To throw a projectile accurately [as we do now, as opposed to lobbing rocks into a herd -- D.H. Sep 2015], you need to time your movements within about a hundredth of a second.  Once you've decided to throw something, it's far, far too late to make adjustments as you go along.  You have to have the whole program ready to go ahead of time, adjusted for where your target is, or rather where it will be when the projectile reaches it.  Calvin speculates that this sort of plan-ahead was re-purposed into our control structures for things like language.

I'm not sure I quite buy this.  I doubt that throwing is the only thing in evolutionary history that requires this sort of plan-ahead.  Surely when a hawk dives for a mouse or a cheetah jumps for a gazelle it is doing the same sort of thing under similar constraints.  Nonetheless, it's an interesting idea, and plausible in a general sense, that the original behavior change of throwing things would have brought on a host of other changes, in both behavior and anatomy, that led to wholly new behaviors like speech and large-scale planning (for lack of a better term for the type of planning that we do and other animals don't).