Sam Saffron <sam.saffron@gmail.com> writes:
> So something is clearly different about the way the tokenisation is
> defined in PG. My question is, how do I figure out what is different
> and how do I make my mac install of PG work like the Linux one?
I'm not sure you can :-(. This devolves to what the libc locale
functions (isalpha(3) and friends) do, and unfortunately the UTF8
locales on OS X are impossibly lame. They tend not to provide
useful character classifications for high Unicode code points.
They don't sort very well either, though that's not your problem here.
Depending on what characters you actually need to work with,
you might have better luck using one of the ISO8859 character set
locales. Though if you actually need both Hebrew and Armenian
in the same DB, that suggestion is a nonstarter.
regards, tom lane