Обсуждение: Accommodating alternative column values

Поиск
Список
Период
Сортировка

Accommodating alternative column values

От
Rich Shepard
Дата:
In data made available from a state regulatory agency I find a few instances
where a facility contact has two email addresses. While multiple locations
are accommodated because they're in a table separate from the facility name
and details, all people associated with a facility and location are in a
'people' table with only one column for an email addresse.

While I could enter an additional email address in the 'comment' column if
I'm entering data for a single facility, I'm reformatting the downloaded
data so I can insert all new table data from one .sql file. Is there a way
to accommodate multiple email addresses other than entering both with a
forward slash separating them in the varchar(64) email address column?

Suggestions appreciated,

Rich




Re: Accommodating alternative column values

От
Christophe Pettus
Дата:

> On Jul 2, 2024, at 14:47, Rich Shepard <rshepard@appl-ecosys.com> wrote:
> Is there a way
> to accommodate multiple email addresses other than entering both with a
> forward slash separating them in the varchar(64) email address column?

If you are absolutely 100% sure there will never be any metadata associated with each email address (like a "valid"
flag),you can use TEXT[] array to store them.  Otherwise, it's best to move them into a table with a foreign key back
tothe owning record. 


Re: Accommodating alternative column values

От
Rich Shepard
Дата:
On Tue, 2 Jul 2024, Christophe Pettus wrote:

> If you are absolutely 100% sure there will never be any metadata
> associated with each email address (like a "valid" flag), you can use
> TEXT[] array to store them. Otherwise, it's best to move them into a table
> with a foreign key back to the owning record.

Christophe,

Using text rather than varchar() is a good suggestion.

Thank you,

Rich



Re: Accommodating alternative column values

От
Christophe Pettus
Дата:

> On Jul 2, 2024, at 14:57, Rich Shepard <rshepard@appl-ecosys.com> wrote:
> Using text rather than varchar() is a good suggestion.

To be clear, I wasn't suggesting stuffing them all into a text column with a delimiter, but storing them in a text
*array*field, each email address one component of the array. 


Re: Accommodating alternative column values

От
Rich Shepard
Дата:
On Tue, 2 Jul 2024, Christophe Pettus wrote:

> To be clear, I wasn't suggesting stuffing them all into a text column with
> a delimiter, but storing them in a text *array* field, each email address
> one component of the array.

Okay. I've not before done that and will learn how. This data set is the
only one I've encountered that has a very few multiple email addresses for a
person.

Thanks,

Rich



Re: Accommodating alternative column values

От
Christophe Pettus
Дата:

> On Jul 2, 2024, at 15:11, Rich Shepard <rshepard@appl-ecosys.com> wrote:
> This data set is the
> only one I've encountered that has a very few multiple email addresses for a
> person.

That's pretty common out in the world.  Just pulling a small dataset I have available, 4+ email addresses per customer
happenfrequently. 


Re: Accommodating alternative column values

От
Rich Shepard
Дата:
On Tue, 2 Jul 2024, Christophe Pettus wrote:

> To be clear, I wasn't suggesting stuffing them all into a text column with
> a delimiter, but storing them in a text *array* field, each email address
> one component of the array.

Christophe,

I'm not using the proper syntax and the postgres alter table doc has no
example in the alter column choices.

What I've tried:
bustrac=# alter table people alter column email set data type varchar(64) [];
ERROR:  column "email" cannot be cast automatically to type character varying[]
HINT:  You might need to specify "USING email::character varying(64)[]".

How do I incorporate the "USING email::..." string?

TIA,

Rich



Re: Accommodating alternative column values

От
"David G. Johnston"
Дата:
On Wednesday, July 3, 2024, Rich Shepard <rshepard@appl-ecosys.com> wrote:

I'm not using the proper syntax and the postgres alter table doc has no
example in the alter column choices.

Simpler syntax forms tend to get skipped over when doing examples.
 

How do I incorporate the "USING email::..." string?

ALTER [ COLUMN ] column_name [ SET DATA ] TYPE data_type [ COLLATE collation ] [ USING expression ]

David J.

Re: Accommodating alternative column values

От
Rich Shepard
Дата:
On Wed, 3 Jul 2024, Rich Shepard wrote:

> What I've tried:
> bustrac=# alter table people alter column email set data type varchar(64) [];
> ERROR:  column "email" cannot be cast automatically to type character 
> varying[]
> HINT:  You might need to specify "USING email::character varying(64)[]".

What I forgot to mention is that the current datatype is varchar(64) and I
want to make it an array.

Rich



Re: Accommodating alternative column values

От
Torsten Förtsch
Дата:
You could try

ALTER TABLE ... SET TYPE TEXT[] USING ARRAY[email]::TEXT[]

something along these lines.

On Wed, Jul 3, 2024 at 3:58 PM Rich Shepard <rshepard@appl-ecosys.com> wrote:
On Tue, 2 Jul 2024, Christophe Pettus wrote:

> To be clear, I wasn't suggesting stuffing them all into a text column with
> a delimiter, but storing them in a text *array* field, each email address
> one component of the array.

Christophe,

I'm not using the proper syntax and the postgres alter table doc has no
example in the alter column choices.

What I've tried:
bustrac=# alter table people alter column email set data type varchar(64) [];
ERROR:  column "email" cannot be cast automatically to type character varying[]
HINT:  You might need to specify "USING email::character varying(64)[]".

How do I incorporate the "USING email::..." string?

TIA,

Rich


Re: Accommodating alternative column values

От
"David G. Johnston"
Дата:


On Wednesday, July 3, 2024, Rich Shepard <rshepard@appl-ecosys.com> wrote:
On Wed, 3 Jul 2024, Rich Shepard wrote:

What I've tried:
bustrac=# alter table people alter column email set data type varchar(64) [];
ERROR:  column "email" cannot be cast automatically to type character varying[]
HINT:  You might need to specify "USING email::character varying(64)[]".

What I forgot to mention is that the current datatype is varchar(64) and I
want to make it an array.


Yeah, the simply cast suggested will not work.  You’d have to apply an expression that turns the current contents into an array.  The current contents are not likely to be an array literal.

David J.

Re: Accommodating alternative column values

От
Torsten Förtsch
Дата:
The USING phrase basically answers the question how do I convert an existing value of the old type to the new type.

On Wed, Jul 3, 2024 at 4:03 PM Rich Shepard <rshepard@appl-ecosys.com> wrote:
On Wed, 3 Jul 2024, Rich Shepard wrote:

> What I've tried:
> bustrac=# alter table people alter column email set data type varchar(64) [];
> ERROR:  column "email" cannot be cast automatically to type character
> varying[]
> HINT:  You might need to specify "USING email::character varying(64)[]".

What I forgot to mention is that the current datatype is varchar(64) and I
want to make it an array.

Rich


Re: Accommodating alternative column values

От
Rich Shepard
Дата:
On Wed, 3 Jul 2024, David G. Johnston wrote:

> Yeah, the simply cast suggested will not work. You’d have to apply an
> expression that turns the current contents into an array. The current
> contents are not likely to be an array literal.

David,

No, it's not now an array.

I thought that this expression would work, but it doesn't:
bustrac=# alter table people alter column email set data type varchar(64)[] using email::varchar(64)[];
RROR:  malformed array literal: "frank@dmipx.com"
DETAIL:  Array value must start with "{" or dimension information.

If I correctly understand the error detail I'd need to change the contents
of that column for all 1280 rows to enclose the contents in curly braces
before I can convert the datatype to an array. Is that correct?

Rich



Re: Accommodating alternative column values

От
Torsten Förtsch
Дата:
Check this out
https://www.postgresql.org/docs/16/arrays.html#ARRAYS-INPUT

You can use
    ('{' || email || '}')::varchar(64)[]

or the syntax I suggested earlier.

On Wed, Jul 3, 2024 at 4:13 PM Rich Shepard <rshepard@appl-ecosys.com> wrote:
On Wed, 3 Jul 2024, David G. Johnston wrote:

> Yeah, the simply cast suggested will not work. You’d have to apply an
> expression that turns the current contents into an array. The current
> contents are not likely to be an array literal.

David,

No, it's not now an array.

I thought that this expression would work, but it doesn't:
bustrac=# alter table people alter column email set data type varchar(64)[] using email::varchar(64)[];
RROR:  malformed array literal: "frank@dmipx.com"
DETAIL:  Array value must start with "{" or dimension information.

If I correctly understand the error detail I'd need to change the contents
of that column for all 1280 rows to enclose the contents in curly braces
before I can convert the datatype to an array. Is that correct?

Rich


Re: Accommodating alternative column values

От
"David G. Johnston"
Дата:
On Wed, Jul 3, 2024 at 7:13 AM Rich Shepard <rshepard@appl-ecosys.com> wrote:
On Wed, 3 Jul 2024, David G. Johnston wrote:

> Yeah, the simply cast suggested will not work. You’d have to apply an
> expression that turns the current contents into an array. The current
> contents are not likely to be an array literal.

David,

No, it's not now an array.

I thought that this expression would work, but it doesn't:
bustrac=# alter table people alter column email set data type varchar(64)[] using email::varchar(64)[];
RROR:  malformed array literal: "frank@dmipx.com"
DETAIL:  Array value must start with "{" or dimension information.

If I correctly understand the error detail I'd need to change the contents
of that column for all 1280 rows to enclose the contents in curly braces
before I can convert the datatype to an array. Is that correct?


Assuming today there is only one email per row, no, see Torsten's reply.

You also wouldn't need to perform an update..."using ('{' || email || '}')::text[]" if just doing that...

David J.

Re: Accommodating alternative column values

От
"Peter J. Holzer"
Дата:
On 2024-07-03 07:13:47 -0700, Rich Shepard wrote:
> On Wed, 3 Jul 2024, David G. Johnston wrote:
> > Yeah, the simply cast suggested will not work. You’d have to apply an
> > expression that turns the current contents into an array. The current
> > contents are not likely to be an array literal.
>
> David,
>
> No, it's not now an array.
>
> I thought that this expression would work, but it doesn't:
> bustrac=# alter table people alter column email set data type varchar(64)[] using email::varchar(64)[];
> RROR:  malformed array literal: "frank@dmipx.com"
> DETAIL:  Array value must start with "{" or dimension information.
>
> If I correctly understand the error detail I'd need to change the contents
> of that column for all 1280 rows to enclose the contents in curly braces
> before I can convert the datatype to an array. Is that correct?

No. You need *some* way of creating an array with a single element which
is your email address. Constructing a valid array literal as a text and
casting that to array type is one way to do this. However, it seems like
a rather cumbersome and error-prone way to me.

As Raymond Hettinger likes to say: "There must be a better way".

And indeed, https://www.postgresql.org/docs/current/functions-array.html
shows lots of array values written as ARRAY[1, 2, 3] or similar. So that
makes it likely that ARRAY[email] creates an array with the intended
contents.

Try it with

    select array[email] from people;

If that looks promising, you can use it in an alter table statement
(Torsten already posted the solution, but I wanted to expand a bit on
how to find it).

        hp

--
   _  | Peter J. Holzer    | Story must make more sense than reality.
|_|_) |                    |
| |   | hjp@hjp.at         |    -- Charles Stross, "Creative writing
__/   | http://www.hjp.at/ |       challenge!"

Вложения

Re: Accommodating alternative column values

От
Adrian Klaver
Дата:
On 7/3/24 07:13, Rich Shepard wrote:
> On Wed, 3 Jul 2024, David G. Johnston wrote:
> 
>> Yeah, the simply cast suggested will not work. You’d have to apply an
>> expression that turns the current contents into an array. The current
>> contents are not likely to be an array literal.
> 
> David,
> 
> No, it's not now an array.
> 
> I thought that this expression would work, but it doesn't:
> bustrac=# alter table people alter column email set data type 
> varchar(64)[] using email::varchar(64)[];
> RROR:  malformed array literal: "frank@dmipx.com"
> DETAIL:  Array value must start with "{" or dimension information.
> 
> If I correctly understand the error detail I'd need to change the contents
> of that column for all 1280 rows to enclose the contents in curly braces
> before I can convert the datatype to an array. Is that correct?

An example:

create table array_conv(id integer, email varchar(64));

insert into array_conv values (1, 'adrian.klaver@aklaver.com'), (2, 
'aklaver@example.com');

select * from array_conv ;
  id |           email
----+---------------------------
   1 | adrian.klaver@aklaver.com
   2 | aklaver@example.com

alter table array_conv alter column email type varchar[] using array[email];

select * from array_conv ;
  id |            email
----+-----------------------------
   1 | {adrian.klaver@aklaver.com}
   2 | {aklaver@example.com}
> 
> Rich
> 
> 

-- 
Adrian Klaver
adrian.klaver@aklaver.com




Re: Accommodating alternative column values [RESOLVED]

От
Rich Shepard
Дата:
On Wed, 3 Jul 2024, Adrian Klaver wrote:

> alter table array_conv alter column email type varchar[] using array[email];
>
> select * from array_conv ;
> id |            email
> ----+-----------------------------
>  1 | {adrian.klaver@aklaver.com}
>  2 | {aklaver@example.com}

Adrian,

Given my inexperience with arrays this seems to be the simplest of all
offered syntaxes.

Another valuable postgres lesson learned.

Much appreciated,

Rich