cellio: (avatar)
Monica ([personal profile] cellio) wrote2014-07-10 07:46 pm
Entry tags:

learning new patterns

Coming to the world of SQL databases from the world of object-oriented programming is...different. I'm starting to realize why some idioms are different, and I'm sure there are tons more that I haven't noticed yet and am probably getting wrong. But that's what learning experiences are for.

Consider, for example, a system where you have authors with associated publications. If I were designing a system to track that in, say, Java, I would define an Author class and a Publication class, with bidirectional links (Author would have a collection of Publications; Publication would have a collection of Authors (because sometimes authors collaborate)). But in a database table design you don't do that; you define a Persons table that has columns for some unique ID, name, and anything else about the person, and you have a Publications table that has columns for things about the publication like a (book) unique ID, title, publisher, genre, etc, and also the unique ID from the Persons table for the author -- and I'm not sure if multiple authors means multiple rows in the Publications table or if there's some way to do collections. But the point is that a Person doesn't know about its publications -- when you want that you'll do a JOIN between the two tables and then you'll have what you need. Connections between flavors of data are external to the data. This makes sense, but it's going to take a little getting used to.

(Y'all who are way ahead of me on this should please feel free to point out any errors in the above and save me mis-learning some things. Thanks.)

[identity profile] zare-k.livejournal.com 2014-07-11 01:43 am (UTC)(link)
"I'm not sure if multiple authors means multiple rows in the Publications table or if there's some way to do collections."

Like [livejournal.com profile] siderea described, not if the database is properly normalized for transaction processing. I usually refer to these as "map tables". It's an easy way to represent relationships between any number of entities.

Storage for analytic scenarios can be a different matter... data may be denormalized back for aggregation. Looks like I will be learning more about this soon myself.


"Coming to the world of SQL databases from the world of object-oriented programming is...different."

It is just as weird coming from the other direction :)
siderea: (Default)

[personal profile] siderea 2014-07-11 02:49 am (UTC)(link)
I recently heard somebody recommend denormalizing data to solve some problem!

Just to make clear: denormalization is the necessary and normal output of any interesting query. Denormalization is fine in output.

Storing data denormalized... denormalizing is the devil you make deals with, see.

ETA: Wait, what do you mean by "denormalization"? In RDBMSs, it means things like "multiple authors means multiple rows in the Publications table". Your result set of "books and their authors" will look like:
The C Programming Language                        | Kernighan
The C Programming Language                        | Ritchie
Structure and Interpretation of Computer Programs | Abelson 
Structure and Interpretation of Computer Programs | Sussman

But you don't ever store it that way, except in some sort of cache, because data hygiene gets hard/impossible.
Edited 2014-07-11 03:03 (UTC)

[identity profile] zare-k.livejournal.com 2014-07-11 04:58 am (UTC)(link)
"I recently heard somebody recommend denormaliing data to solve some problem!"

Generally motivated by performance concerns. There is some cost to joining a bunch of entities back together for aggregation. Although, you will occasionally hear a blanket "joins are bad!" which is just silly... especially with current RDBMSes that have very advanced query optimizers.

[identity profile] goldsquare.livejournal.com 2014-07-11 02:38 am (UTC)(link)
You can get amazing performance out of SQL as long as you are well to compromise on purity of theory. :-)
siderea: (Default)

[personal profile] siderea 2014-07-11 02:46 am (UTC)(link)
I usually refer to these as "map tables".

I was sufficiently intrigued by the sheer diversity of terms for these things, that I held a poll on it. "Join table" was the clear winner, but "map", "link(|ing|y])", and "(x|cross|)ref(|erence])" all had multiple endorsements.
Edited 2014-07-11 02:47 (UTC)

[identity profile] zare-k.livejournal.com 2014-07-11 05:01 am (UTC)(link)
Interesting! I hear "join table" a lot also.