After reading the books, I can't imagine watching this show without knowing some of the stuff you get from the narration in the books. Honestly, I found understanding the relationships and NAMES of everyone in the show/books simply not possible with only watching the show.
Highly, highly recommend everyone read the books. And if you're into reading into the theories behind the series here is a really great site
http://towerofthehand.com/ .