Don't give up on this book. Please.
You're probably going to want to, especially if you've read some of Jasper Fforde's other novels - The Eyre Affair and The Big Over Easy, for example, start fast and carry you along. If you don't get the references in these BookWorld novels, I'd admit that you're likely to find yourself more or less baffled by most of the goings-on, but that's only because your level of referentiality isn't simpatico with the novel's. (We blame you for this, just so you know.)
In Shades of Grey, the first novel in Fforde's third (!) ongoing series, something else happens. It's still not quite clear to me why it took so long for me to get hooked, or why I came so near to giving up before getting hooked, but it's not just because I was busy and distracted. No, that's just a normal day around Book Addiction HQ. Rather, I suspect it's because this world is so very, very different from our own: Orwellian, in that conveniently imprecise way people avoid adjectivizing the title 1984, but immensely stranger than that, in ways that are basically beyond a casual reader's penetration, and Fforde deliberately sets us up as casual readers.
Briefly: It's Britain in the future, an impossible-to-determine number of years from now. No one can see at night, everyone's terrified of the dark, and a person can see only parts of the visual spectrum. As a result, your last name is a marker of your colour-sightedness (Ochre, deMauve, Cinnabar, and so on), with gradations within each of the primary and complementary colours; your sightedness is determined during the Ishihara test, taken during your 20th year. The lowest class are the Greys, who do almost all the work in this new society, and whose deaths are unremarked by anyone of another colour. American painter and inventor Albert Henry Munsell makes an appearance here, in a role like that of Aldous Huxley's Ford in Brave New World. Compliance with Munsell's Rules is absolute, and money has been largely supplanted by the use of merits and demerits: lose enough points, and you're subject to Reboot.
And just as in every other fictional totalitarian state, something's wrong. Desperately so, but it's so unclear as to be outside the comprehension of the protagonist, one Eddie Russett. Will Eddie learn enough to make some sense of it all before it's too late?
In the acknowledgements section, Fforde remarks that Shades of Grey turned out to be "rather more difficult to get on to paper than [he] had anticipated" (p.435). I'm assuming that this is one reason that it's a hard book to get into, because Eddie's position is so benightedly ignorant - just like the position of (almost) anyone else in his society - that Fforde's not able to straightforwardly give us the tools to assess Eddie's position. Instead, we're kept in the dark the same way Eddie is, to such an extent that it begins to seem obstructively unhelpful, almost like cheating on Fforde's part.
Once you get the necessary information, much of which doesn't start falling into place until you're 300 or so pages into the novel's 430 pages, then the earlier confusion seems reasonable, and you recognize just how much Fforde has had to keep from us in order to let us appreciate Eddie's character and predicament. Once I was okay with Fforde's secrecy, then retrospectively I was greatly impressed by his narrative reserve and his judicious decision to suppress the essential backstory to this culture. It's a startlingly rich and rewarding novel, but you won't believe me until you're a few hundred pages into it.
So in sum, don't give up.
Shades of Grey is NOT an easy novel to get through, by far the most difficult Jasper Fforde I've read so far. But I wouldn't be surprised if it turned out to be the Fforde novel which stays in the mind longest and most intensely: there's a lot here, and the ending sets up the next volume beautifully. The second in the series, whenever it appears, should have a very different narrative structure that's a whole lot more accessible to anyone who's read this first one - and please, God, don't let Jasper Fforde write Shades of Grey 2 as if its readers haven't read this one! Trust us to follow you around, and we'll follow you wherever you go.