It's not that much of a pain as I don't really have much capital loss. Most of my loss are trading losses and just the cost of doing business. It's a bit hard to argue I am not a trader when clearly I am. For "investments" I always make a separate note on why I am investing... hopefully that'd suffice in an audit.
BTW I usually just hand the gains and losses to my accountant who deals with the tax return... it's just cross my mind the other day wondering the method to which they calculate the tax...
So thanks everyone for the discussion (and saving me some fees from my accountant).