persistance, keep checking, spending time and getting lucky!! Works for me!! (I also go to sidestep.com as well as kayak.com - not that I'm obsessive mind you!!

)
My favorite story using kayak was my parents favorite uncle passed away, and the air fare was so high ($500 pp rt) that only my dad was going to go, mom was so upset, etc... (1 week notice, Ft Myers to Chicago)
and I got them air fare for $220 RT per person!! cheaper than my dad one ticket RT!!
That is magic!!