I wonder if your family did a specific gift swap rather than yankee swap, it would be easier? Don't give gifts to every person, but each person picks a name from a hat and spends $50 on that particular person? Everyone would get something, but I'd bet you'd have more fun buying (and people would have more fun receiving).