Lots of Americans have been to Cuba, even I know some.  True, its illegal, but its not hard.  
The guys I know who went are scuba divers.  They flew into the Dominican Republic and onto Cuba from there.  It is a poor country, similar to other Caribbean nations.