Lots of Americans have been to Cuba, even I know some. True, its illegal, but its not hard.
The guys I know who went are scuba divers. They flew into the Dominican Republic and onto Cuba from there. It is a poor country, similar to other Caribbean nations.