Two things, the Boy Scouts of America explicitly forbid atheists from being scouts, and second, even if they "didn't make an issue out of it", my son would be swearing an oath to god, and I don't want my kid thinking that oaths don't mean anything. If he swears to something he doesn't believe, it's a poor life lesson.