If it is a private club, there isn't much anyone can do about it.
I'm not suggesting the Valley Swim Club's behavior is acceptable, it is deplorable and so revoltingly similiar to the signs over drinking fountains that said 'whites only' from the past.
That said, modern racial fighters like Rev Sharpton should be there, instead of at the Michael Jackson funeral. Then again, there is little publicity and/or money to be made away from the lime light of the funeral.
edit: on second thought, maybe they can sue the club for breech of contract.