Less horsepower in the engines, less wing area (less lift, less climb rate, lower ceiling on a plane that already barely gets to 20k when loaded), and from pics I've seen there is no bomb bay "bulge" difference between the two. I've seen pics of both and didn't notice any major changes there.
A-1 would definitely be a lesser plane, compared to the A-4.