I happen to know the A320 quite well, including the systems operations. You won't hear them transferring fuel between tanks in flight, as this cannot be done. Fuel can be fed from any tank to either engine, but this is not audible.
The Hydraulic system does have a PTU that can transfer pressure (or energy if you will) between two of the hydraulic systems, but this isn't typically heard in normal flight as it requires difference in pressure that is larger than normally occurs with both engines running at or above idle. It can happen though. On the A318-A321 series aircraft you can often hear the PTU loudest during engine shutdown/spool down when the pilot kills the engines in a staggered manner. If he kills them simultaneously it isn't always heard. When it is heard, it makes a sound that is often compared to a barking dog, declining in frequency and volume as the engines slow to a stop.
Could you have heard the speed brakes being extended?