If it was working fine to start with, and what came out went back in, then the problem must be down to some spacer, bearing or bush being displaced and not seating. Not much help to diagnose what's wrong, but looks like a logical inspection of bearings, retainers and spacers would be the way to go. Look for signs and listen for binding or metal to metal contact between brake backplate and hub centre. Disconnect the brake linkage to eliminate brake binding, as suggested by GB.
Swarfy.