The way I'd expect it to work is that when I go to another doctor's office, I sign something, or if the transfer is needed in advance, I sign something at the time of referral.

Maybe when the federal government standardizes medical records, a lot of this problem will disappear.