When this happens do you have a file window open to that drive?

Some of the usb drivers need some time after the last access to the drive to
sync / flush the read/write buffers before you can eject the drive.