Im not so sure if it is the case but you may want to look into binding the port to one of the IP addresses at a time.