I think he stumbled upon the house at first just because he was being chased by the priest (which in itself doesn't make sense) and then the second time he recognised the car that run him down.
At least that's how I took it.
__________________  Triumphant sight on a northern sky |