You follow the arrow on your Dowsing Machine until a little circle appears, which means you're standing on right on top of the item. You then move 1 step back and face the item again to press A. You do not stand on the spot where the item is.
Source: experience