I just tested this on PO.
The boost will only stay with you when your item isn't there, The second you get an Item back ( I used a Tropius with Bestow to test it ) Your speed goes back down to its original, although when you consume Its item again, your speed goes back to double.