A less expensive way is a portable app. There are "portable applications" that install and run SOLELY off a thumb drive. a Portable browser's history, cookies and bookmarks are kept on the thumb drive.
Most once installed auto pop a shortcut to the desktop so you can easily run it and when done, unplug and the shortcut goes away.
@Orion1972, I run Ubuntu Linux, there is no registry and the hd was encrypted when I installed. You either have an account on my machine to decrypt YOUR home directory, or you get garbage.
the key is a 1024 bit key btw.