BSDCan 2007 005

Rob Krten is a dedicated software hacker who has been doing this for 20+ years. Rob Krten is the author of three QNX books and several articles. He specializes in embedded realtime work, and collects antique minicomputers as a hobby. You can see his resume at www.parse.com/resume.html and visit his personal website at www.parse.com/~rk This presentation describes how to download a large variety of equity and option data from various sources on the internet, how to manage the data (parsing, archiving, etc), and finally how to present the data to applications with a focus on efficiency and access speed. Public domain / open source tools like curl and lynx are highlighted, as well as the author's own custom tools. The entire database schema is presented, and then the use of mmap() is shown for complete efficiency.