Very very cool. Similar to the DigitalPalace idea, LesOrchards Agent Frank which is in turn an implementation of the UniversalPersonalProxy idea.
See also: DigitalPalace, WikiAsPim, AsWeMayThink, VannevarBush
MyLifeBits Project
Microsoft Bay Area Research Center Media Presence Group
MyLifeBits is a lifetime store of everything. It is the fulfillment of VannevarBushs 1945 Memex vision including full-text search, text & audio annotations, and hyperlinks.
Gordon Bell has captured a lifetime's worth of articles, books, cards, CDs, letters, memos, papers, photos, pictures, presentations, home movies, videotaped lectures, and voice recordings and stored them digitally. He is now paperless, and is beginning to capture phone calls, television, and radio.
MyLifeBits software leverages SQL server to support: hyperlinks, annotations, reports, saved queries, pivoting, clustering, and fast search. It includes tools to make annotation easy, including gang annotation on right click, voice annotation, and browser integration. Its browser tool records a copy of every web page visited.
Source: http://research.microsoft.com/barc/MediaPresence/MyLifeBits.aspx