Flow-based search architecture promises flawless

February 24, 2008

Flow-based search architecture promises flawless

Bill Burnham, an early beta-tester of a, what he calls, flow-based search engine, predicts bright future for SkyGrid and even its ability to predict it; the future, that is.

Mr. Burnham writes on alwayson.goingon.com that when the flow, filter, analyze search architecture correlates to the “observed movements in things like … stock markets, company sales […] it should ultimately be able to theoretically predict, with reasonable accuracy, many of those changes. Yes, I said it: SkyGrid and its new search architecture may ultimately predict the future,” the author writes.

Mr. Burnham contrasts the “flow/filter/analyze” SkyGrid architecture to the “traditional” “crawl, index, query,” and the verdict to the latter sounds pessimistic. He calls SkyGrid “a radical new architecture” which ‘holds the potential to actually predict the pattern and influence of idea/meme propagation throughout the internet and from there into the financial markets and beyond.” To support his claims, the author breaks the flow-based architecture description in a series of logical steps that he had, as an early beta-tester, identified.

As to the danger of having the new, “revolutionary” search architecture getting beaten by the sharks of the business, Google, for instance, Mr. Burnham has the answer to that. “Moving from a traditional crawl/index/query architecture to a flow/filter/analyze one is a decidedly non-trivial undertaking, one that would require an entire re-architecture of their core services and thus one highly unlikely to be made.”

Picture: Flickr