[FoRK] Stand up and face the future

Ken Ganshirt @ Yahoo ken_ganshirt at yahoo.ca
Tue Dec 22 15:39:22 PST 2009

--- On Tue, 12/22/09, Jeff Bone <jbone at place.org> wrote:

> Stephen says:
> > Mining, sifting, and real-time do not go together. At
> least not in the traditional forms.
> With the caveat that mining and sifting / reacting in
> realtime are (today) different activities, I have to point
> at the existence proof (what I do for a living these days)
> as contrary to this point of view.  

Perhaps you can "sift"/react in near-realtime (I assume you mean you're filtering the data pretty much as it's created?). But you can't "mine" in realtime. Mining requires a pre-existing source of accumulated data. Or it's not mining. By definition. ... Or is that what you just said?? :-)

And you can't even sift in near-realtime if the data being filtered isn't hitting the filter immediately it's created.

So for "remote" data sources, how do you position your filters in order for the data to hit them in near-realtime? 

Or is your definition of "realtime" sorta looser than mine (e.g. you don't count such things as latency, etc.)? 

(Notice I don't really like to use the term "realtime" because it never is. Comes from my days as a SCADA system developer. Users figured we really could do stuff in real time. And got pretty pissed when we didn't. So I quit using the term.)


Looking for the perfect gift? Give the gift of Flickr! 


More information about the FoRK mailing list