Guido van Rossum wrote:
> I personally don't think IMAP has a bright future, but for people who
> do use it, that's certainly a good approach.
Writing an IMAP server is a non-trivial task.  The specification is huge
and clients do all kinds of weird stuff.  POP is very easy in
comparison.  Perhaps you could forward messages to a special address or
save them in a special folder to mark them as false negatives.
Alternatively, perhaps there could be a separate protocol and client
that could be used to review additions to the training set.  Each day a
few random spam and ham messages could be grabbed as candidates.
Someone would periodically startup the client, review the candidates,
reclassify or remove any messages they don't like and add them to the
training set.
Neil

[Spambayes] Corpus Collection (Was: Re: Deployment)

I think one step towards deployment is creating a re-usable tokenizer
for mail messages.  The current codebase doesn't expose an easy-to-use
or easy-to-customize tokenizer.
The timtest module seems to contain an enormous body of practical
knowledge about how to parse mail messages, but the module wasn't
designed for re-use.  I'd like to see a module that can take a single
message or a collection of messages and tokenize each one.
I'd like to see the tokenize by customizable, too.  Tim had to exclude
some headers from his test data, because there were particular biases
in the test data.  If other people have test data without those
biases, they ought to be able to customize the tokenizer to include
them or exclude others.
Jeremy

> The other thing on my todo list (probably tonight's tram ride home) is
> to add all headers from non-text parts of multipart messages. If nothing
> else, it'll pick up most virus email real quick.
See the checkin comments for timtest.py last night.  Adding this code gave a
major reduction in the false negative rate:
I *suspect* most of that stuff didn't make any difference, but I put it all
in as one blob so don't know which parts did and didn't help.

Your message of "Fri, 06 Sep 2002 10:53:24 PDT."
             <GCEDKONBLEFPPADDJCOECEGMENAA.whisper@oz.net>