>> Before we get too far down this road, what do people think of
>> creating a spambayes package containing classifier and tokenizer?
>> This is just to minimize clutter in site-packages.
Guido> Too early IMO (if you mean to leave the various other tools out
Guido> of it).
Well, I mentioned classifier and tokenize only because I thought they were
the only importable modules.  The rest represent script-level code, right?
Guido> If and when we package this, perhaps we should use Barry's trick
Guido> from the email package for making the package itself the toplevel
Guido> dir of the distribution (rather than requiring an extra directory
Guido> level just so the package can be a subdir of the distro).
That would be perfect.  I tried in the naive way last night, but wound up
with all .py files in the package, which wasn't my intent.
Skip

These results are from timtest.py.  I've got three sets of spam and ham
with about 500 messages in each set.  Here's what happens when I enable
Anthony's header counting code does not seem to help.

> These results are from timtest.py.  I've got three sets of spam and ham
> with about 500 messages in each set.  Here's what happens when I enable
If you've still got the summary files, please cvs up and try running cmp.py
again -- in the process of generalizing cmp.py, you managed to make it skip
half the lines <wink>.  That is, if you've got N sets, you *should* get
N**2-N pairs for each error rate.  You have 3 sets, so you should get 6
pairs of f-n rates and 6 pairs of f-p rates.
>     total unique fp went from 19 to 17
>     total unique fn went from 43 to 28
Looks promising!  Getting 6 lines of output for each block would give a
> Anthony's header counting code does not seem to help.
It helps my test data too much <wink/sigh>.

[Greg Ward]
> Case of headers is definitely helpful.  SpamAssassin has a rule for it
> -- if you have headers like "DATE" or "SUBJECT", you get a few more
> points.
Across my data, all-caps DATE, SUBJECT, TO, etc indeed appear only in the
spam collections.  OTOH, they don't appear often -- less than 1% of spam
messages have at least one of these all-cap header lines.  But when I'm
fighting what are now sub-1% f-n rates, even rare clues can help!