Using tokenizers?

Ruby Apps Ferret
1

Hi lis

I using Ferret to index some files for a specific usage.

I want to know how can I set a tokenizer for some of my index fields and
if
I can choose a different tokenizer for each field. For example:

If in my document I have two fields :F1 and :F2. What I have to do if I
want
that the field :F1 will be tokenized with a StandardTokenizer and :F2
with
the WhiteSpaceTokenizer??

thank you

2

Hi!

have a look at the PerFieldAnalyzer:
http://ferret.davebalmain.com/api/classes/Ferret/Analysis/PerFieldAnalyzer.html

cheers,
Jens

On 28.09.2008, at 12:20, Lyes A. wrote:

http://rubyforge.org/mailman/listinfo/ferret-talk
–
Jens Krämer
webit! Gesellschaft für neue Medien mbH
Schnorrstraße 76 | 01069 Dresden
Telefon +49351467660 | Telefax +493514676666
[email protected] | www.webit.de

Amtsgericht Dresden | HRB 15422
GF Sven Haubold

3

Ok thank you, it was what I looked for