End of File Error on index optmize

Ruby Apps Ferret
1

I was optimizing a 650MB using ferret (0.11.3) and I received the
following error. I’ve seen some people have similar issues but I
haven’t seen any resolutions. The contents of the index directory
follow the error. Has anyone seen anything like this and found a
resolution? Many thanks.

/mnt/apps/search/releases/20070622175637/script/…/config/…/vendor/
gems/rdig-0.3.4/lib/rdig/index.rb:48:in `optimize’: End-of-File Error
occured at <except.c>:93 in xraise (EOFError)
Error occured in store.c:216 - is_refill
current pos = 0, file length = 0

     from /mnt/apps/search/releases/20070622175637/script/../

config/…/vendor/gems/rdig-0.3.4/lib/rdig/index.rb:48:in close' from /mnt/apps/search/releases/20070622175637/script/../ config/../vendor/gems/rdig-0.3.4/lib/rdig/crawler.rb:36:inrun’
from /mnt/apps/search/releases/20070622175637/script/…/
config/…/vendor/gems/rdig-0.3.4/lib/rdig.rb:274:in run' from /mnt/apps/search/releases/20070622175637/script/rdig:95 from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/daemons/ application.rb:152:instart_load’
from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/daemons/
application.rb:229:in start' from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/daemons/ controller.rb:69:inrun’
from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/
daemons.rb:133:in run' from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/daemons/ cmdline.rb:105:incatch_exceptions’
from /usr/lib/ruby/gems/1.8/gems/daemons-1.0.5/lib/
daemons.rb:132:in `run’

ls -Alh /index_dir/
total 649M
-rw------- 1 my_user my_user 3.2M Jun 22 15:40 _0.cfs
-rw------- 1 my_user my_user 22M Jun 22 17:29 _1.cfs
-rw------- 1 my_user my_user 22M Jun 22 18:53 _2.cfs
-rw------- 1 my_user my_user 23M Jun 22 20:14 _3.cfs
-rw------- 1 my_user my_user 22M Jun 22 22:01 _4.cfs
-rw------- 1 my_user my_user 20M Jun 22 21:19 _5.cfs
-rw------- 1 my_user my_user 41M Jun 22 22:02 _5.fdt
-rw------- 1 my_user my_user 113K Jun 22 22:02 _5.fdx
-rw------- 1 my_user my_user 0 Jun 22 22:02 _5.frq
-rw------- 1 my_user my_user 0 Jun 22 22:02 _5.prx
-rw------- 1 my_user my_user 0 Jun 22 22:02 _5.tfx
-rw------- 1 my_user my_user 0 Jun 22 22:02 _5.tis
-rw------- 1 my_user my_user 0 Jun 22 22:02 _5.tix
-rw------- 1 my_user my_user 57M Jun 22 21:19 _6.fdt
-rw------- 1 my_user my_user 161K Jun 22 21:19 _6.fdx
-rw------- 1 my_user my_user 0 Jun 22 21:19 _6.frq
-rw------- 1 my_user my_user 0 Jun 22 21:19 _6.prx
-rw------- 1 my_user my_user 0 Jun 22 21:19 _6.tfx
-rw------- 1 my_user my_user 0 Jun 22 21:19 _6.tis
-rw------- 1 my_user my_user 0 Jun 22 21:19 _6.tix
-rw------- 1 my_user my_user 22M Jun 22 22:50 _7.cfs
-rw------- 1 my_user my_user 135M Jun 22 22:50 _8.fdt
-rw------- 1 my_user my_user 376K Jun 22 22:50 _8.fdx
-rw------- 1 my_user my_user 0 Jun 22 22:50 _8.frq
-rw------- 1 my_user my_user 0 Jun 22 22:50 _8.prx
-rw------- 1 my_user my_user 0 Jun 22 22:50 _8.tfx
-rw------- 1 my_user my_user 0 Jun 22 22:50 _8.tis
-rw------- 1 my_user my_user 0 Jun 22 22:50 _8.tix
-rw------- 1 my_user my_user 7.9M Jun 22 23:11 _9.cfs
-rw------- 1 my_user my_user 276M Jun 22 23:11 _a.fdt
-rw------- 1 my_user my_user 767K Jun 22 23:11 _a.fdx
-rw------- 1 my_user my_user 0 Jun 22 23:11 _a.frq
-rw------- 1 my_user my_user 0 Jun 22 23:11 _a.prx
-rw------- 1 my_user my_user 0 Jun 22 23:11 _a.tfx
-rw------- 1 my_user my_user 0 Jun 22 23:11 _a.tis
-rw------- 1 my_user my_user 0 Jun 22 23:11 _a.tix
-rw------- 1 my_user my_user 16 Jun 22 23:11 segments
-rw------- 1 my_user my_user 350 Jun 22 23:11 segments_5

2

Quick follow up. I’m running a cluster of servers to do indexing in
parallel and I noticed a similar error on another server.

ruby 1.8.4 (2005-12-24) [i386-linux]
Linux 2.6.16-xenU #1 SMP Thu Nov 30 13:48:50 SAST 2006 i686 athlon
i386 GNU/Linux

Over all 16 out of 19 servers have died for as yet unknown reasons.
Here is the other error:

in `optimize’: End-of-File Error occured at <except.c>:93 in xraise
(EOFError)
Error occured in compound_io.c:137 - cmpdi_read_i
Tried to read past end of file. File length is <4360> and
tried to read to <5120>

Help is very much appreciated. Thanks.
Begin forwarded message:

3

in `optimize’: End-of-File Error occured at <except.c>:93 in xraise
(EOFError)
Error occured in compound_io.c:137 - cmpdi_read_i
Tried to read past end of file. File length is <4360> and
tried to read to <5120>

I was optimizing a 650MB using ferret (0.11.3) and I received the
following error. I’ve seen some people have similar issues but I
haven’t seen any resolutions. The contents of the index directory
follow the error. Has anyone seen anything like this and found a
resolution? Many thanks.

Go to ferret 0.11.4

–
Kyle M.
Software Engineer
CastTV, Inc