thr3ads.net - dovecot - [Dovecot] Corrupted index cache file and Maildir filename has wrong W value [May 2010]

If this information is useful, please help other people find it:
Share via:

Barry Scott

2010-May-04 17:21 UTC

[Dovecot] Corrupted index cache file and Maildir filename has wrong W value

kmail stopped working and when I check the dovecot log file I see:

May  4 11:40:38 f12barry dovecot: IMAP(bscott): Corrupted index cache file
/home/bscott/Maildir/._NewMail-com/dovecot.index.cache: Corrupted virtual size
for uid=234: 633278 != 633251
May  4 11:40:38 f12barry dovecot: IMAP(bscott): Corrupted index cache file
/home/bscott/Maildir/._NewMail-com/dovecot.index.cache: Corrupted virtual size
for uid=234: 633278 != 633251
May  4 12:34:44 f12barry dovecot: IMAP(bscott): Corrupted index cache file
/home/bscott/Maildir/.Mailing Lists.Xorg Devel 2010-04/dovecot.index.cache:
Corrupted virtual size for uid=312: 8884 != 8858
May  4 12:34:44 f12barry dovecot: IMAP(bscott): Corrupted index cache file
/home/bscott/Maildir/.Mailing Lists.Xorg Devel 2010-04/dovecot.index.cache:
Corrupted virtual size for uid=312: 8884 != 8858
... more of the same...
May  4 13:02:54 f12barry dovecot: IMAP(bscott): Corrupted index cache file
/home/bscott/Maildir/.Mailing Lists.Xorg Users 2010-04/dovecot.index.cache:
Corrupted virtual size for uid=38: 30392 != 30366
May  4 13:02:58 f12barry dovecot: IMAP(bscott): Corrupted index cache file
/home/bscott/Maildir/.Mailing Lists.Xorg Users 2010-04/dovecot.index.cache:
Corrupted virtual size for uid=43: 8796 != 8770
May  4 15:25:03 f12barry dovecot: IMAP(bscott): FETCH [] for mailbox
_NewMail-com UID 48 got too little data: 3230 vs 3278
May  4 15:25:03 f12barry dovecot: IMAP(bscott): Maildir filename has wrong W
value:
/home/bscott/Maildir/._NewMail-com/cur/1271683097.M615087P3538.f12barry.office.onelan.co.uk,S=3154,W=3278:2,S
May  4 15:25:03 f12barry dovecot: IMAP(bscott): Corrupted index cache file
/home/bscott/Maildir/._NewMail-com/dovecot.index.cache: Broken virtual size for
mail UID 48
May  4 15:25:03 f12barry dovecot: IMAP(bscott): Disconnected: FETCH failed
bytes=15437134/33737060
May  4 17:45:41 f12barry dovecot: dovecot: Killed with signal 15 (by pid=7300
uid=0 code=kill)

At this point I had only tail'ed the log and seen the issue with UID 48.
I then:
1. stopped dovecot
2. deleted the ofending file
3. deleted the dovecot* files
4. started dovecot

May  4 17:49:58 f12barry dovecot: Dovecot v1.2.11 starting up (core dumps
disabled)
May  4 17:52:17 f12barry dovecot: Killed with signal 15 (by pid=7556 uid=0
code=kill)
May  4 17:53:21 f12barry dovecot: Dovecot v1.2.11 starting up (core dumps
disabled)
May  4 17:53:21 f12barry sendmail[2067]: starting daemon (8.14.3): SMTP+queueing
at 01:00:00
May  4 17:53:21 f12barry sm-msp-queue[2075]: starting daemon (8.14.3): queueing
at 01:00:00
May  4 17:55:26 f12barry dovecot: imap-login: Login: user=<bscott>,
method=PLAIN, rip=::1, lip=::1, secured
May  4 17:55:29 f12barry dovecot: IMAP(bscott): FETCH [] for mailbox
_NewMail-com UID 48 got too little data: 3878 vs 3920
May  4 17:55:29 f12barry dovecot: IMAP(bscott): Maildir filename has wrong W
value:
/home/bscott/Maildir/._NewMail-com/cur/1271683097.M733325P3538.f12barry.office.onelan.co.uk,S=3780,W=3920:2,S
May  4 17:55:29 f12barry dovecot: IMAP(bscott): Corrupted index cache file
/home/bscott/Maildir/._NewMail-com/dovecot.index.cache: Broken virtual size for
mail UID 48
May  4 17:55:29 f12barry dovecot: IMAP(bscott): Disconnected: FETCH failed
bytes=3955/48628
May  4 18:05:55 f12barry dovecot: imap-login: Login: user=<bscott>,
method=PLAIN, rip=::1, lip=::1, secured

Now another file is being complained about.

What would cause these problems?
What is the W value and how could I check it?

Here is the details of the dovecot I'm using and the kmail version I'm
using.?

$ sudo dovecot -n
# 1.2.11: /etc/dovecot.conf
# OS: Linux 2.6.32.11-99.fc12.x86_64 x86_64 Fedora release 12 (Constantine) 
login_dir: /var/run/dovecot/login
login_executable(default): /usr/libexec/dovecot/imap-login
login_executable(imap): /usr/libexec/dovecot/imap-login
login_executable(pop3): /usr/libexec/dovecot/pop3-login
mail_executable(default): /usr/libexec/dovecot/imap
mail_executable(imap): /usr/libexec/dovecot/imap
mail_executable(pop3): /usr/libexec/dovecot/pop3
mail_plugin_dir(default): /usr/lib64/dovecot/imap
mail_plugin_dir(imap): /usr/lib64/dovecot/imap
mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3
auth default:
  passdb:
    driver: pam
  userdb:
    driver: passwd

Client is kmail from kdepim-4.4.2-1.fc12.x86_64

Barry

Barry Scott

2010-May-25 13:38 UTC

head link

[Dovecot] Corrupted index cache file and Maildir filename has wrong W value

On Tuesday 04 May 2010 18:21:50 Barry Scott wrote:> kmail stopped working and when I check the dovecot log file I see:
> 
> May  4 11:40:38 f12barry dovecot: IMAP(bscott): Corrupted index cache file
/home/bscott/Maildir/._NewMail-com/dovecot.index.cache: Corrupted virtual size
for uid=234: 633278 != 633251
> May  4 11:40:38 f12barry dovecot: IMAP(bscott): Corrupted index cache file
/home/bscott/Maildir/._NewMail-com/dovecot.index.cache: Corrupted virtual size
for uid=234: 633278 != 633251
> May  4 12:34:44 f12barry dovecot: IMAP(bscott): Corrupted index cache file
/home/bscott/Maildir/.Mailing Lists.Xorg Devel 2010-04/dovecot.index.cache:
Corrupted virtual size for uid=312: 8884 != 8858
> May  4 12:34:44 f12barry dovecot: IMAP(bscott): Corrupted index cache file
/home/bscott/Maildir/.Mailing Lists.Xorg Devel 2010-04/dovecot.index.cache:
Corrupted virtual size for uid=312: 8884 != 8858
> ... more of the same...
> May  4 13:02:54 f12barry dovecot: IMAP(bscott): Corrupted index cache file
/home/bscott/Maildir/.Mailing Lists.Xorg Users 2010-04/dovecot.index.cache:
Corrupted virtual size for uid=38: 30392 != 30366
> May  4 13:02:58 f12barry dovecot: IMAP(bscott): Corrupted index cache file
/home/bscott/Maildir/.Mailing Lists.Xorg Users 2010-04/dovecot.index.cache:
Corrupted virtual size for uid=43: 8796 != 8770
> May  4 15:25:03 f12barry dovecot: IMAP(bscott): FETCH [] for mailbox
_NewMail-com UID 48 got too little data: 3230 vs 3278
> May  4 15:25:03 f12barry dovecot: IMAP(bscott): Maildir filename has wrong
W value:
/home/bscott/Maildir/._NewMail-com/cur/1271683097.M615087P3538.f12barry.office.onelan.co.uk,S=3154,W=3278:2,S
> May  4 15:25:03 f12barry dovecot: IMAP(bscott): Corrupted index cache file
/home/bscott/Maildir/._NewMail-com/dovecot.index.cache: Broken virtual size for
mail UID 48
> May  4 15:25:03 f12barry dovecot: IMAP(bscott): Disconnected: FETCH failed
bytes=15437134/33737060
> May  4 17:45:41 f12barry dovecot: dovecot: Killed with signal 15 (by
pid=7300 uid=0 code=kill)
> 
> At this point I had only tail'ed the log and seen the issue with UID
48.
> I then:
> 1. stopped dovecot
> 2. deleted the ofending file
> 3. deleted the dovecot* files
> 4. started dovecot
> 
> May  4 17:49:58 f12barry dovecot: Dovecot v1.2.11 starting up (core dumps
disabled)
> May  4 17:52:17 f12barry dovecot: Killed with signal 15 (by pid=7556 uid=0
code=kill)
> May  4 17:53:21 f12barry dovecot: Dovecot v1.2.11 starting up (core dumps
disabled)
> May  4 17:53:21 f12barry sendmail[2067]: starting daemon (8.14.3):
SMTP+queueing at 01:00:00
> May  4 17:53:21 f12barry sm-msp-queue[2075]: starting daemon (8.14.3):
queueing at 01:00:00
> May  4 17:55:26 f12barry dovecot: imap-login: Login: user=<bscott>,
method=PLAIN, rip=::1, lip=::1, secured
> May  4 17:55:29 f12barry dovecot: IMAP(bscott): FETCH [] for mailbox
_NewMail-com UID 48 got too little data: 3878 vs 3920
> May  4 17:55:29 f12barry dovecot: IMAP(bscott): Maildir filename has wrong
W value:
/home/bscott/Maildir/._NewMail-com/cur/1271683097.M733325P3538.f12barry.office.onelan.co.uk,S=3780,W=3920:2,S
> May  4 17:55:29 f12barry dovecot: IMAP(bscott): Corrupted index cache file
/home/bscott/Maildir/._NewMail-com/dovecot.index.cache: Broken virtual size for
mail UID 48
> May  4 17:55:29 f12barry dovecot: IMAP(bscott): Disconnected: FETCH failed
bytes=3955/48628
> May  4 18:05:55 f12barry dovecot: imap-login: Login: user=<bscott>,
method=PLAIN, rip=::1, lip=::1, secured
> 
> Now another file is being complained about.
> 
> What would cause these problems?
> What is the W value and how could I check it?
> 
> Here is the details of the dovecot I'm using and the kmail version
I'm using.?
> 
> $ sudo dovecot -n
> # 1.2.11: /etc/dovecot.conf
> # OS: Linux 2.6.32.11-99.fc12.x86_64 x86_64 Fedora release 12 (Constantine)
> login_dir: /var/run/dovecot/login
> login_executable(default): /usr/libexec/dovecot/imap-login
> login_executable(imap): /usr/libexec/dovecot/imap-login
> login_executable(pop3): /usr/libexec/dovecot/pop3-login
> mail_executable(default): /usr/libexec/dovecot/imap
> mail_executable(imap): /usr/libexec/dovecot/imap
> mail_executable(pop3): /usr/libexec/dovecot/pop3
> mail_plugin_dir(default): /usr/lib64/dovecot/imap
> mail_plugin_dir(imap): /usr/lib64/dovecot/imap
> mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3
> auth default:
>   passdb:
>     driver: pam
>   userdb:
>     driver: passwd
> 
> Client is kmail from kdepim-4.4.2-1.fc12.x86_64
> 
> Barry
> 
> 
I'm seeing this problem again.

Can anyone provide any insight into what may be wrong?

At least point me to an explanation for the wrong W value message?

Barry

Timo Sirainen

2010-May-25 15:26 UTC

head link

[Dovecot] Corrupted index cache file and Maildir filename has wrong W value

On Tue, 2010-05-04 at 18:21 +0100, Barry Scott wrote:> May  4 15:25:03 f12barry dovecot: IMAP(bscott): Maildir filename has wrong
W value:
/home/bscott/Maildir/._NewMail-com/cur/1271683097.M615087P3538.f12barry.office.onelan.co.uk,S=3154,W=3278:2,S
S=3154 means the file's size should be 3154 bytes.
W=3278 means the file's "virtual size" = size if linefeeds were
CRLF
should be 3278 bytes.

Easy way to check these values is with e.g.:

# wc 1274725794.M935807P27627.kurkku,S=1901,W=1951:2,
  50  212 1901 1274725794.M935807P27627.kurkku,S=1901,W=1951:2,
# echo 1901+50|bc 
1951

If W value is wrong, it's not currently fixed automatically. Because it
just shouldn't happen. How are you delivering new mails? That file looks
like it's created by Dovecot. So the only possibilities are:

a) Something modified the file after it was already written.

b) The program writing the maildir file is buggy (I'm not aware of any
Dovecot bugs related to this.)

c) Filesystem corrupted the mail file.

Possibly Parallel Threads

Search for more maybe matching threads

dovecot - May 2010 - Corrupted index cache file and Maildir filename has wrong W value

[Dovecot] Corrupted index cache file and Maildir filename has wrong W value

[Dovecot] Corrupted index cache file and Maildir filename has wrong W value

[Dovecot] Corrupted index cache file and Maildir filename has wrong W value

Possibly Parallel Threads