[Yanel-dev] problem re-starting Yanel containing a realm with search lock

[Josias Thöny]

Michael Wechner wrote:
> Josias Thöny wrote:
> 
>> Michael Wechner wrote:
>>
>>> Josias Thöny wrote:
>>
>> [...]
>>
>>>
>>>> That's why I changed the behaviour to have only one IndexWriter 
>>>> which is closed when the repository is shut down.
>>>
>>>
>>>
>>> where exactly did you change this? Within the configure/init and 
>>> shutdown methods of Yarep? Is this Yarep repo implementation specific?
>>
>>
>> It's specific to the VFS implementation, and the changes are in r36400 
>> and in r36520, concerning these files:
>>
>> public/yarep/trunk/src/impl/java/org/wyona/yarep/impl/repo/vfs/VirtualFileSystemNode.java 
>>
>> public/yarep/trunk/src/impl/java/org/wyona/yarep/impl/repo/vfs/VirtualFileSystemOutputStream.java 
>>
>> public/yarep/trunk/src/impl/java/org/wyona/yarep/impl/repo/vfs/VirtualFileSystemRepository.java 
>>
> 
> 
> thanks very much for these pointers
> 
>>
>> I think it concerns the clustered repos which use vfs and use indexing.
> 
> 
> ok
> 
>>
>>> and I would like to fix this as quick as possible. At the same time 
>>> you are saying that one receives a LockObtainFailedExceptions when 
>>> multiple threads are trying to write. I am sure there is some way 
>>> that we can fix both problems.
>>
>>
>> I had a closer look at the lucene implementation. It seems that when 
>> it's trying to obtain the write lock, it actually tries multiple times 
>> until a timeout occurs. The default timeout is 1 second.
>> Maybe we can revert to the old way, increase the timeout,
> 
> 
> although I wouldn't increase it much more. Btw, where exactly is this 
> configurable?

IndexWriter.setWriteLockTimeout(long ms)

> 
>> and catch&ignore the LockObtainFailedException.
>> I hope this should fix the problems, or WDYT?
> 
> 
> sounds like a good workaround. Maybe it would be good to log this into a 
> dedicated log-file, e.g. lucene.log, I mean when the 
> LockObtainFailedException is caught, that we log when exactly and for 
> what file this problem occured, such that one has a chance to maybe 
> re-index these files?

sounds good.

josias

> 
> WDYT?
> 
> Thanks
> 
> Michi
> 
>>
>> josias
>>
>>>
>>> Any idea?
>>>
>>> Thanks
>>>
>>> Michi
>>>
>>>>
>>>> Josias
>>>>
>>>> [1] 
>>>> http://lucene.apache.org/java/2_2_0/api/org/apache/lucene/index/IndexWriter.html 
>>>>
>>>>
>>>>>
>>>>>> Maybe with a finalize() method of the IdentityManager/PolicyManager?
>>>>>>
>>>>>> BTW, why is indexing enabled for the res-config repository of the 
>>>>>> yanel-website realm?
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> no, it would make sense to disable this.
>>>>>
>>>>> Cheers
>>>>>
>>>>> Michi
>>>>>
>>>>>>
>>>>>> josias
>>>>>>
>>>>>>>
>>>>>>> Also maybe 
>>>>>>> http://www.manning-sandbox.com/message.jspa?messageID=39279 helps
>>>>>>>
>>>>>>> Thanks
>>>>>>>
>>>>>>> Michi
>>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Yanel-development mailing list
>>>>>> Yanel-development at wyona.com
>>>>>> http://lists.wyona.org/cgi-bin/mailman/listinfo/yanel-development
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>> _______________________________________________
>>>> Yanel-development mailing list
>>>> Yanel-development at wyona.com
>>>> http://lists.wyona.org/cgi-bin/mailman/listinfo/yanel-development
>>>
>>>
>>>
>>>
>>
>> _______________________________________________
>> Yanel-development mailing list
>> Yanel-development at wyona.com
>> http://lists.wyona.org/cgi-bin/mailman/listinfo/yanel-development
> 
> 
>