Log of the #fcrepo channel on chat.freenode.net

Using timezone: Eastern Standard Time
* dwilcox joins04:31
* manez joins04:55
* manez leaves05:00
* dwilcox leaves05:28
* manez joins05:56
* manez leaves06:01
* dwilcox joins06:41
* manez joins06:57
* manez leaves07:01
* dwilcox leaves07:02
* manez joins07:57
* manez leaves08:00
* manez joins
* dhlamb joins08:06
* dwilcox joins08:08
* manez leaves08:30
* manez joins08:36
* peichman joins08:57
* peichman leaves09:06
* acoburn joins09:24
* peichman joins09:40
* dwilcox leaves09:43
* whikloj joins09:47
* mikeAtUVa joins09:53
* dwilcox joins10:02
* peichman1 joins10:14
* peichman leaves10:16
<whikloj>acoburn: ping10:17
<acoburn>whikloj: pong
<whikloj>acoburn: I was testing some of the Solr indexing issues yinlin and danny bernstein found. It appears to do more with latency, in that given enough time the object is indexed.10:18
<acoburn>whikloj: can you summarize what those issues were?
<whikloj>acoburn: But it seemed slowed because the other objects it was trying to index had already been deleted. Would an aggregator be beneficial?
acoburn: Basically I tried using yinlin's test suite which is a java implementation of the bash scripts, but as objects are created and deleted right after each other fcrepo-camel would get a 40410:20
<acoburn>whikloj: yes, I'd expect that
<whikloj>acoburn: So when it comes around to testing the Solr indexer, there was a considerable lag before it showed up in Solr.
acoburn: Not sure this is really an issue, as it did show up.
<acoburn>whikloj: how often are objects "committed" to the index
whikloj: I think the default is 10 seconds, you can change that to 100 ms10:21
* peichman1 leaves
<whikloj>acoburn: good question, I'll check that on the vagrant base box.
<acoburn>whikloj: https://github.com/fcrepo4-exts/fcrepo-camel-toolbox/blob/master/fcrepo-indexing-solr/src/main/cfg/org.fcrepo.camel.indexing.solr.cfg#L29
whikloj: it's 10 seconds by default
<whikloj>acoburn: ohhhhhhhh10:22
<acoburn>whikloj: that's a good default value for production use
whikloj: but for testing it's useful to make it much smaller
<whikloj>acoburn: Yeah this was much longer than that, it seemed to take awhile to get the messages off the queue
acoburn: I'll try timing it and see what it appears to be
acoburn: Because the "solrObject" didn't appear in the karaf log until a good 2-3 minutes after it was created.10:23
<acoburn>whikloj: that seems like quite a long time10:24
<whikloj>acoburn: I assumed all the 404s where causing some redelivery issues that slowed down processing?
<acoburn>whikloj: that's quite likely
<whikloj>acoburn: So would an last message aggregator solve that, so if you add and delete it within the specified timeframe it would only try to send the delete request to Solr, instead of failing on indexing the object10:25
* peichman joins10:26
<acoburn>whikloj: if you're just testing things, and you don't want Solr indexing enabled, you can just disable it
whikloj: i.e. set the input.stream to something like "mock:foo"
<whikloj>acoburn: ok10:27
* dwilcox leaves10:32
* peichman leaves10:48
* peichman joins10:58
* dbernstein joins11:00
* peichman leaves
* dwilcox joins11:08
* dwilcox_ joins12:00
* dwilcox leaves
* peichman joins12:02
* dhlamb leaves12:07
* dbernstein_ joins12:08
* peichman leaves12:11
* dbernstein leaves12:12
* peichman joins12:15
* peichman leaves12:16
* dwilcox_ leaves12:17
* github-ff joins12:22
[fcrepo4-vagrant] whikloj opened pull request #63: Misspelled fcrepo-ldpath feature name. (master...misspelled-feature) https://git.io/vPsZI
* github-ff leaves
<whikloj>ruebot: ^^ if you have time12:23
<ruebot>whikloj: i shall take care of it today!12:27
<whikloj>ruebot: It doesn't seem to be a rush as it seems to get pulled in automatically. So I have still been able to index objects. But that error is annoying.12:28
<ruebot>whikloj: ...and i'll get to remove that error from all my notes on the testing page :-D12:30
<whikloj>ruebot++
* github-ff joins12:33
[fcrepo4-vagrant] whikloj opened pull request #64: Fix misspelled feature name - Release Branch (4.7.0-RC...misspelled-feature-4.7.0-RC) https://git.io/vPscW
* github-ff leaves
* ajs6f joins12:49
* github-ff joins13:59
[fcrepo4-vagrant] whikloj pushed 1 new commit to 4.6.0-maintenance: https://git.io/vPsas
fcrepo4-vagrant/4.6.0-maintenance b7260d9 Jared Whiklo: Merge pull request #61 from fcrepo4-exts/FCREPO-2251...
* github-ff leaves
* github-ff joins14:00
[fcrepo4-vagrant] whikloj pushed 1 new commit to 4.7.0-RC: https://git.io/vPsaB
fcrepo4-vagrant/4.7.0-RC ff318bf Jared Whiklo: Merge pull request #60 from fcrepo4-exts/FCREPO-2157...
* github-ff leaves
* manez leaves14:35
* github-ff joins14:38
[fcrepo-camel-tests] acoburn opened pull request #13: Add httpcore dependency (master...fcrepo-2257) https://git.io/vPs6W
* github-ff leaves
* amccarty joins14:49
* dhlamb joins14:58
* github-ff joins
[fcrepo-camel] acoburn opened pull request #125: Tighten processor code (master...fcrepo-2257) https://git.io/vPsXu
* github-ff leaves
<acoburn>ajs6f: any chance that you could review this: https://jira.duraspace.org/browse/FCREPO-2257?15:00
ajs6f: the goal is basically to clean up the code before I start making breaking changes15:01
ajs6f: i.e. remove the jms-specific header defns
dhlamb: or, if you have time ^^^
* manez joins15:19
* github-ff joins15:42
[fcrepo4-vagrant] ruebot closed pull request #63: Misspelled fcrepo-ldpath feature name. (master...misspelled-feature) https://git.io/vPsZI
* github-ff leaves
* github-ff joins15:47
[fcrepo4-vagrant] ruebot closed pull request #64: Fix misspelled feature name - Release Branch (4.7.0-RC...misspelled-feature-4.7.0-RC) https://git.io/vPscW
* github-ff leaves
* amccarty leaves16:04
* dhlamb leaves16:06
* mjgiarlo joins16:10
* mjgiarlo leaves16:27
* mjgiarlo joins16:42
* manez leaves16:50
* mjgiarlo leaves
* acoburn leaves16:52
* manez joins16:56
* mikeAtUVa leaves17:01
* whikloj leaves17:02
* peichman joins17:32
* manez leaves17:50
* amccarty joins17:54
* amccarty_ joins17:58
* amccarty leaves
* amccarty joins18:00
* amccarty_ leaves
* manez joins18:51
* manez leaves18:55
* dwilcox joins18:56
* peichman leaves19:21
* dwilcox leaves19:28
* manez joins19:33
* ajs6f leaves20:06
* dbernstein leaves20:07
* manez leaves20:13
* ajs6f joins20:21
* ajs6f leaves
* dbernstein joins20:58
* manez joins21:13
* manez leaves21:18
* peichman joins21:27
* dhlamb joins21:54
* manez joins22:14
* manez leaves22:18
* peichman leaves22:27
* manez joins22:40
* amccarty leaves22:45
* manez leaves22:54

Generated by Sualtam