Log of the #duraspace-ff channel on chat.freenode.net

Using timezone: Eastern Standard Time
* gregjansen leaves09:06
* gregjansen joins09:07
* fasseg leaves11:08
* jonathangee leaves11:11
* ksclarke joins12:01
<pivotal-bot_>Esme Cowles added "Update curl examples to use --data-binary instead of -d option" https://www.pivotaltracker.com/story/show/6390192412:06
<barmintor>awoods: I am under the impression that, given our tardiness and a lack of response from potential attendees, that there will be no Fedora4 C4L pre-con. True?12:19
* edInCo joins13:09
* scossu joins14:32
* scossu leaves14:37
* scossu_ joins14:41
* scossu joins
* scossu_ leaves
<scossu>Hi there.14:45
I'm testing the jms-indexer. I'm pretty sure I had it working several weeks ago, but I'm having problems now.
I'm using Sesame for indexing. The config is pretty default-ish:14:46
<property name="queryBase" value="http://${sesame.host:localhost}:${sesame.port:8080}/openrdf-sesame/repositories/collections-test"/>
<property name="updateBase" value="http://${sesame.host:localhost}:${sesame.port:8080}/openrdf-sesame/repositories/collections-test/statements"/>
<property name="formUpdates">
<value type="java.lang.Boolean">true</value>
I verified that the endpoint exists. Although when I insert a record in Fedora I get this in the logfile:14:48
DEBUG 13:22:13.926 (IndexerGroup) Received message: ID:webserver-44709-1389813717085-3:1:1:1:1
DEBUG 13:22:13.926 (IndexerGroup) Discovered pid: /newObj1234 in message.
DEBUG 13:22:13.926 (IndexerGroup) Discovered event type: http://fedora.info/definitions/v4/repository#NODE_ADDED in message.
DEBUG 13:22:13.926 (IndexerGroup) It is false that this is a removal operation.
DEBUG 13:22:13.927 (RdfRetriever) Retrieving RDF content from: http://localhost:8080/rest/newObj1234...
WARN 13:22:13.938 (DefaultMessageListenerContainer) Execution of JMS message listener failed, and no ErrorHandler has been set.
java.lang.RuntimeException: org.apache.http.HttpException: HTTP/1.1 404 Not Found
at com.google.common.base.Throwables.propagate(Throwables.java:160) ~[guava-15.0.jar:na]
at org.fcrepo.indexer.RdfRetriever.get(RdfRetriever.java:84) ~[fcrepo-jms-indexer-core-4.0.0-alpha-3-SNAPSHOT.jar:na]
at org.fcrepo.indexer.RdfRetriever.get(RdfRetriever.java:47) ~[fcrepo-jms-indexer-core-4.0.0-alpha-3-SNAPSHOT.jar:na]
at com.google.common.base.Suppliers$MemoizingSupplier.get(Suppliers.java:125) ~[guava-15.0.jar:na]
at org.fcrepo.indexer.IndexerGroup.onMessage(IndexerGroup.java:203) ~[fcrepo-jms-indexer-core-4.0.0-alpha-3-SNAPSHOT.jar:na]
at org.springframework.jms.listener.AbstractMessageListenerContainer.doInvokeListener(AbstractMessageListenerContainer.java:562) ~[spring-jms-3.2.0.RELEASE.jar:3.2.0.RELEASE]
at org.springframework.jms.listener.AbstractMessageListenerContainer.invokeListener(AbstractMessageListenerContainer.java:500) ~[spring-jms-3.2.0.RELEASE.jar:3.2.0.RELEASE]
* ksclarke leaves15:33
* scossu leaves15:34
* scossu joins15:38
<awoods>barmintor: Unless we hear otherwise, I am also assuming no c4l pre-con... although I suspect you could ping Tim McGeary if you wanted to 'make it happen'.16:19
* gregjansen leaves17:06
* scossu leaves17:11
* scossu joins17:27
<awoods>scossu: Any luck with the jms-indexer?17:29
<scossu>awoods: no. I'm stuck with the error message above.17:32
There is a 404 but I can't figure out what it's looking for.17:33
<awoods>scossu: Can you describe your setup, and I will try to reproduce...
how are you deploying Fedora? jetty? tomcat? port?
how are you deploying Jena? port?
<scossu>Tomcat. Sesame is on the same host:port (localhost:8080)17:34
<awoods>how are you deploying the jms-indexer?
<scossu>as Fedora
Compiled from source with Maven and dropped .war file into container.
<awoods>Fedora and Sesame are both on Tomcat:8080
<awoods>and how is jms-indexer deployed?17:35
<scossu>That's what I was talking about.
Sesame I downloaded the package and deployed the provided .war files for workbench and server.
<awoods>there are three apps: fedora, sesame, and jms-indexer.17:36
<scossu>I can access the Sesame repo from the workbench.
<awoods>please describe how they are each deployed.
take your time.
<scossu>Fedora I compiled with mvn, grabbed the war file in fcrepo-webapp, dropped into /var/lib/tomcat7/webapps, configured and restarted.17:38
Tested, records are created, updated and deleted.
<awoods>Are you saying that everything is in tomcat:8080 (fcrepo-webapp, jms-indexer, sesame, and sesame-workbench)?17:40
* scossu1 joins17:41
Sesame: unpacked tarball and deployed openrdf-sesame.war and openrdf-workbench.war to same tomcat webapps folder17:42
and how about jms-indexer.war?
is that also in tomcat:8080?
<barmintor>awoods: mostly I need to figure out if there's a Columbia-fundable reason for me to register for C4L.17:43
<barmintor>(that was from my question earlier, sorry)
* scossu leaves
<awoods>barmintor: I would suggest responding to the email thread that included Tim McGeary to see if you can confirm a pre-con. I know he would like to help make that happen.17:44
barmintor: emails with subject: "Re: F4 C4L Pre-con"17:45
<scossu1>The command line for tomcat server:
svc.exec -Djava.awt.headless=true -Dfile.encoding=UTF-8 -server -Xms512m -Xmx1024m -XX:NewSize=256m -XX:MaxNewSize=256m -XX:PermSize=256m -XX:MaxPermSize=256m -XX:+DisableExplicitGC -Dcatalina.home=/usr/share/tomcat7 -Dcatalina.base=/usr/share/tomcat7 -Djava.io.tmpdir=/var/tmp/tomcat7/temp -cp /usr/share/java/commons-daemon.jar:/usr/share/java/eclipse-ecj.jar:/usr/share/tomcat7/bin/bootstrap.jar:/usr/share/tomcat7/bin/tomcat-juli.jar -user tomcat7 -j
Last word is Bootstrap, sorry17:46
<awoods>scossu1: I have never tried to deploy all four webapps in the same tomcat, but will give it a try to see if it is working on my side. Usually I have two jettys and one tomcat.
scossu1: Anyways, let me try.17:47
<scossu1>for the JMS indexer I actually encountered some test errors, so I went with -DskipTests. I can try to re-compile to reproduce them.
Solr indexer test fails:17:54
Pardon - this is the actual one: http://pastebin.com/711K52gd17:57
<awoods>scossu1: I am rebuilding master of fcrepo and jms-indexer... stay tuned.18:02
One question: is there any configuration needed in Fedora for the indexer? Or is it all configured in the indexer servlet?18:17
<awoods>scossu1: No additional configuration is needed on the Fedora side.
scossu1: fcrepo-jms-indexer-pluggable just successfully built for me. (mvn clean install)
<cbeer>barmintor: want to man the blacklight table?18:23
at c4l
<scossu1>awoods: correction: the fedora .war file I'm using is the pre-compiled alpha318:24
<awoods>scossu1: ok
scossu1: would you mind building jms-indexer again (mvn clean install), just to see if the error is consistent?18:25
Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 22.879 sec <<< FAILURE! - in org.fcrepo.indexer.system.SolrMappingsIT18:34
testOneResourceCustomMapping(org.fcrepo.indexer.system.SolrMappingsIT) Time elapsed: 20.431 sec <<< FAILURE!
java.lang.AssertionError: Got other-than-one documents from index under our title!
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.fcrepo.indexer.system.SolrMappingsIT.testOneResourceCustomMapping(SolrMappingsIT.java:214)
WARN 17:32:35.297 (CommonAnnotationBeanPostProcessor) Invocation of destroy method failed on bean with name 'org.fcrepo.jms.observer.JMSTopicPublisher#0': javax.jms.JMSException: Peer (vm://localhost#1) disposed.
DEBUG 17:32:35.312 (FusekiContainerWrapper) stopping Fuseki
Results :
Failed tests:
SolrMappingsIT.testOneResourceCustomMapping:214 Got other-than-one documents from index under our title!
Tests run: 7, Failures: 1, Errors: 0, Skipped: 0
<awoods>scossu1: same error as before.18:35
<awoods>scossu1: as a test, could you stop your tomcat (sudo service tomcat7 stop), then run the jms-indexer test again (mvn clean install)?
awoods: same error.18:40
scossu1: How are you configuring jms-indexer? with /etc/default/tomcat7?18:50
<scossu1>awoods: /var/lib/tomcat7/webapps/fcrepo-indexer/WEB-INF/classes/spring/indexer-core.xml18:52
awoods: I basically just uncommented the sesame section, changed port # from 8081 to 8080 and commented the fuseki section.18:53
<awoods>scossu1: then restarted tomcat?
<scossu1>No, just the servlet.18:54
awoods: I can try restart tomcat too.
<awoods>scossu1: you probably already have, if you stopped tomcat for the previous test.
<scossu1>awoods: By the way, I tried replacing the indexer with the most recent build, reconfigured, and it still gives me 404.18:55
awoods: the indexer is alive apparently.18:56
<awoods>DEBUG 17:50:44.085 (RdfRetriever) Retrieving RDF content from: http://localhost:8080/rest/hello...
it looks like the url is missing: fcrepo-webapp
scossu1: my work-around for that is to set the port to: "8080/fcrepo-webapp"18:57
<scossu1>awoods: Oh I see that.
<awoods>scossu1: I will put in a pivotal tracker ticket to make that configurable.18:58
<scossu1>awoods: why does the port have to include the context part?18:59
<awoods>scossu1: That is the only way you can currently get the context into the URL.19:01
scossu1: hence the pivotal ticket.
<scossu1>awoods: I see. Where do I specify that?19:03
<awoods>scossu1: Either in the indexer-core.xml:19:05
<property name="repositoryURL" value="http://${fcrepo.host:localhost}:${fcrepo.port:8080}/rest" />
...or with the property: "fcrepo.port" in your /etc/default/tomcat7 file.
<pivotal-bot_>Andrew Woods added "JMS-Indexer-Pluggable context should be configurable" https://www.pivotaltracker.com/story/show/6393397819:08
Andrew Woods edited "JMS-Indexer-Pluggable context should be configurable" https://www.pivotaltracker.com/story/show/6393397819:09
* edInCo leaves19:11
<scossu1>awoods: Thanks for looking into this.19:26
<awoods>scossu1: any luck?
<scossu1>awoods: now I don't get an error message, but the indexer still won't show the new object.
awoods: DEBUG 18:25:32.572 (IndexerGroup) Received message: ID:webserver-44261-1389831426358-3:1:1:1:1119:27
DEBUG 18:25:32.572 (IndexerGroup) Discovered pid: /testIndexing01 in message.
DEBUG 18:25:32.572 (IndexerGroup) Discovered event type: http://fedora.info/definitions/v4/repository#NODE_ADDED in message.
DEBUG 18:25:32.572 (IndexerGroup) It is false that this is a removal operation.
DEBUG 18:25:32.572 (RdfRetriever) Retrieving RDF content from: http://localhost:8080/fcrepo-webapp-4.0.0-alpha-3/rest/testIndexing01...
DEBUG 18:25:32.697 (IndexerGroup) Resource: /testIndexing01 retrieved without indexable type.
DEBUG 18:25:32.697 (IndexerGroup) Operating for indexer: org.fcrepo.indexer.FileSerializer@583df1cb
DEBUG 18:25:32.697 (IndexerGroup) Operating for indexer: org.fcrepo.indexer.sparql.SparqlIndexer@4acd73af
awoods: What does 'retrieved without indexable type' mean? Do I have to enable indexing explicitly on objects?19:28
<awoods>scossu1: yes
<scossu1>awoods: that makes sense.
<awoods>scossu1: The wiki is currently (temporarily) down for maintenance... when it comes back up I will find the documentation that describes that.19:29
<scossu1>awoods: Thanks a lot. I'll disconnect to get back home. I'll look into the docs later.19:31
<awoods>scossu1: I will send you a link in an email.
...if the wiki comes back sometime soon-ish.
<scossu1>awoods: thanks! Talk to you later.19:32
* scossu1 leaves
* scossu joins21:19
* scossu leaves21:33
* scossu joins21:51
* scossu leaves21:52
* scossu joins22:18
* scossu leaves22:58
* scossu joins