Log of the #duraspace-ff channel on chat.freenode.net

Using timezone: Eastern Standard Time
* ksclarke leaves02:28
* kaarefc joins02:49
* escowles joins07:43
* mikeAtUVa joins08:04
* escowles leaves08:07
* github-ff joins09:00
[fcrepo4] barmintor pushed 1 new commit to jersey2: http://git.io/9JZ9Pg
fcrepo4/jersey2 d5bc9d1 Benjamin Armintor: stash TransactionService changes for rebase
* github-ff leaves
* kaarefc leaves09:15
* travis-ci joins09:19
[travis-ci] futures/fcrepo4#1142 (jersey2 - d5bc9d1 : Benjamin Armintor): The build failed.
[travis-ci] Change view : https://github.com/futures/fcrepo4/compare/6cbd1dc93ac4...d5bc9d1e3be7
[travis-ci] Build details : http://travis-ci.org/futures/fcrepo4/builds/13806173
* travis-ci leaves
<bljenkins>Project fcrepo-fixity-corrupter build #398: SUCCESS in 1 min 54 sec: http://ci.fcrepo.org/jenkins/job/fcrepo-fixity-corrupter/398/09:30
Project fcrepo-kitchen-sink build #612: FAILURE in 5 min 35 sec: http://ci.fcrepo.org/jenkins/job/fcrepo-kitchen-sink/612/09:36
* escowles joins09:41
* ksclarke joins09:42
* osmandin joins09:46
<mikeAtUVa>When I try to build modeshape from source, I get a bunch of local failed dependencies and Access denied to: http://repository.jboss.org/maven2/org/jboss/security/jbossxacml/2.0.4/jbossxacml-2.0.4.pom.. has anyone seen this, and is there an easy solution?10:11
<awoods>mikeAtUVa: are you following the directions in the ModeShape GitHub README?
mikeAtUVa: namely, using their -s settings.xml
<mikeAtUVa>I suppose not. I'll try that.10:12
awoods: thanks.10:13
<awoods>mikeAtUVa: np, thank you.
<escowles>awoods: i've got the day off today b/c of veterans' day -- do you know if other people are off today, or not?
<awoods>escowles: I am not sure. This page does not indicate a holiday: https://wiki.duraspace.org/display/FF/Beta+Sprint+Schedule10:14
escowles, et. al: I wanted to discuss an updated plan during today's stand-up...10:15
<escowles>awoods: just noticed that -- i was planning on doing standup (and i'm getting my desktop machine setup to do performance testing)
* fasseg joins10:18
<awoods>escowles: Does that mean you will or will not be able to join/lead the stand-up?10:22
<escowles>awoods: i am fine leading the standup today, just wanted to make sure it was going to happen10:23
<awoods>escowles: nbanks was the only one I heard say that he would not be able to join.
all: Based on discussions last week, the 4.0 Key Capabilities has been trimmed to get it out very soon.10:32
I would like to revisit everyone's focus coming out of Austin and going into a targeted next alpha release.
<pivotal-bot>Chris Beer edited "Update a whole set of datastreams while incrementing the top level object version by one only" https://www.pivotaltracker.com/story/show/4577145910:38
Chris Beer edited "Retrieve a top level object version based on a time stamp" https://www.pivotaltracker.com/story/show/45768823
Chris Beer started "Document CND REST Endpoint" https://www.pivotaltracker.com/story/show/60475356
* barmintor joins10:40
* ermadmix joins
<awoods>cbeer: Do you have time for pivotal cleaning today?10:41
<pivotal-bot>Chris Beer added comment: "Added to https://wiki.duraspace.org/display/FF/REST+API" https://www.pivotaltracker.com/story/show/6047535610:44
<cbeer>awoods: sure.
<awoods>cbeer: right after standup?10:45
<cbeer>works for me
<awoods>cbeer: thanks
cbeer: I gather this is "Finish"ed? https://www.pivotaltracker.com/story/show/6047535610:50
<pivotal-bot>feature: Document CND REST Endpoint (started) / owner: Chris Beer
<cbeer>awoods: yes. i haven't clicked save yet, because i'm re-documenting the namespaces endpoint on that page too10:51
<pivotal-bot>Chris Beer finished "Document CND REST Endpoint" https://www.pivotaltracker.com/story/show/6047535610:54
<cbeer>be there soon.. hit a 2-factor auth screen..11:01
<awoods>barmintor: standup?11:02
<barmintor>awoods: there
<cbeer>awoods: do you want to reschedule our call?11:04
<pivotal-bot>Chris Beer started "Review/Modify Async Storage API" https://www.pivotaltracker.com/story/show/5985547011:07
Chris Beer added comment: "Added proposed async interaction pattern to https://wiki.duraspace.org/display/FF/Design+-+Asynchronous+Stora..." https://www.pivotaltracker.com/story/show/5985547011:26
Chris Beer added comment: "If there's consensus, I'll remove the old page content, add some more examples, and call out endpoints to mak..." https://www.pivotaltracker.com/story/show/5985547011:27
Chris Beer edited "Make a JMS serialization that isn't annoying to parse" https://www.pivotaltracker.com/story/show/4562943911:34
Chris Beer added comment: "@ajs6f any suggestions for a good endpoint name?" https://www.pivotaltracker.com/story/show/5109804911:36
Chris Beer edited "Rename fcr:pid to something non-PIDy" https://www.pivotaltracker.com/story/show/51098049
<escowles>fasseg: i found the script i was using for testing adding rdf properties linking two objects using SPARQL Update: https://gist.github.com/escowles/741610311:39
<fasseg>escowles: thx, here the desc of my prob: https://gist.github.com/fasseg/741614911:40
<pivotal-bot>A. "Senphitic" Soroka added comment: "I don't like "minter" because it's a verb." https://www.pivotaltracker.com/story/show/5109804911:43
Chris Beer edited "Arbitrary recursion depth for RDF responses" https://www.pivotaltracker.com/story/show/49867057
Chris Beer edited "Provide machinery to inject the current node into the controller" https://www.pivotaltracker.com/story/show/5333612311:44
A. "Senphitic" Soroka added comment: ""identifier" is cool by me. I wonder if there's a practice out there we can adopt for "minter"-typ..." https://www.pivotaltracker.com/story/show/51098049
<barmintor>cbeer: One of the failures I'm getting is from a NPE for the subject of the Jena Dataset serialized by the BaseHTMLProvider- I don't see that it is set anywhere. Sound familiar at all?11:45
<cbeer>barmintor: you're talking about something in11:46
<barmintor>Yes, looks like
we expect the subject to be keyed to "uri" elsewhere
<pivotal-bot>Chris Beer estimated "Arbitrary recursion depth for RDF responses" as 3 points https://www.pivotaltracker.com/story/show/4986705711:47
<cbeer>barmintor: ah, yes. that happens somewhere in the dataset generators in kernel.
<barmintor>cbeer: ok- somehow it's not, but I'll track it down
<escowles>fasseg: my script was using the rest api -- the implementation is here and looks like it's doing something similar to what you are doing: https://github.com/futures/fcrepo4/blob/master/fcrepo-http-api/src/main/java/org/fcrepo/http/api/FedoraNodes.java#L25511:51
<cbeer>barmintor: looks like it's in places that use GraphProperties.URI_SYMBOL?11:53
<fasseg>escowles: yeah i also looked at the updateProperty() integration tests but it seems the translation between the rest resource i exposed at "/fcrepo/scape/entity/" to a node with a path of "/objects/scape/entities/" seems to be the problem for me
<pivotal-bot>Chris Beer deleted "Add REST API documentation about WHY we made the decisions we did" https://www.pivotaltracker.com/story/show/51567165
Chris Beer deleted "Improve hydra integration test response time" https://www.pivotaltracker.com/story/show/5130920711:54
<fasseg>but when im looking a GraphSubjects now I think I might have misunderstood it ....
<pivotal-bot>Chris Beer deleted "Improve performance of SPARQL/UPDATE request endpoint to take <150ms" https://www.pivotaltracker.com/story/show/51568497
Chris Beer deleted "fcrepo4 stress test" https://www.pivotaltracker.com/story/show/50682547
Chris Beer deleted "Create a hydra-jetty fcrepo4 fork" https://www.pivotaltracker.com/story/show/51570127
<escowles>fasseg: i'm a little fuzzy on GraphSubjects -- but it sounds like it may need to be updated to handle the scape mapping?
<pivotal-bot>Chris Beer added "fcrepo4 locking error in -webapp on redeploy" https://www.pivotaltracker.com/story/show/6052347411:55
Chris Beer deleted "org.infinispan.util.concurrent.TimeoutException: Unable to acquire lock after [10 seconds] " https://www.pivotaltracker.com/story/show/4775830711:56
Chris Beer deleted "Figure out the XA deadlock problem" https://www.pivotaltracker.com/story/show/47842075
<fasseg>it's actually an interface which I implemented myself for SCAPE but it seems I did mess up a node path separator
escowles ^^
<pivotal-bot>Chris Beer started "Upgrade to Jersey 2.0" https://www.pivotaltracker.com/story/show/5220082311:57
<cbeer>barmintor: a 5 point task, huh? ^
<barmintor>cbeer: in retrospect, definitively
<pivotal-bot>Chris Beer added comment: "This may be implicitly fixed by @eddies resource sync work?" https://www.pivotaltracker.com/story/show/58449968
Chris Beer added comment: "@ajs6f there's another ticket that says the same thing, but says to inject the actual FedoraResource object i..." https://www.pivotaltracker.com/story/show/5923213412:00
Chris Beer deleted "Refactor (to DRY out) the HTTP path => JCR path logic" https://www.pivotaltracker.com/story/show/5942450812:01
A. "Senphitic" Soroka added comment: "Yep, we could inject either the path or the resource, or both in different circumstances." https://www.pivotaltracker.com/story/show/5923213412:02
Chris Beer added "Single-click launcher enhancements" https://www.pivotaltracker.com/story/show/6052445812:04
<barmintor>awoods: I gotta drop the call, back in just a minute12:07
<cbeer>wow. i found a ticket mentioning https://cwiki.apache.org/confluence/display/MAVEN/Parallel+builds+in+Maven+312:18
it shaved a pretty good chunk of time off my local builds, at least.12:19
<barmintor>Oh, hey: that is awesome.
<fasseg>20-50% !! nice
<awoods>cbeer: what was your command? "mvn -T 4"?
-T 3C
(3 threads per core)12:20
if only he'd sent an email instead of burying it in a ticket!
<awoods>ajs6f mentioned test failures in this mode. I assume your tests passed.
<cbeer>awoods: except for my already broken tests.12:21
<awoods>cbeer: that is fair
<cbeer>i'm going to stash my changes and re-run it against master soon
the ticket said to enable this on travis-ci, which seems like a good idea.. i'm trying to figure out the resources of a travis worker first
ah. single core, apparently.12:24
<fasseg>:( mvn -T 3C clean install fails for me at fcrepo-jms with a PathNotFoundExceptionMapper
<awoods>it failed for me in fcrepo-rss
but I was on pace for a 50% speed increase.12:25
<cbeer>hm. it passed -rss for me12:27
<pivotal-bot>Chris Beer added comment: "Travis only offers 1 core. Do you think it'd actually benefit from multiple threads? I guess i'm not sure how..." https://www.pivotaltracker.com/story/show/5960319012:40
* ermadmix leaves12:41
* osmandin leaves12:42
<barmintor>cbeer: sneaky sneaky- SerializationUtils duplicates that key12:44
<pivotal-bot>Chris Beer deleted "Expose registered predicates (and a way to register typed predicates) via the REST API" https://www.pivotaltracker.com/story/show/5109757512:46
<cbeer>escowles: i'm poking at that sparql thing, as i said..12:52
i'm not sure how to handle predicate-selecting SPARQL queries yet
e.g. SELECT ?predicate WHERE <my:subject> ?predicate "xyz"
i'm thinking about just saying you can't do that.12:53
* ermadmix joins12:59
<awoods>cbeer: ready?13:02
<cbeer> 2 min.
<cbeer>awoods: ok13:04
<pivotal-bot>Chris Beer deleted "Expose cluster health via REST API" https://www.pivotaltracker.com/story/show/4773068913:08
Chris Beer deleted "Figure out how to handle low-level cache entries in a distributed scenario (where our cache loader may not have all ..." https://www.pivotaltracker.com/story/show/4953735113:12
Chris Beer added "Add clustering design doc" https://www.pivotaltracker.com/story/show/60530490
Chris Beer added "Add fixity design doc" https://www.pivotaltracker.com/story/show/60530506
Chris Beer deleted "Add locking to LowLevelCacheEntry when it is mucking around with content streams" https://www.pivotaltracker.com/story/show/4992797713:13
Chris Beer deleted "Figure out how to best arrange IT in the globbing branch" https://www.pivotaltracker.com/story/show/4879937713:14
Chris Beer added "Use consistent package naming for integration tests" https://www.pivotaltracker.com/story/show/6053090013:17
Chris Beer edited "Remove jaxb dependencies from external fcrepo projects" https://www.pivotaltracker.com/story/show/5043348713:18
<barmintor>cbeer: haven't pushed ityet, but for some reason FedoraIdentifiers wasn't setting subject on its Dataset result13:19
so NPEs on serialization
<pivotal-bot>Chris Beer deleted "Produce a set of performance charts comparing fcrepo3 and fcrepo4" https://www.pivotaltracker.com/story/show/5157228313:21
Chris Beer deleted "Add enunciate docs to the webapp" https://www.pivotaltracker.com/story/show/5082721913:23
Chris Beer deleted "Parameterize JMeter thread groups" https://www.pivotaltracker.com/story/show/5124857313:24
Chris Beer deleted "Test fcrepo4 with a large random data set" https://www.pivotaltracker.com/story/show/52213823
Chris Beer deleted "Ensure fcrepo4 datastream read times are consistently faster than fcrepo3 read times" https://www.pivotaltracker.com/story/show/48288739
Chris Beer deleted "Ensure fcrepo4 datastream write times are consistently faster than fcrepo3 write times" https://www.pivotaltracker.com/story/show/48288755
Chris Beer deleted "Analyze clustered test results and generate new tickets for improving performance" https://www.pivotaltracker.com/story/show/51567907
Chris Beer deleted "Create asynchronous indexing, clustered configuration for modeshape" https://www.pivotaltracker.com/story/show/5151542913:25
Chris Beer added "Review distributed fcrepo-jcr configurations for consistency, performance, etc and document tradeoffs." https://www.pivotaltracker.com/story/show/60531566
Chris Beer deleted "Run performance benchmarks against (clustered) modeshape-based fcrepo4" https://www.pivotaltracker.com/story/show/4480905913:26
Chris Beer deleted "Analyze single-node sync & async test results and generate new tickets" https://www.pivotaltracker.com/story/show/51567801
Chris Beer deleted "hydra + fcrepo4 benchmark" https://www.pivotaltracker.com/story/show/5068293713:27
Chris Beer deleted "Update JMeter test to demonstrate starting a transaction, make changes, and commit the changes" https://www.pivotaltracker.com/story/show/49010757
A. "Senphitic" Soroka added comment: "Actually, I guess "minter" is not a verb, but it still seems a little off to me. The ID minter is ..." https://www.pivotaltracker.com/story/show/5109804913:28
Chris Beer deleted "Publish performance benchmarks with single-fast-ingest config" https://www.pivotaltracker.com/story/show/5198697113:30
<barmintor>I get a PErmGen error every time I try to build13:31
the jersey2 branch, anyway
so… that's bad
<pivotal-bot>Chris Beer deleted "Document CMIS feature" https://www.pivotaltracker.com/story/show/52022147
* ermadmix leaves
<pivotal-bot>Chris Beer deleted "Add ability for bagit connector to read from zipped bags" https://www.pivotaltracker.com/story/show/5431849813:32
Chris Beer deleted "Add ability for bagit connector to write to exploded bags" https://www.pivotaltracker.com/story/show/54318670
Chris Beer edited "Leverage Event.getMixinNodeTypes() in DefaultFilter" https://www.pivotaltracker.com/story/show/5453060613:33
<barmintor>Exception in thread "JS executor for com.gargoylesoftware.htmlunit.WebClient@7c7e4d74" java.lang.OutOfMemoryError: PermGen space13:34
MAVEN_OPTS="-Xmx4g -XX:MaxPermSize=2048M" mvn clean install13:35
<pivotal-bot>Chris Beer deleted "Add structured exception response data" https://www.pivotaltracker.com/story/show/51102179
Andrew Woods deleted "Fair Game" https://www.pivotaltracker.com/story/show/5428520213:36
Chris Beer deleted "Fedora datastream content request should support asynchronous operations" https://www.pivotaltracker.com/story/show/42227375
Chris Beer deleted "Propose a straw-man way to support whole-object versioning" https://www.pivotaltracker.com/story/show/49013577
Chris Beer deleted "Add test coverage to FedoraResource" https://www.pivotaltracker.com/story/show/5156594313:38
* github-ff joins
[fcrepo4] cbeer deleted resource-unit-test at 3d310db: http://git.io/wavaTw
* github-ff leaves
<pivotal-bot>Chris Beer edited "Replace state transfer with ClusterCacheLoader?" https://www.pivotaltracker.com/story/show/48170003
Chris Beer deleted "Replace state transfer with ClusterCacheLoader?" https://www.pivotaltracker.com/story/show/4817000313:39
* github-ff joins
[fcrepo4] cbeer deleted clustered-cache-loader at 4612289: http://git.io/cQm-ow
* github-ff leaves
<pivotal-bot>Chris Beer deleted "Tomcat 7 on futures6 Permgen Exception on re-deploy" https://www.pivotaltracker.com/story/show/4654330113:40
Chris Beer deleted "The root node should have an etag value" https://www.pivotaltracker.com/story/show/5423197413:41
Chris Beer deleted "Create iRODS Connector" https://www.pivotaltracker.com/story/show/5425057413:42
Chris Beer deleted "Create a sequencer that copies projected bagit nodes to internal nodes." https://www.pivotaltracker.com/story/show/5074829113:43
Chris Beer deleted "Index projected nodes into MODE's Lucene index" https://www.pivotaltracker.com/story/show/5074867713:44
Chris Beer deleted "Implement Write Operations in BagIt Federation Connector" https://www.pivotaltracker.com/story/show/48764295
Chris Beer deleted "Replace Velocity templating with LDPath's Freemarker integration" https://www.pivotaltracker.com/story/show/5306415513:46
Chris Beer edited "Propose modules to get extracted from core for fcrepo 4.0" https://www.pivotaltracker.com/story/show/5116425313:47
Chris Beer deleted "Fixity service should send a JMS message when fixity runs on an object" https://www.pivotaltracker.com/story/show/4646190913:48
Chris Beer deleted "Create and Install SSL Cert: Sonar, Nexus, Jenkins" https://www.pivotaltracker.com/story/show/54283812
Chris Beer deleted "Migrate from Gluck to AWS" https://www.pivotaltracker.com/story/show/54284208
Chris Beer estimated "OPTIONS support on LDP Resources" as 2 points https://www.pivotaltracker.com/story/show/5429290413:49
Chris Beer estimated "Use nouns in the fcrepo-http-api sub-resources" as 2 points https://www.pivotaltracker.com/story/show/4906241713:50
Chris Beer estimated "Provide machinery to inject the current node into the controller" as 2 points https://www.pivotaltracker.com/story/show/53336123
Chris Beer estimated "Rename fcr:pid to something non-PIDy" as 1 point https://www.pivotaltracker.com/story/show/51098049
Chris Beer edited "Define Object "Delete" Strategy" https://www.pivotaltracker.com/story/show/5461105013:53
Chris Beer estimated "Define Object "Delete" Strategy" as 2 points https://www.pivotaltracker.com/story/show/54611050
Chris Beer deleted "Define requirements for BagIt Connector" https://www.pivotaltracker.com/story/show/54879554
Chris Beer deleted "Ensure BagIt connector emits event on Manifest update" https://www.pivotaltracker.com/story/show/54879652
Chris Beer deleted "Ensure BagIt connector triggers a given sequencer" https://www.pivotaltracker.com/story/show/5487957213:54
Chris Beer deleted "Watcher for federated BagIt filesystem that triggers events" https://www.pivotaltracker.com/story/show/47380619
Chris Beer deleted "Create a design document for the BagIt connector describing our implementation, requirements, and limitations." https://www.pivotaltracker.com/story/show/47646459
Chris Beer deleted "Ensure projected content emit events on update" https://www.pivotaltracker.com/story/show/5500398213:55
Chris Beer deleted "Ingest large files from projected store into BinaryStore" https://www.pivotaltracker.com/story/show/55003946
Chris Beer deleted 8 stories https://www.pivotaltracker.com/story/show/552964645425051855399510552964265529672854197470482534775445826413:56
Chris Beer deleted "Create a JAX-RS endpoint to proxy a SPARQL endpoint (provided by an external service) AS IF it was a first-class mem..." https://www.pivotaltracker.com/story/show/4545845913:57
Chris Beer deleted "SPARQL Query endpoint in repository:describe" https://www.pivotaltracker.com/story/show/55655436
Chris Beer deleted "fcrepo-fs-ms-federation-connector fires multiple polling events while same large file is transferred" https://www.pivotaltracker.com/story/show/5601562213:58
Chris Beer deleted "Fedora FilesystemConnector for Large Content" https://www.pivotaltracker.com/story/show/55813834
Chris Beer deleted "Do awesome Stanbol EntityHub vs. Fedora integration" https://www.pivotaltracker.com/story/show/5923964614:00
<bljenkins>Project fcrepo-fixity-corrupter build #399: SUCCESS in 1 min 58 sec: http://ci.fcrepo.org/jenkins/job/fcrepo-fixity-corrupter/399/14:01
<pivotal-bot>Chris Beer added "Clean up authz / container and credentials scenarios and setups tag tickets" https://www.pivotaltracker.com/story/show/6053529814:03
Chris Beer added "Trash pending review" https://www.pivotaltracker.com/story/show/6053538214:04
Andrew Woods deleted "Islandora integration" https://www.pivotaltracker.com/story/show/5923764014:05
Chris Beer edited "Trash below pending review" https://www.pivotaltracker.com/story/show/60535382
Chris Beer deleted "View Object in Drupal Interface" https://www.pivotaltracker.com/story/show/55038554
Chris Beer deleted 4 stories https://www.pivotaltracker.com/story/show/58507046584406045844100058441286
<bljenkins>Project fcrepo-fedora3-federation-connector build #177: UNSTABLE in 6 min 24 sec: http://ci.fcrepo.org/jenkins/job/fcrepo-fedora3-federation-connector/177/
<pivotal-bot>Andrew Woods deleted "Triplestore" https://www.pivotaltracker.com/story/show/5576927614:06
Chris Beer deleted "Bulk synchronize all Fedora resources from ModeShape to an external triplestore" https://www.pivotaltracker.com/story/show/5500186614:07
Chris Beer deleted "MODS Sequencer" https://www.pivotaltracker.com/story/show/5715335414:08
<barmintor>Are we still supposed to be creating intermdeiate nodes on POST for a datastream?14:09
<pivotal-bot>Chris Beer deleted "Ingest large files into projected store" https://www.pivotaltracker.com/story/show/55003910
Chris Beer deleted "Add metadata and datastreams to projected content" https://www.pivotaltracker.com/story/show/5500395814:10
Chris Beer deleted "Create a pull request to ModeShape adding the FileSystemMonitor class to their FileSystemConnector code." https://www.pivotaltracker.com/story/show/5598533414:11
Chris Beer deleted "Identify bottleneck solutions" https://www.pivotaltracker.com/story/show/55813388
Andrew Woods deleted "Clustering" https://www.pivotaltracker.com/story/show/57085254
Chris Beer deleted "Investigate alternative indexStorage options (especially in a clustered configuration)" https://www.pivotaltracker.com/story/show/5141769114:12
Andrew Woods deleted "Fedora 3 to 4 Upgrade Capability" https://www.pivotaltracker.com/story/show/4601810714:13
Andrew Woods deleted "Misc" https://www.pivotaltracker.com/story/show/56894974
Chris Beer deleted 2 stories https://www.pivotaltracker.com/story/show/571879544745077714:14
* mikeAtUVa leaves14:20
<pivotal-bot>Chris Beer deleted "OAI-PMH "identify" verb" https://www.pivotaltracker.com/story/show/56811540
* ermadmix joins
<pivotal-bot>Chris Beer deleted "In-memory configuration" https://www.pivotaltracker.com/story/show/5864166014:21
Chris Beer edited "FileSerializer swallows exception" https://www.pivotaltracker.com/story/show/5884534014:22
Chris Beer deleted "Fedora3 Connector: Exception on empty F3 repo" https://www.pivotaltracker.com/story/show/5884892214:23
Andrew Woods deleted "Postponed" https://www.pivotaltracker.com/story/show/5428558614:26
Chris Beer deleted "Add equals and hashCode support to our node wrapper objects (FedoraObject/FedoraResponse/etc/etc)" https://www.pivotaltracker.com/story/show/5110571514:27
* github-ff joins
[fcrepo4] cbeer closed pull request #97: Added support for equals and hashCode to node wrapper objects (master...equals-hashcode-support) http://git.io/_Y1X2w
* github-ff leaves
<pivotal-bot>Chris Beer deleted "Run profiling against current fcrepo4 master and look for any easy bottlenecks to clear off" https://www.pivotaltracker.com/story/show/52325659
<bljenkins>Project fcrepo-fixity-corrupter build #400: SUCCESS in 2 min 13 sec: http://ci.fcrepo.org/jenkins/job/fcrepo-fixity-corrupter/400/14:28
<pivotal-bot>Chris Beer deleted 3 stories https://www.pivotaltracker.com/story/show/584401445843983858439650
* mikeAtUVa joins14:33
<bljenkins>Project fcrepo-kitchen-sink build #613: STILL FAILING in 7 min 21 sec: http://ci.fcrepo.org/jenkins/job/fcrepo-kitchen-sink/613/14:35
<pivotal-bot>Chris Beer estimated "Complete Test Cluster specs page for AWS" as 1 point https://www.pivotaltracker.com/story/show/59699930
<bljenkins>Yippie, build fixed!
Project fcrepo-fedora3-federation-connector build #178: FIXED in 10 min: http://ci.fcrepo.org/jenkins/job/fcrepo-fedora3-federation-connector/178/
<pivotal-bot>Chris Beer estimated "Complete Test Cluster specs page for UW Madison" as 1 point https://www.pivotaltracker.com/story/show/59699864
Chris Beer estimated "Complete Test Cluster specs page for UNC" as 1 point https://www.pivotaltracker.com/story/show/59699750
Andrew Woods edited "Complete Test Cluster specs page for AWS" https://www.pivotaltracker.com/story/show/5969993014:36
Chris Beer deleted "Adjust Sonar settings" https://www.pivotaltracker.com/story/show/5975413614:37
Chris Beer deleted "Find out what "audit" means." https://www.pivotaltracker.com/story/show/5997656814:39
Chris Beer deleted "Retrieve a top level object version based on a time stamp" https://www.pivotaltracker.com/story/show/4576882314:40
Chris Beer deleted "Update a whole set of datastreams while incrementing the top level object version by one only" https://www.pivotaltracker.com/story/show/45771459
Andrew Woods edited "Complete Test Cluster specs page for AWS" https://www.pivotaltracker.com/story/show/5969993014:41
Chris Beer deleted "Investigate CDI framework" https://www.pivotaltracker.com/story/show/5836703414:46
Chris Beer deleted "Create benchmark timing tests for core repository operations (to ensure new-feature-performance standards)" https://www.pivotaltracker.com/story/show/46484665
Chris Beer edited "Fix last modified calculations to include child node modification data (and sometimes jcr:content under that)" https://www.pivotaltracker.com/story/show/4993444514:48
Chris Beer edited "Fix replacing values in non-ISPN binary stores " https://www.pivotaltracker.com/story/show/49863555
Chris Beer edited "Add metadata reader role to basic roles PEP" https://www.pivotaltracker.com/story/show/5933596014:49
Chris Beer edited "Add a query-based strategy to enforce cascading delete" https://www.pivotaltracker.com/story/show/59939480
Chris Beer unstarted "fcr:fixity bug using the FileSystemConnector" https://www.pivotaltracker.com/story/show/5600291614:50
Chris Beer edited "fcr:fixity bug using the FileSystemConnector" https://www.pivotaltracker.com/story/show/56002916
Chris Beer unstarted "Integrate an XACML engine with a role-based PEP" https://www.pivotaltracker.com/story/show/54196834
Chris Beer edited "Integrate an XACML engine with a role-based PEP" https://www.pivotaltracker.com/story/show/5419683414:51
Chris Beer unstarted "Fedora performance tests with/without active basic roles and PEP enforcement" https://www.pivotaltracker.com/story/show/59417314
Chris Beer edited "Fedora performance tests with/without active basic roles and PEP enforcement" https://www.pivotaltracker.com/story/show/59417314
Andrew Woods added comment: "What does this mean exactly?" https://www.pivotaltracker.com/story/show/6027646814:52
Chris Beer unstarted "Fix upload via web interface for files > ~1GB" https://www.pivotaltracker.com/story/show/5522724014:54
Chris Beer edited "Fix upload via web interface for files > ~1GB" https://www.pivotaltracker.com/story/show/55227240
Chris Beer estimated "Workspace description triple" as 1 point https://www.pivotaltracker.com/story/show/60294700
Chris Beer estimated "Single-click launcher enhancements" as 5 points https://www.pivotaltracker.com/story/show/60524458
Chris Beer estimated "Review distributed fcrepo-jcr configurations for consistency, performance, etc and document tradeoffs." as 3 points https://www.pivotaltracker.com/story/show/60531566
Chris Beer estimated "Add fixity design doc" as 2 points https://www.pivotaltracker.com/story/show/60530506
Chris Beer estimated "Add clustering design doc" as 2 points https://www.pivotaltracker.com/story/show/60530490
Chris Beer estimated "Simple Versioning" as 3 points https://www.pivotaltracker.com/story/show/59614268
* ermadmix leaves
<pivotal-bot>Chris Beer estimated "First-Run repository configuration interface" as 5 points https://www.pivotaltracker.com/story/show/6026758014:55
Chris Beer estimated "Package default configuration as a repository" as 3 points https://www.pivotaltracker.com/story/show/60267422
Chris Beer estimated "Configuration auto-discovery" as 5 points https://www.pivotaltracker.com/story/show/60267172
Chris Beer estimated "Human-Intelligible Storage For More Complex Installations" as 2 points https://www.pivotaltracker.com/story/show/60255538
Chris Beer estimated "Human-Intelligible Storage By Default" as 2 points https://www.pivotaltracker.com/story/show/60255168
Chris Beer estimated "Refactor clients of fcrepo-kernel (other than fcrepo-http-api) to use iterating RDF generation pattern." as 3 points https://www.pivotaltracker.com/story/show/5923655414:57
Chris Beer estimated "Develop paging mechanism for fcrepo-http-api methods that report RDF." as 3 points https://www.pivotaltracker.com/story/show/59240160
<cbeer>escowles: ping?15:04
<escowles>cbeer: hey
<cbeer>escowles: i had a question for you while you were at lunch15:05
<escowles>you were asking about sparql queries that answered predicates before
<cbeer>yep. how important is that in real-world uses?
or, i've never done a sparql query that wanted to retrieve predicate names that i can think of
<escowles>it would be very useful for discovering what properties an object has
<escowles>particuarly if you didn't know the vocabs it was using and wanted to know about them
<cbeer>that seems reasonable.
<escowles>we're big fans of the self-describing RDF approach, where you describe your predicates in your triplestore
though i think you wouldn't need to support that for the basic search functionality in the current scope15:07
<cbeer>ok. i'll think about it some more. it doesn't seem impossible, but probably involves a lot of post-processing
<escowles>why is it hard? sparql select can return anything, so i'm not sure why predicates are a special case -- or are we usually assuming URIs are objects?15:08
<cbeer>escowles: i don't think i can get column names out of a jcr query
<escowles>hmmm... so you might do a query, and then need to parse the query to figure out what the result fields were? or something like that?15:09
<cbeer>and maybe do another query to get the predicate-based results15:10
because property information isn't in the jcr index
<escowles>yeah, that would be a pain -- there's no JcrResultSetMetaData?
<cbeer>nope. and the JCR ResultSet is pretty awful. it's not even a hashmap15:11
there's an array of columns and an array of an array of values
and the columns are simple strings, not jcr property names
sorry, jcr Property instances
<escowles>that's pretty primitive
<cbeer>and worse.. they seem to index things based on mixin15:12
so doing cross-mixin based queries means doing a weird join
<escowles>so it might not be worth the effort to do anything more than the simple property-lookup we were talking about in austin15:14
<cbeer>could be.
there's also a (deprecated?) xpath-like query language out-of-the-box15:15
which might be worth exposing
<escowles>something like xpath could get us all the property-lookup functionality we need (and presumably operators, and whatever else they implement)15:16
<cbeer>could be. anyway, i think i'm close on a bunch of simple sparql queries. maybe after getting them done, doing the predicate thing won't be as scary15:18
but i won't throw it out of scope yet
<escowles>cbeer: sounds reasonable -- it would be awesome to have reasonably-complete sparql built-in, but it's not worth herculean efforts15:19
<cbeer>maybe Longshou will come along and just do it..15:22
<escowles>once we get our hydra head pushed out, maybe he will...15:23
* ermadmix joins
<barmintor>I have a question bout the REST API:15:24
If I POST to /notexist with no Slug header, am I supposed to create at /notExist or at /notExist/generatedPid
<cbeer>i'd say create /notexist15:25
<barmintor>me too, but given that:15:26
how was this test supposed to pass?
err, that is: that's not how it was working, so how was that passing?15:27
or did I mess this up in the jersey2 branch?
looking at https://github.com/futures/fcrepo4/blob/master/fcrepo-http-api/src/main/java/org/fcrepo/http/api/FedoraNodes.java#L41515:28
oh, wait
I see
Derp, that if clause checks to see if it exists
<cbeer>testMultipleDatastreams doesn't make sense to me15:29
<barmintor>ok, somewhere in the IT that pid is is getting created
<escowles>cbeer: it seems pretty straightforward to me: create an object and two datastreams, fetch the rdf, and make sure the datastreams are mentioned15:30
<barmintor>I think this might account for the differences between Eclipse and mvn
<cbeer>escowles: oh. i was mis-parsing the first argument t assertTrue
<barmintor>Eclipse isn't cleaning between junit runs
<cbeer>as usual.
barmintor: we've been replacing these hard-coded path names with a uuid-generated one15:31
in some other tests
<barmintor>cbeer: yea, I just refactored it to use the jcr path in the returned Location header
basically the same thing
* gregjansen joins16:03
* osmandin joins16:12
* ermadmix leaves
* ermadmix joins16:18
<cbeer>escowles: ok. i think i have JCR-SQL2 translations for these types of SPARQL queries:16:23
PREFIX dc: <http://purl.org/dc/terms/> SELECT ?subject WHERE { ?subject dc:title "xyz"}
PREFIX dc: <http://purl.org/dc/terms/> SELECT ?title WHERE { ?subject dc:title ?title }
PREFIX dc: <http://purl.org/dc/terms/> SELECT ?subject ?title WHERE { ?subject dc:title ?title }
SELECT ?title WHERE { ?subject dc:title ?title . ?subject fedorarelsext:isPartOf <info:fedora/xyz> }
i think i should move on to different types of operators16:24
(or, really, stash all this work and come back to it later to do that..)
i guess my question for you is, are there other element visitors you'd rank higher in priority?16:25
the only thing i can think of is figuring out subqueries, or some kind of complex reasoning about those paths.16:26
(so i could do SELECT ?relatedTitle WHERE { ?subject dc:title "xyz" . ?subject hasPart ?part . ?pid dc:title ?relatedTitle }16:27
but i kinda want to punt on that form for now.
(if you want that, use a proper triple store!)
* osmandin leaves16:51
<barmintor>ok, finally back to not being able to find the RDF serializers from mvn :P16:54
* github-ff joins16:56
[fcrepo4] barmintor pushed 1 new commit to jersey2: http://git.io/kEDbyw
fcrepo4/jersey2 6e883c8 Benjamin Armintor: test fixup to deal with previously-created PIDs better
* github-ff leaves
<awoods>barmintor: That is forward progress?17:08
<barmintor>awods: yeah, I've been dealing with some test problems17:09
* travis-ci joins
[travis-ci] futures/fcrepo4#1143 (jersey2 - 6e883c8 : Benjamin Armintor): The build is still failing.
[travis-ci] Change view : https://github.com/futures/fcrepo4/compare/d5bc9d1e3be7...6e883c85fbf6
[travis-ci] Build details : http://travis-ci.org/futures/fcrepo4/builds/13828710
* travis-ci leaves
<barmintor>awoods ^
<awoods>barmintor: I see. OAuth has been tripping up the last couple of commits17:10
<pivotal-bot>Andrew Woods edited "Define needs of FileSystem Federation" https://www.pivotaltracker.com/story/show/60276468
Andrew Woods edited "Clean up authz / container and credentials scenarios and setups tag tickets" https://www.pivotaltracker.com/story/show/6053529817:11
Andrew Woods edited "Review distributed fcrepo-jcr configurations for consistency, performance, etc and document tradeoffs." https://www.pivotaltracker.com/story/show/60531566
Andrew Woods edited "Use consistent package naming for integration tests" https://www.pivotaltracker.com/story/show/6053090017:12
Andrew Woods edited "Add fixity design doc" https://www.pivotaltracker.com/story/show/60530506
Andrew Woods edited "Add clustering design doc" https://www.pivotaltracker.com/story/show/60530490
Eric James added comment: "Thinking in terms of functionality we'd like to have with the FileSystemConnector proposing some enhancements..." https://www.pivotaltracker.com/story/show/60276468
Andrew Woods edited "Single-click launcher enhancements" https://www.pivotaltracker.com/story/show/60524458
Andrew Woods edited "Create MessageBodyWriter<RdfStream> " https://www.pivotaltracker.com/story/show/5993921817:13
Andrew Woods edited "Use Maven parallelism in CI" https://www.pivotaltracker.com/story/show/5960319017:14
* gregjansen leaves
<pivotal-bot>Andrew Woods edited "Complete Test Cluster specs page for UNC" https://www.pivotaltracker.com/story/show/59699750
Andrew Woods edited "Define Object "Delete" Strategy" https://www.pivotaltracker.com/story/show/5461105017:15
Andrew Woods edited "Remove jaxb dependencies from external fcrepo projects" https://www.pivotaltracker.com/story/show/50433487
Andrew Woods edited "Introspect the bson output for modeshape schematics and report back how friendly the output is" https://www.pivotaltracker.com/story/show/49012799
Andrew Woods edited "Clean up code in the fcrepo-kernel now that the api is path oriented." https://www.pivotaltracker.com/story/show/49059161
Andrew Woods edited "Use nouns in the fcrepo-http-api sub-resources" https://www.pivotaltracker.com/story/show/4906241717:16
Andrew Woods edited "Parameterize Dataset HTML response " https://www.pivotaltracker.com/story/show/51426639
Andrew Woods edited "Inject graph subjects into JAX-RS resources" https://www.pivotaltracker.com/story/show/6044159217:17
Andrew Woods edited "Inject graph subjects into JAX-RS resources" https://www.pivotaltracker.com/story/show/60441592
Andrew Woods edited "Update graph subjects to subsume the toPath logic" https://www.pivotaltracker.com/story/show/6044163417:18
Andrew Woods edited "Rename fcr:pid to something non-PIDy" https://www.pivotaltracker.com/story/show/51098049
Andrew Woods edited "Make a JMS serialization that isn't annoying to parse" https://www.pivotaltracker.com/story/show/45629439
<awoods>cbeer: That is unfortunate... given the degree to which we lean on jena.17:21
<cbeer>it was going fine, until i needed to implement this interface:
public void visit(ExprFunctionN func) {
without any java docs from them.17:22
<awoods>let that be a lesson to us.
<bljenkins>Project fcrepo-fixity-corrupter build #401: SUCCESS in 2 min 18 sec: http://ci.fcrepo.org/jenkins/job/fcrepo-fixity-corrupter/401/17:23
* fasseg leaves17:24
<cbeer>lesson = visitor patterns are hard?
<awoods>lesson += javadocs are good.
cbeer: Did you happen to notice if ajs6f committed "public void visit (ExprFunctionN func)" to the jena baseline?17:26
<cbeer>awoods: if he had, i'm sure it'd return a Function<void, Function<>>
<bljenkins>Project fcrepo-kitchen-sink build #614: STILL FAILING in 7 min 1 sec: http://ci.fcrepo.org/jenkins/job/fcrepo-kitchen-sink/614/17:30
<barmintor>cbeer: lol17:31
<escowles>cbeer: those look like the main sparql patterns -- the main one i would expect people to want is to do subqueries to find objects based on datastream properties, e.g., "select ?subject ?size where { ?subject fcrepo:hasChild ?child . ?child fcrepo:hasContent ?ds . ?ds fcrest:size ?size }"17:37
<cbeer>escowles: ok, thanks. i'll try to figure that out next... figuring out what's actually talking about nodes ought to be.. interesting.17:38
<awoods>cbeer/escowles: I may have missed the earlier part of this thread, but are we expecting to service such a query as above based on ModeShape's indexing of properties? Obviously, we can not load all of the nodes into memory to respond to such a query. Or is this an example of a query that makes more sense in the external triplestore?17:41
<cbeer>yes, modeshape indexing.
<awoods>cbeer: That would be deluxe if ModeShape offers enough support to service that query.17:42
<cbeer>(or, yes, we're really talking about translating a SPARQL query to a JCR-SQL2 query, so it can be translated to a Lucene query.)
I suspect we would also expect the external triplestore to also correctly service the same queries as well?17:43
<cbeer>yes, though probably more efficiently.17:44
<awoods>escowles: The external triplestore gathers the node properties, correct?
<cbeer>and without some of the restrictions we're probably going to have to add
<awoods>It is probably worth scoping the range of queries supported by the "simple" internal/admin query service.17:45
<cbeer>+1. if we can hit the 80% case, i'll be more than happy17:55
escowles: ping?17:59
* ksclarke leaves18:02
<pivotal-bot>Andrew Woods added comment: "If all of the development team can pass builds with -T 2C, then we might as well see if Travis can as well." https://www.pivotaltracker.com/story/show/5960319018:12
Andrew Woods added comment: "For consistency, does it make more sense to have "fcr:queue" and "fcr:status"(?) as path suffixes instead o..." https://www.pivotaltracker.com/story/show/5985547018:17
Chris Beer added comment: "I think fcr:queue and/or fcr:status should be repository-wide endpoints. " https://www.pivotaltracker.com/story/show/5985547018:18
* github-ff joins18:28
[fcrepo4] barmintor pushed 1 new commit to jersey2: http://git.io/MNKxrA
fcrepo4/jersey2 3d133a6 Benjamin Armintor: manually adding RdfProvider until we figure out classpath scanning
* github-ff leaves
<pivotal-bot>Andrew Woods added "Single-node F4 Ingest Benchmarks" https://www.pivotaltracker.com/story/show/6055694818:31
Andrew Woods added "Single-node F3 Ingest Benchmarks" https://www.pivotaltracker.com/story/show/6055702418:32
Andrew Woods estimated "Single-node F3 Ingest Benchmarks" as 3 points https://www.pivotaltracker.com/story/show/60557024
Andrew Woods added "Clustered F4 Ingest Benchmarks" https://www.pivotaltracker.com/story/show/6055709618:33
Andrew Woods estimated "Clustered F4 Ingest Benchmarks" as 3 points https://www.pivotaltracker.com/story/show/6055709618:34
* tecoripa joins
* tecoripa leaves
<pivotal-bot>Andrew Woods added "Tune Single-node F4 Ingest" https://www.pivotaltracker.com/story/show/6055733618:37
* github-ff joins
[fcrepo4] cbeer created sparql (+2 new commits): http://git.io/VKragw
fcrepo4/sparql 1b43d7e Chris Beer: stash
fcrepo4/sparql 21e19b9 Chris Beer: sparql stuff
* github-ff leaves
<pivotal-bot>Andrew Woods added "Demonstrate/Document Cluster Recipes" https://www.pivotaltracker.com/story/show/6055745418:39
Andrew Woods edited "Demonstrate/Document Cluster Recipes" https://www.pivotaltracker.com/story/show/60557454
* travis-ci joins18:43
[travis-ci] futures/fcrepo4#1145 (sparql - 21e19b9 : Chris Beer): The build has errored.
[travis-ci] Change view : https://github.com/futures/fcrepo4/compare/1b43d7ed635b^...21e19b92411a
[travis-ci] Build details : http://travis-ci.org/futures/fcrepo4/builds/13832564
* travis-ci leaves
<pivotal-bot>Andrew Woods added comment: "Wiki comment: An example SPARQL update body would be helpful for: "/rest/ fcr:namespaces"" https://www.pivotaltracker.com/story/show/6047535618:44
* ermadmix leaves18:48
<pivotal-bot>Chris Beer added comment: "added" https://www.pivotaltracker.com/story/show/60475356
Andrew Woods accepted "Document CND REST Endpoint" https://www.pivotaltracker.com/story/show/6047535618:50
<bljenkins>Project fcrepo-fixity-corrupter build #402: SUCCESS in 1 min 44 sec: http://ci.fcrepo.org/jenkins/job/fcrepo-fixity-corrupter/402/18:55
Project fcrepo-fedora3-federation-connector build #180: UNSTABLE in 4 min 53 sec: http://ci.fcrepo.org/jenkins/job/fcrepo-fedora3-federation-connector/180/18:58
<cbeer>hm. i think object versioning is going to have to happen at the REST API layer19:03
it looks like you can't start a new version when you have a "dirty" session19:04
and we're relying on the REST API to save the session (probably rightfully so)
<awoods>cbeer: Are you suggesting that "create version" needs to happen in fcrepo-http-api:FedoraNodes versus fcrepo-kernel:FedoraResource?19:07
<awoods>hmm, what will a direct integration look like (i.e. someone who interacts with an embedded F4)?19:08
<cbeer>they'd have to trigger versioning themselves.
just like they have to trigger saves themselves19:09
<awoods>cbeer/all: Does this feel right to you? Is there an opportunity to refactor the logic to push versioning/saves into kernel?19:10
Maybe a topic for Thursday?19:11
<cbeer>i think we've had this debate before. happy to reopen it, but it sure seems like a lot of work for little gain.
that said, the -kernel abstraction layer is already a disaster.19:12
<awoods>cbeer: I am happy to let the debate rest... although I would be happier to let it rest with the back-story of where it landed.19:13
<bljenkins>Project fcrepo-fixity-corrupter build #403: SUCCESS in 59 sec: http://ci.fcrepo.org/jenkins/job/fcrepo-fixity-corrupter/403/19:14
<bljenkins>Project fcrepo-kitchen-sink build #615: STILL FAILING in 3 min 39 sec: http://ci.fcrepo.org/jenkins/job/fcrepo-kitchen-sink/615/19:17
Yippie, build fixed!19:18
Project fcrepo-fedora3-federation-connector build #181: FIXED in 5 min 49 sec: http://ci.fcrepo.org/jenkins/job/fcrepo-fedora3-federation-connector/181/
* ermadmix joins19:35
<pivotal-bot>Chris Beer started "Simple Versioning" https://www.pivotaltracker.com/story/show/5961426819:45
* ermadmix leaves20:07
* ermadmix joins20:19
* ermadmix leaves20:51
* github-ff joins21:28
[fcrepo4] cbeer pushed 1 new commit to sparql: http://git.io/vGZA-g
fcrepo4/sparql 780f89d Chris Beer: stash
* github-ff leaves
* travis-ci joins21:33
[travis-ci] futures/fcrepo4#1146 (sparql - 780f89d : Chris Beer): The build has errored.
[travis-ci] Change view : https://github.com/futures/fcrepo4/compare/21e19b92411a...780f89d9a06a
[travis-ci] Build details : http://travis-ci.org/futures/fcrepo4/builds/13837829
* travis-ci leaves
* ermadmix joins21:47
* ermadmix leaves22:19
* ksclarke joins22:26
* ermadmix joins22:27
<bljenkins>Project fcrepo-fixity-corrupter build #404: SUCCESS in 9 min 50 sec: http://ci.fcrepo.org/jenkins/job/fcrepo-fixity-corrupter/404/22:45
<bljenkins>Project fcrepo-kitchen-sink build #616: STILL FAILING in 17 min: http://ci.fcrepo.org/jenkins/job/fcrepo-kitchen-sink/616/23:02
* ermadmix leaves23:31
* ermadmix joins23:44
* ermadmix leaves00:16
* ermadmix joins00:31
* ermadmix leaves01:04
* ermadmix joins01:56
* ksclarke leaves02:49
* ermadmix leaves03:01
* ermadmix joins03:04
* ermadmix leaves03:36

Generated by Sualtam