Log of the #duraspace-ff channel on chat.freenode.net

Using timezone: Eastern Standard Time
* scossu leaves00:26
<ksclarke>awoods you around?00:59
* ksclarke just realizes the hour01:00
* ksclarke leaves01:21
* scossu joins08:19
* scossu leaves08:28
* scossu joins
<awoods>ksclarke: here08:34
* github-ff joins09:00
[fcrepo-jms-indexer-pluggable] awoods pushed 1 new commit to reindex: http://git.io/snb-lQ
fcrepo-jms-indexer-pluggable/reindex 64871bb Andrew Woods: Enable fcrepo-jms-indexer-webapp to run F4 in integration tests...
* github-ff leaves
<pivotal-bot>Andrew Woods added comment: "Resolved with: https://github.com/futures/fcrepo-jms-indexer-pluggable/commit/64871bb59802a85c1733e709b8f96..." https://www.pivotaltracker.com/story/show/6919228009:01
Andrew Woods finished "Configure indexer webapp to run fcrepo4 for integration tests" https://www.pivotaltracker.com/story/show/6919228009:02
Andrew Woods added comment: "@escowles, #69192280 is finished." https://www.pivotaltracker.com/story/show/65168574
* ksclarke joins09:27
* scossu leaves09:29
* martinjd joins09:58
<pivotal-bot>Kevin Clarke started "Unable to list ACL if user includes "writer" role" https://www.pivotaltracker.com/story/show/6854753010:15
* scossu joins10:24
* scossu1 joins10:30
* scossu leaves10:32
<awoods>ksclarke: I assume this ticket is finished? https://www.pivotaltracker.com/story/show/6866296410:38
<pivotal-bot>feature: Execute cross-backend performance testing regime (started) / owner: Kevin Clarke10:39
<ksclarke>yes, but keeping it open while I run some more tests in the background (ones with larger data sizes)
<awoods>ksclarke: that would be great... do you have a sense of how long it would take to run a 100k batch?10:40
<ksclarke>was going to paste them into the confluence page too then close
<awoods>meaning 100,000 objects10:41
<ksclarke>so 30k takes 40 mins10:42
for one config
something like 9 hours?10:44
<awoods>ksclarke: so it may be possible to even run a 500,000 object (single-config) run over the weekend.
I'd have to partition more space10:45
<awoods>ksclarke: that could be good information... or as large of a batch of objects as we can go.
<ksclarke>ok, will just clear with work that I can leave the aws up for the weekend
<awoods>ksclarke: which would mean attaching a larger EBS volume?
leveldb-default would be the one config to test?10:47
<awoods>ksclarke: sure, leveldb10:48
ksclarke: btw, you may want to use my irc hand to get my attention.
* longshou joins10:51
* ksclarke nods10:53
<pivotal-bot>Stefano Cossu added "Distinguish between properties and child nodes in fcr:nodetypes REST API endpoint" https://www.pivotaltracker.com/story/show/6934690410:54
Stefano Cossu edited "Distinguish between properties and child nodes in fcr:nodetypes REST API endpoint" https://www.pivotaltracker.com/story/show/6934690410:58
* github-ff joins11:07
[fcrepo4] chadfennell opened pull request #282: fixing the features wiki link (master...master) http://git.io/sLHLfQ
* github-ff leaves
<pivotal-bot>Esme Cowles edited "Multiple Fedoras Feeding Single Triplestore" https://www.pivotaltracker.com/story/show/6885335411:22
Andrew Woods deleted "Test 2-Node Ingest on UCSD cluster" https://www.pivotaltracker.com/story/show/6183594611:23
<awoods>MAVEN_OPTS="-Xdebug -Xnoagent -Djava.compiler=NONE -Xrunjdwp:transport=dt_socket,address=8000,server=y,suspend=n"
<escowles>longshou: were you starting to say something as i hung up?11:31
<pivotal-bot>Andrew Woods edited "Reduce "One-click-run" Logging" https://www.pivotaltracker.com/story/show/6349324611:33
<longshou>@Esme, yes, I'll be offline for an hour or two after 12:00 EST.11:37
<pivotal-bot>Andrew Woods edited "F4 Test Dataset" https://www.pivotaltracker.com/story/show/6919058811:40
* bibliotechy joins11:49
<pivotal-bot>Longshou Situ added comment: "Just note that single JMS indexer can't consume message from two or more Fedora installations to push to a..." https://www.pivotaltracker.com/story/show/6885335412:01
* longshou leaves12:03
<pivotal-bot>Andrew Woods added comment: "Could you attach the log output file for the error you are seeing: "(IndexerGroup) Failed to retrieve index..." https://www.pivotaltracker.com/story/show/6885335412:24
Andrew Woods added comment: "This code is rolled into the ticket #65168574" https://www.pivotaltracker.com/story/show/6919228012:29
Andrew Woods delivered "Configure indexer webapp to run fcrepo4 for integration tests" https://www.pivotaltracker.com/story/show/69192280
Andrew Woods edited "Distinguish between properties and child nodes in fcr:nodetypes REST API endpoint" https://www.pivotaltracker.com/story/show/6934690412:40
Andrew Woods added comment: "Initially need to investigate why child nodes are being detected as "properties" in the response RDF." https://www.pivotaltracker.com/story/show/6934690412:42
Andrew Woods estimated "Distinguish between properties and child nodes in fcr:nodetypes REST API endpoint" as 2 points https://www.pivotaltracker.com/story/show/69346904
Kevin Clarke added "Turn on checkstyle checking for fcrepo4's test classes" https://www.pivotaltracker.com/story/show/69355194
Andrew Woods unstarted "SPARQL search does not find results for fcrepo:hasParent and fcrepo:hasChild" https://www.pivotaltracker.com/story/show/6449951412:48
Andrew Woods edited "SPARQL search does not find results for fcrepo:hasParent and fcrepo:hasChild" https://www.pivotaltracker.com/story/show/64499514
Andrew Woods edited "Distinguish between properties and child nodes in fcr:nodetypes REST API endpoint" https://www.pivotaltracker.com/story/show/6934690412:49
Andrew Woods added comment: "@escowles and @longshous, can you two look into why this query is not supported by the internal SPARQL-Quer..." https://www.pivotaltracker.com/story/show/6449951412:50
Andrew Woods edited "Investigate hanging fcrepo-jms-indexer-pluggable build hangs" https://www.pivotaltracker.com/story/show/6919869412:52
Andrew Woods edited "FedoraFileSystemConnectorIT test fails when running mvn install without running a clean first" https://www.pivotaltracker.com/story/show/69013802
* longshou joins12:58
<ksclarke>hmm, seems benchtool's "purge objects" isn't really removing them from my file system(?)13:08
<awoods>ksclarke: you mean the objects are not being purged from the repository?13:09
<ksclarke>well, looking at code now... I mean after benchtool says it's purged the 30k objects the disk size hasn't been reduced back to what it was before the objects were added
(so I run out of disk space on the next run)13:10
<awoods>ksclarke: that is surprising. I will be interested to hear what you discover.13:11
<cbeer>ksclarke: modeshape lazy-garbage-collects objects. is that what you're seeing?13:12
* fcrepo-bot joins13:13
<ksclarke>perhaps... that was my first thought, but I figured when I tried to write more into a space it would be cleaning up things to be collected, but instead I was able to write until I got a disk full error
cbeer ^13:14
<awoods>cbeer: Do you know the GC schedule?
<ksclarke>and actually I restart jetty between the purge and starting to write new records so I'd assuming jetty going down would trigger modeshape cleanup?13:15
<awoods>cbeer: different topic, I saw you name magically appear on this sprint at 50%... do you know anything about that? It is news to me.
<cbeer>awoods: next week jcoyne and I (and esme and barmintor??) are doing hydra/fcrepo4 stuff
i can't plan any further ahead than the next sprint though13:16
<awoods>cbeer: so not sprint-work per se.
<escowles>cbeer: glad to hear that, though i haven't heard about me being involved...
<awoods>escowles: Are you in on this next week?
<escowles>awoods: dunno -- i'll ask my peeps
<cbeer>escowles: ok. I thought BigD volunteered you at code4lib
awoods: i haven't looked at tickets. if there's any REST API stuff sitting around, maybe they're good candidates.13:18
<pivotal-bot>Andrew Woods edited "Support deleting of multi-valued properties on REST API" https://www.pivotaltracker.com/story/show/6892855813:19
Andrew Woods edited "Return some indication of whether or not all triples were persisted in the response to a resource creation request." https://www.pivotaltracker.com/story/show/68301958
Andrew Woods edited "Return timestamp when creating node" https://www.pivotaltracker.com/story/show/68301562
Andrew Woods deleted "Demonstrate linear scaling of a cluster by adding nodes at UNC." https://www.pivotaltracker.com/story/show/6711552813:20
Andrew Woods deleted "Get New Relic license" https://www.pivotaltracker.com/story/show/6623010813:21
<cbeer>awoods: i'm not logged in, but I'm pretty sure https://www.pivotaltracker.com/s/projects/684825/stories/68928558 works if you actually use the sparql-update syntax for it
e.g. DELETE { <> <dc:title> ?t } WHERE { <> <dc:title> ?t }
<awoods>cbeer: Let me give it a spin...
<pivotal-bot>Andrew Woods edited "Including "<> a <ldp:Container >" triple in a PUT request body should not result in a 500 status code and stack trace" https://www.pivotaltracker.com/story/show/6616830813:22
Andrew Woods edited "Determine what paging means and verify that it works." https://www.pivotaltracker.com/story/show/6250277213:23
Andrew Woods edited "Make org.fcrepo.kernel.Transaction implement javax.transaction.Transaction" https://www.pivotaltracker.com/story/show/6549729413:24
<awoods>cbeer: indeed the multi-delete works. Thanks.13:30
<cbeer>awoods: cool. it's a clunky syntax, but i guess it's good for something.
<escowles>cbeer is right -- BigD reminded me that we did talk about that at code4lib -- i just didn't fully appreciate that "before LDCX" and "next week" were the same thing13:31
<pivotal-bot>Andrew Woods added comment: "This capability should work: ""
# Do insert
INSERT { <> dc:title "t0"; dc:title "t1"; dc:title "t2"}
WHERE { }..." https://www.pivotaltracker.com/story/show/68928558
Andrew Woods estimated "Support deleting of multi-valued properties on REST API" as 1 point https://www.pivotaltracker.com/story/show/68928558
Andrew Woods started "Support deleting of multi-valued properties on REST API" https://www.pivotaltracker.com/story/show/6892855813:32
<cbeer>escowles: scary, isn't it?
<pivotal-bot>Andrew Woods edited "Support deleting of multi-valued properties on REST API" https://www.pivotaltracker.com/story/show/68928558
Andrew Woods finished "Support deleting of multi-valued properties on REST API" https://www.pivotaltracker.com/story/show/68928558
Andrew Woods delivered "Support deleting of multi-valued properties on REST API" https://www.pivotaltracker.com/story/show/68928558
<escowles>cbeer: yep, i'm doing a lot more travel than usual lately, and beginning to lose track...
<awoods>escowles: Does that mean you are gone next week?13:33
scossu1: Can you verify this: https://www.pivotaltracker.com/story/show/68928558
<pivotal-bot>feature: Support deleting of multi-valued properties on REST API (delivered) / owner: Chris Beer
<escowles>awoods: i'm not exactly sure, let me talk to BigD about it -- i'm not sure what my role is going to be and how much of my time that'll take13:34
<awoods>escowles: Losing you next week would be a stinker.13:35
escowles: although, since you have been dominating the primary goals, we could probably work some sharing out.13:36
<escowles>awoods: speaking of primary goals -- i've got deleting versions mostly working, except deleting the current version fails -- should i just error out for that? i could revert to some other version, but it seems messy to figure out which one13:38
<awoods>escowles: So the user would need to create a new version, then delete the previous one in order to remove the "current version"?13:39
<escowles>yes, that was my thinking -- you can delete "old" versions but not the current one13:40
or explicitly revert to an old version and then delete the newer version
<pivotal-bot>Stefano Cossu added comment: "Verified. I will add a comment in the REST API documentation since it is not clear." https://www.pivotaltracker.com/story/show/68928558
<awoods>escowles: That is probably fine, especially if the error message was informative when attempting to delete the current.13:41
<escowles>ok, i'll work on that
<pivotal-bot>Andrew Woods added comment: "Perfect, @stefanoc. Thanks." https://www.pivotaltracker.com/story/show/6892855813:42
Andrew Woods accepted "Support deleting of multi-valued properties on REST API" https://www.pivotaltracker.com/story/show/68928558
* awoods leaves13:47
<pivotal-bot>Longshou Situ added comment: "Attached log file (jms-indexer.log) with the errors from fcrepo-jms-indexer-pluggable." https://www.pivotaltracker.com/story/show/6885335413:50
* awoods joins
<escowles>awoods: i expect that i'll have some time next week to work on sprint work, especially at the beginning of the week13:54
<awoods>escowles: will you be doing hydra/f4 integration the rest of the time?13:55
<escowles>and i should be able to come to standup to give progress reports, help longshou out if he has questions, etc.
yes, the rest of my time will go to that
<pivotal-bot>Longshou Situ started "Reduce "One-click-run" Logging" https://www.pivotaltracker.com/story/show/6349324614:03
Stefano Cossu added comment: "Added documentation in https://wiki.duraspace.org/display/FF/Properties+CRUD. Thanks. " https://www.pivotaltracker.com/story/show/6892855814:05
* scossu1 leaves14:17
* fcrepo-bot leaves14:22
* scossu joins15:13
<awoods>I'm out, team. Be safe.15:26
* awoods leaves15:28
* martinjd leaves15:44
* github-ff joins16:01
[fcrepo4] escowles created version-delete (+3 new commits): http://git.io/KpfcWA
fcrepo4/version-delete 92c415c Esmé Cowles: Adding method to remove a version
fcrepo4/version-delete 0283503 Esmé Cowles: Updating versionRemove to also remove labels and refuse to remove the current version, adding HTTP API
fcrepo4/version-delete 82f42bb Esmé Cowles: Adding HTML UI for deleting versions
* github-ff leaves
* github-ff joins16:02
[fcrepo4] escowles opened pull request #283: Version delete (master...version-delete) http://git.io/rL5N9g
* github-ff leaves
<pivotal-bot>Esme Cowles added comment: "https://github.com/futures/fcrepo4/pull/283" https://www.pivotaltracker.com/story/show/69177560
Esme Cowles finished "Enable Version Deletion" https://www.pivotaltracker.com/story/show/6917756016:03
Esme Cowles added comment: "This PR will return an error if you try to remove the current version: "Cannot remove current version". Sho..." https://www.pivotaltracker.com/story/show/6917756016:05
Esme Cowles added comment: "Now that #69192280 is finished, the ITs work for me and the Travis build passes: ""16:08
https://github.com/futures..." https://www.pivotaltracker.com/story/show/65168574
Esme Cowles finished "Enable index rebuild" https://www.pivotaltracker.com/story/show/65168574
Esme Cowles added comment: "@longshous I think this is working on our VMs. I created indexable objects on lib-devsandbox2 and lib-devsa..." https://www.pivotaltracker.com/story/show/6885335416:21
Longshou Situ added comment: "Esme: Are you using the REST API http://lib-devsandbox3.ucsd.edu:8080/rest to create the records?" https://www.pivotaltracker.com/story/show/6885335416:25
* scossu1 joins16:26
* scossu leaves
* travis-ci joins16:28
[travis-ci] futures/fcrepo4#1710 (version-delete - 82f42bb : Esmé Cowles): The build passed.
[travis-ci] Change view : https://github.com/futures/fcrepo4/compare/92c415c5f373^...82f42bb16216
[travis-ci] Build details : http://travis-ci.org/futures/fcrepo4/builds/22801263
* travis-ci leaves
<pivotal-bot>Esme Cowles added comment: "@longshous Yes, I'm using scripts on lib-devsandbox3 to create the records. As tomcat on lib-devsandbox3, d..." https://www.pivotaltracker.com/story/show/6885335416:36
Longshou Situ added comment: "Esme: I was using the web UI on http://lib-devsandbox3.ucsd.edu:8080/rest to add new records with an index..." https://www.pivotaltracker.com/story/show/6885335416:43
Esme Cowles added comment: "@longshous Yes, I just created an object in the HTML UI, and then updated the properties box to have: ""16:48
INSER..." https://www.pivotaltracker.com/story/show/68853354
* bibliotechy leaves17:02
* longshou leaves17:12
* gregjansen leaves17:31
<pivotal-bot>Longshou Situ added comment: "Esme: No. I haven't restated fuseki since I ingested those records. Maybe you can check the fuseki.log in ..." https://www.pivotaltracker.com/story/show/6885335417:45
* longshou joins17:57
* scossu1 leaves19:28
* longshou leaves20:58