Log of the #duraspace-ff channel on chat.freenode.net

Using timezone: Eastern Standard Time
* awead leaves03:45
* escowles leaves08:13
* dwilcox joins08:54
* mikeAtUVa joins09:04
* awead joins09:06
* ksclarke joins09:19
* osmandin joins09:22
* github-ff joins09:24
[fcrepo-camel] awoods pushed 2 new commits to master: http://git.io/zx8jlA
fcrepo-camel/master 18bf19b Aaron Coburn: osgi deployment requires that getters and setters use the same types
fcrepo-camel/master c1c43eb Andrew Woods: Merge pull request #21 from acoburn/osgi-deployment-support...
* github-ff leaves
* acoburn joins
* jgpawletko joins09:28
* travis-ci joins09:29
fcrepo4-labs/fcrepo-camel#41 (master - c1c43eb : Andrew Woods): The build passed.
Change view : https://github.com/fcrepo4-labs/fcrepo-camel/compare/2680b086828f...c1c43eb65a8d
Build details : http://travis-ci.org/fcrepo4-labs/fcrepo-camel/builds/43099220
* travis-ci leaves
<awoods>ksclarke: ping09:59
<ksclarke>awoods good morning
<awoods>hello, ksclarke.
ksclarke: I am trying to run your grinder project10:00
what's the issue?
<awoods>ksclarke: it seems like the issues I am seeing are related to strip-json-comments
<awoods>ksclarke: I do not have it installed
ksclarke: which is fine
ksclarke: It would appear to be optional10:01
<ksclarke>right you shouldn't have to to run the build script
<awoods>ksclarke: but the logic at line:102 in build.sh does not seem correct
* ksclarke looks
<awoods>ksclarke: so I removed lines:102 and 103
ksclarke: and changed line:104 from elif to if10:02
ksclarke: so now I get the error: Failed to parse template: Error in line 1, char -1: unexpected end of JSON input
ksclarke: I wonder if you can effectively uninstall strip-json-comments and see if you run into kinks10:05
<ksclarke>yes, looking into that now, thanks10:06
awoods: okay, changing the check to "if [ ! -f $STRIP_JSON_SCRIPT ]; then" fixes the problem. I'm going to cycle through one more build then push the change up; will let you know when it's ready10:16
<awoods>ksclarke: great. I look forward to it.10:17
* ksclarke goes to look at the graphite build too
awoods: should work now for you, I think10:39
<awoods>ksclarke: thanks, I will give it a spin in a moment10:41
* acoburn leaves10:43
* acoburn joins10:44
<f4jenkins>Project fcrepo4-T2 build #74: UNSTABLE in 5 min 39 sec: http://jenkins.fcrepo.org/job/fcrepo4-T2/74/10:54
awoods: Upgrade ModeShape to version 4.1.0.Final
* longshou joins10:55
<awoods>dwilcox: coming?11:01
<dwilcox>awoods: Meeting running long - I'll join when I can
* acoburn leaves11:34
* acoburn joins
<awoods>longshou: see: https://github.com/lsitu/fcrepo4-oaiprovider/pull/111:44
longshou: after you build the oaiprovider project, then look at: target/classes/spring/oai.xml
<longshou>Sure, thanks.11:45
* awead leaves11:54
* scossu joins12:04
==> amazon-ebs: Inspecting the source AMI...
==> amazon-ebs: Creating temporary keypair: packer 5481e8e4-7dcc-1a8c-d91d-ba9596b1eb6c
==> amazon-ebs: Launching a source AWS instance...
amazon-ebs: Instance ID: i-c2824b2b
==> amazon-ebs: Waiting for instance (i-c2824b2b) to become ready...
==> amazon-ebs: Waiting for SSH to become available...
==> amazon-ebs: Timeout waiting for SSH.
==> amazon-ebs: Terminating the source AWS instance...
<ksclarke>that looks like from the build?
<awoods>ksclarke: ??
<ksclarke>from running the build.sh12:25
<awoods>ksclarke: yes, that is the terminal output when running build.sh
<ksclarke>did you run a second time and get the same thing?
<awoods>ksclarke: no. Is twice a charm?
<ksclarke>that's a part of the packer process (not my code)
sometimes if it's an amazon issue, packer will give up
<awoods>ksclarke: running again12:26
<ksclarke>if it's an amazon issue it's unlikely to happen again (usually)
there are some "waiting for ssh" tickets in the packer issue queue (and I did bump into one of them), but I'd check the second run first12:28
if it's repeatable it's probably not an amazon issue
and I'll ask that you give me the log and I'll investigate on the packer site
* awead joins12:29
<awoods>ksclarke: twice is apparently a charm. It has moved past the SSH phase12:30
<ksclarke>okay, sounds like an amazon weirdness then... sometimes they're a bit slow to respond to stuff and I guess the decision (for packer or whomever) is to wait or give up and let a second run fix it :-)
* ksclarke makes a note to investigate whether the time packer waits for the ssh is configurable12:32
* osmandin leaves12:40
* acoburn leaves12:49
<awoods>ksclarke: aws/grinder status is still scrolling by in the ./build.sh terminal.12:55
ksclarke: that is a busy little script.
<ksclarke>yes... the packer builds aren't small, and it runs two :-)13:01
<awoods>ksclarke:... still running
<ksclarke>Hmm, I see I get the fcrepo4-labs projects with travis builds in my travis view now; anyone know if I turn the build off in travis whether that's just for me (which I'd assume) or does it impact fcrepo4-labs in some way?13:10
* awead leaves13:14
* awead joins13:16
<awoods>ksclarke: what is the link that you are seeing in travis-ci?13:18
ksclarke: I enable travis integration with some of the fcrepo4-labs projects.13:19
<ksclarke>it is for the org apparently(?) https://travis-ci.org/fcrepo4-labs/fcrepo4-client/settings or https://travis-ci.org/profile/fcrepo4-labs13:20
interesting, I don't see as many for https://travis-ci.org/profile/Islandora13:21
I'm pretty sure there are a bunch in islandora with travis tests
<awoods>ksclarke: I suspect if you disable any of the projects that are currently "ON" in https://travis-ci.org/profile/fcrepo4-labs, they will be OFF for more than just your personal view. But you can test one if you want.13:22
<ksclarke>hmm, okay tested for fcrepo4-labs/fcrepo4-client ... do you see that as off or on now?13:23
<awoods>ksclarke: yes, fcrepo4-client is now off for me (and presumably for the world)
<ksclarke>bummer, okay, turning it back on
<awoods>ksclarke: now refresh https://travis-ci.org/profile/fcrepo4-labs13:25
ksclarke: any difference?
* ksclarke waits for github sync
Interesting, yes, now I don't see them... what did you do?13:26
<awoods>ksclarke: I reduced your rights on the fcrepo4-labs github organization.13:27
<ksclarke>oh, okay, I don't see fcrepo4-labs any more in my list of accounts either
awoods: from what to what?
(so I can request the same of other orgs)
<awoods>ksclarke: from "owner" to "nobody"
<ksclarke>heh, not sure I want to be a nobody though13:28
ksclarke: which of the fcrepo4-labs projects would you like rights on?
there are quite a few I'm interested in (I started compiling a list), but maybe I don't need ownership on any but fcrepo4-packer-aws-grinder at the moment?13:32
given the workflow for any contributions are PRs13:33
<awoods>ksclarke: ok, just let me know if you need more than fcrepo4-packer-aws-grinder
thanks, awoods
ksclarke: you have been invited13:34
* awead leaves13:43
* osmandin joins13:46
* awead joins13:47
* awead leaves13:51
* awead joins13:53
* awead leaves13:57
* acoburn joins14:01
* scossu leaves14:22
* nbanks joins14:23
* awead joins14:33
* scossu joins14:52
* awead leaves15:09
* awead joins15:12
* longshou leaves15:21
* fcrepo-bot joins15:23
* osmandin leaves15:33
* nbanks leaves16:01
* dwilcox leaves16:03
* dwilcox joins16:06
* dwilcox leaves
* fcrepo-bot leaves16:31
* longshou joins16:38
* acoburn leaves16:53
* mikeAtUVa leaves16:59
* github-ff joins17:32
[fcrepo4-oaiprovider] awoods pushed 1 new commit to master: http://git.io/HXOtGA
fcrepo4-oaiprovider/master dc171c0 lsitu: Add support to allow admins to manage descriptive content about the...
* github-ff leaves
* github-ff joins17:33
[fcrepo4-oaiprovider] awoods closed pull request #10: Added support to allow admins to manage descriptive content about the repository and make the content available. (master...feature/descriptive-content) http://git.io/3qT6ZA
* github-ff leaves
<awoods>ksclarke: ping17:35
<ksclarke>hello awoods
<awoods>ksclarke: so...
ksclarke: build.sh succeeded...
ksclarke: Then I run "start.sh 3"17:36
ksclarke: And I get:
list index out of range
list index out of range
list index out of range
ERROR: Did not find the expected console instance:
<awoods>ksclarke: There is an empty file named: ec2-console.instance17:37
<ksclarke>an no ec2-agent-#.instance files I assume (since that's the list out of range)17:38
<awoods>ksclarke: no
<ksclarke>and the aws cli is on your path?
* ksclarke realizes he probably doesn't check for that
<awoods>ksclarke: yes17:39
<ksclarke>awoods: what's your os and version?17:40
<awoods>Description: Ubuntu 14.04.1 LTS17:41
Release: 14.04
Codename: trusty
<ksclarke>do you have content in the ec2-console.ami file?17:42
<awoods>ksclarke: yes
ksclarke: an ami id
ksclarke: It seems like "build.sh" takes a very long time, and it produces some AMIs. I would expect that there would be some publicly available AMIs (possibly provided by Fedora) that people could use.17:43
<ksclarke>and `tee --version` gives you output?
<awoods>tee (GNU coreutils) 8.21
Copyright (C) 2013 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>.
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Written by Mike Parker, Richard M. Stallman, and David MacKenzie.
ksclarke: I would expect that the process would be: "Given these AMIs, start up the AWS environment for test Fedora with Grinder"17:44
<ksclarke>awoods: the only problem with providing agent AMIs is how it looks up its console (which is dependent on the instance of the console"
and the instance is tied to an account
of course
<awoods>ksclarke: I am not sure I understand the expected flow.
<ksclarke>there may be another way around that I just haven't discovered yet, but to the problem at hand first17:45
<awoods>ksclarke: taking an hour to build AMIs when I want to run Grinder seems crazy and unnecessary.
<ksclarke>but you can keep your amis around; and my time is much less than an hour (though I haven't timed it)
so you don't have to build.sh every time you want to use them
and there may be another way, but problem at hand first17:46
<awoods>ksclarke: ok, I have AMIs. Now what?
<ksclarke>what do you get from: aws ec2 run-instances --image-id $(cat ec2-console.ami) --security-group-ids "${AWS_SECURITY_GROUP_ID}" --key-name "${AWS_KEYPAIR_NAME}" --instance-type "${AWS_INSTANCE_TYPE}" --placement "AvailabilityZone=${AWS_REGION}a" | grep INSTANCES
inserting your values in there
<awoods>ksclarke: Unable to locate credentials. You can configure credentials by running "aws configure".17:51
ksclarke: after running "aws configure"............ HTTPSConnectionPool(host='ec2.us-east-1a.amazonaws.com', port=443): Max retries exceeded with url: / (Caused by <class 'socket.gaierror'>: [Errno -2] Name or service not known)
<ksclarke>yes, if you don't want to pass them in through the command line you need to supply them in ~/.aws/config17:52
that's what you get from `run-instances` ?
that https connection pool error?
<awoods>ksclarke: yes
awoods@red:~/programming/java/apps/fedora/futures/fcrepo4-packer-aws-grinder$ aws ec2 run-instances --image-id $(cat ec2-console.ami) --security-group-ids ff-aw --key-name awoods-ff-keypair --instance-type m3.medium --placement "AvailabilityZone=us-east-1a" | grep INSTANCES17:53
HTTPSConnectionPool(host='ec2.us-east-1a.amazonaws.com', port=443): Max retries exceeded with url: / (Caused by <class 'socket.gaierror'>: [Errno -2] Name or service not known)
<ksclarke>okay, that's new to me... investigating
awoods, and what do you get from: aws --version17:54
<awoods>aws-cli/1.6.6 Python/2.7.6 Linux/3.13.0-40-generic17:55
* jgpawletko_away leaves17:58
<ksclarke>awoods and you have the us-east-1 region available to you right?18:02
<awoods>ksclarke: I have us-east-1[a-e], yes18:03
<ksclarke>awoods and your vars/vars.json has: "aws_region": "us-east-1",18:06
<awoods>"aws_region": "us-east-1",
ksclarke: It seems like this should be simple: I have some AMIs, let's spin up the environment.18:07
<ksclarke>I'm seeing a lot of google hits with this error, seeming to suggest that "ec2.us-east-1a.amazonaws.com" should be "ec2.us-east-1.amazonaws.com"
<awoods>awoods@red:~/programming/java/apps/fedora/futures/fcrepo4-packer-aws-grinder$ aws ec2 run-instances --image-id $(cat ec2-console.ami) --security-group-ids ff-aw --key-name awoods-ff-keypair --instance-type m3.medium --placement "AvailabilityZone=us-east-1" | grep INSTANCES18:08
HTTPSConnectionPool(host='ec2.us-east-1a.amazonaws.com', port=443): Max retries exceeded with url: / (Caused by <class 'socket.gaierror'>: [Errno -2] Name or service not known)
ksclarke: I dropped the "a"
<ksclarke>in AvailabilityZone or elsewhere?
<awoods>in AvailabilityZon18:09
<ksclarke>meaning you didn't have it or you're trying it now without it?
<awoods>see command above
you need it there but not in the vars/vars.json18:10
so what output do you get running with it (from the command line)?18:11
<awoods>ksclarke: ok, but I am not using the "vars/vars.json" in the above command.
<ksclarke>right, I was just providing big picture
<awoods>ksclarke: which command are you suggesting I run?
<ksclarke>the "a" is added as a part of the script
aws ec2 run-instances --image-id $(cat ec2-console.ami) --security-group-ids "${AWS_SECURITY_GROUP_ID}" --key-name "${AWS_KEYPAIR_NAME}" --instance-type "${AWS_INSTANCE_TYPE}" --placement "AvailabilityZone=${AWS_REGION}a" | grep INSTANCES
with your info
<awoods>awoods@red:~/programming/java/apps/fedora/futures/fcrepo4-packer-aws-grinder$ aws ec2 run-instances --image-id $(cat ec2-console.ami) --security-group-ids ff-aw --key-name awoods-ff-keypair --instance-type m3.medium --placement "AvailabilityZone=us-east-1a" | grep INSTANCES
HTTPSConnectionPool(host='ec2.us-east-1a.amazonaws.com', port=443): Max retries exceeded with url: / (Caused by <class 'socket.gaierror'>: [Errno -2] Name or service not known)
ff-aw isn't a security group id, it's the name
<awoods>ksclarke: it would be interesting to see if anyone else can get it to run.
<ksclarke>the security group id should start with "sg-"
* jgpawletko joins18:15
<awoods>ksclarke: That is probably an issue... but same error:
awoods@red:~/programming/java/apps/fedora/futures/fcrepo4-packer-aws-grinder$ aws ec2 run-instances --image-id $(cat ec2-console.ami) --security-group-ids sg-8319cee8 --key-name awoods-ff-keypair --instance-type m3.medium --placement "AvailabilityZone=us-east-1a" | grep INSTANCES
HTTPSConnectionPool(host='ec2.us-east-1a.amazonaws.com', port=443): Max retries exceeded with url: / (Caused by <class 'socket.gaierror'>: [Errno -2] Name or service not known)
<ksclarke>awoods: for context too, running build.sh takes 20 mins for me
and you do have the AMIs created in your account?18:16
<awoods>ksclarke: I can run it again: "time build.sh"
ksclarke: yes, I have the AMIs
longshou: ping18:17
<awoods>longshou: are you in a position to try to walk through these instructions: https://github.com/fcrepo4-labs/fcrepo4-packer-aws-grinder
<longshou>Not yet.
<ksclarke>my output: kevin@ksclarke-laptop:~/Workspaces/PersonalWorkspace/packer-aws-grinder$ aws ec2 run-instances --image-id $(cat ec2-console.ami) --security-group-ids sg-3d48f958 --key-name ksclarke-ucla --instance-type m3.medium --placement "AvailabilityZone=us-east-1a" | grep INSTANCES
INSTANCES 0 x86_64 None False xen ami-52a9333a i-177efafb m3.medium aki-919dcaf8 ksclarke-ucla 2014-12-05T23:17:45.000Z ip-172-31-4-18.ec2.internal /dev/sda1 ebs True None subnet-4391a605 paravirtual vpc-efce338a
it's not clear to me why it's not seeing the aws service for you18:19
still googling...
we do have a different version of aws cli18:20
and I'm using whatever the u* ubuntu version is instead of trusty
* ksclarke is just thinking out loud
I'm wondering if it's a difference in the aws cli versions...18:21
I take it awoods you didn't install the aws cli through pip?18:23
<awoods>ksclarke: yes, I used pip
<ksclarke>oh I see I have an update there that I just haven't installed
* ksclarke tries updating
hmm, nope still started the console for me18:28
though I didn't do a build again, just ./start.sh
<awoods>ksclarke: I am doing some googling
ksclarke: I get the same error with another commandline AWS tool:18:31
ec2-run-instances $(cat ec2-console.ami) --group sg-8319cee8 --key awoods-ff-keypair --instance-type m3.medium --region us-east-1a | grep INSTANCES
do you have another ami to try in place of that one?
(can be something else)
<awoods>ksclarke: same error18:33
<ksclarke>with a different non-packer ami?
<awoods>ksclarke: yes, same error with other non-packer AMIs
I'm going to have to go make my kids dinner; I'll be back on later after 8pm est if you're still around18:34
<ksclarke>don't feel obligated to continue on now, but if you figure it out, awoods, email me
<awoods>will do
<ksclarke>(so I don't continue to investigate)
okay, see you later
* ksclarke leaves18:36
* scossu leaves19:02
* github-ff joins20:02
[fcrepo4] lsitu opened pull request #673: Reject fedora resource property update that contains fcr namespace prefix. (master...feature/namespace-fcr) http://git.io/AQrFWA
* github-ff leaves
* ksclarke joins20:10
* github-ff joins21:44
[fcrepo4] lsitu opened pull request #674: Added fixity IT for the previous version of binary content. (master...feature/fixity-it) http://git.io/tXIN-g
* github-ff leaves
* awead leaves21:48
* jgpawletko leaves22:32
* longshou leaves22:36

Generated by Sualtam