Verify Requirements: [localhost] openshift_health_check (Not all of the required packages are available at their requested version: docker:1.12)

[dmage]

https://openshift-gce-devel.appspot.com/build/origin-ci-test/pr-logs/pull/16140/test_pull_request_origin_extended_conformance_install_update/5407/?log#log

/kind test-flake

[enj]

@stevekuznetsov @jupierce @sdodson seeing this a lot.

[stevekuznetsov]

Was blocking the queue. I have disabled the check in openshift-eng/aos-cd-jobs@9b40211 so we should see this stop affecting PRs.

[stevekuznetsov]

Was blocking the queue. I have disabled the check in openshift-eng/aos-cd-jobs@9b40211 so we should see this stop affecting PRs.

[sosiouxme]

@stevekuznetsov with openshift/openshift-ansible#5299 merged could you re-enable the check? Might want to unleash it on openshift-ansible first as we didn't really have a good way to test that this fixes CI other than running a CI job.

[stevekuznetsov]

@sosiouxme can you make the revert PR in aos-cd-jobs? There is a blurb in the README about how you would test changes to the inventory in a canary job.

[sosiouxme]

@stevekuznetsov are you referring to https://github.com/openshift/aos-cd-jobs/#custom-xml-generator-configuration-under-sjb ? Looks like it describes running test jobs there but not obvious to me how to use a different checks.yml in such a job.

[stevekuznetsov]

If changes are being made to the files under sjb/ in this repository, it is not enough to copy a job configuration and run it to test the changes. Instead, it will be necessary to mark the copied job as syncing a pull request for aos-cd-jobs using the type field on the repository as per the spec. Then, when running your copied job, configure it at run-time to merge in your pull request by entering in your pull request number in the appropriate parameter field in the Jenkins UI when starting the job.

[smarterclayton]

Probably unrelated, but similar symptom. Starting sept 7th seeing same failure but due to yum metadata

https://openshift-gce-devel.appspot.com/build/origin-ci-test/pr-logs/pull/16256/test_pull_request_origin_extended_conformance_install_update/5714/?log

Failure summary:

  1. Host:     localhost
     Play:     Verify Requirements
     Task:     openshift_health_check
     Message:  One or more checks failed
     Details:  check "docker_storage":
               Some dependencies are required in order to query docker storage on host:
               Unable to install required packages on this host:
                   python-docker-py
               Failure talking to yum: failure: repodata/98cd8fe00600d7fe9af1e7fdee23d6de6819634daa9e063f96afa1956d511103-primary.sqlite.bz2 from li: [Errno 256] No more mirrors to try.
               https://mirror.ops.rhcloud.com/libra/rhel-7-libra/x86_64/repodata/98cd8fe00600d7fe9af1e7fdee23d6de6819634daa9e063f96afa1956d511103-primary.sqlite.bz2: [Errno 14] HTTPS Error 404 - Not Found
               https://use-mirror2.ops.rhcloud.com/libra/rhel-7-libra/x86_64/repodata/98cd8fe00600d7fe9af1e7fdee23d6de6819634daa9e063f96afa1956d511103-primary.sqlite.bz2: [Errno 14] HTTPS Error 404 - Not Found
               https://use-mirror1.ops.rhcloud.com/libra/rhel-7-libra/x86_64/repodata/98cd8fe00600d7fe9af1e7fdee23d6de6819634daa9e063f96afa1956d511103-primary.sqlite.bz2: [Errno 14] HTTPS Error 404 - Not Found
               https://euw-mirror1.ops.rhcloud.com/libra/rhel-7-libra/x86_64/repodata/98cd8fe00600d7fe9af1e7fdee23d6de6819634daa9e063f96afa1956d511103-primary.sqlite.bz2: [Errno 14] HTTPS Error 404 - Not Found

Need to ping ops

[sosiouxme]

That one might benefit from retries openshift/openshift-ansible#5125

Or not, if the remote repo is actually broken at the time, or the problem is local yum metadata (I've considered running a yum clean all on first yum failure just in case).

That's unrelated though... this particular check started failing consistently due to our CI environment and I have yet to get it working the way I expect in that circumstance. Since the check has been disabled for now and isn't blocking queues, I would rather prioritize other bugs.

[sosiouxme]

Check reinstated with openshift-eng/aos-cd-jobs#614 - reopen if this pops up again.