Re: Assistance testing Harbor for OCI conformance
toggle quoted messageShow quoted text
For the live testing, I have opened a PR at
https://github.com/goharbor/harbor/pull/11801. We’d like to enable the live testing as Harbor repo so that we can know which PR introduces new failures and fix it on time.
@Alex Xu your idea?
From: <harbor-dev@...> on behalf of "Josh Dolitsky via lists.cncf.io" <jdolitsky=gmail.com@...>
Reply-To: "harbor-dev@..." <harbor-dev@...>
Date: Wednesday, 29 April 2020 at 11:02 PM
To: "harbor-dev@..." <harbor-dev@...>
Subject: Re: [harbor-dev] Assistance testing Harbor for OCI conformance
Yan, thanks for helping with this. Do you know if it is possible to start a fresh new Harbor instance in GitHub actions? GitHub actions allows for a "services" section which you can launch containers for the test run. This is what we really
need help from Harbor team on. Here is a example action using a redis: https://github.com/actions/example-services/blob/master/.github/workflows/redis-service.yml#L18
Since Harbor is an opensource registry, it would be preferred to do it this way vs. testing a live version (i.e.
demo.goharbor.io). This is definitely a great start regardless.
On Wed, Apr 29, 2020 at 4:41 AM Yan Wang <wangyan@...
Thanks for your detailed info.
I have filed an PR to add Harbor conformance test, could you please help to review?
BTW, can you help to add two more secrets(Harbor_USERNAME and Harbor_PASSWORD) to store the testing account auth?
Thanks for the heads up. The conformance test has been on our radar and we did some manual dry run locally.
Adding Harbor to the report is on the todo list, and we’ll have that incorporated within this or next week.
Engineer, VMware R&D, Beijing
Hello Harbor team,
We're seeking help setting up test automation using GitHub actions to test Harbor for OCI conformance. See full issue
For background: the
OCI Distribution Specification is an open spec based on Docker's Registry API, and is the current workspace for defining standards concerning container registries such as Harbor. There is a recent effort to enable registry providers to validate if a registry
properly conforms to the specification.
We need your expertise in setting up Harbor for tests purposes within the context of GitHub actions, as well as configuration setup for running the
OCI conformance test suite.
You can view a live view of preliminary test results at https://oci.bloodorange.io.
Click one of the "test report" links to open up a detailed conformance report.
If you're interested in the larger discussion, I encourage you to join the the OCI
Feel free to email me or ping me on Slack if you have any questions etc.
- Josh Dolitsky (@jdolitsky)
Join firstname.lastname@example.org to automatically receive all group messages.