Date   

Harbor community conf call

Yan Wang <wan...@...>
 

Hello everyone,


 Welcome to join Harbor community conf call! In this meeting, we have a very important topic: introduce, discuss and collect feedback on the Harbor governance model, which defines the primary principles and flows to operate and promote the Harbor community. As a member of the Harbor community, your comments and suggestions are very important to the whole community. We hope you can reserve time to attend this significant meeting. Looking forward to seeing you at the meeting!


Agenda:

                    Harbor related(15 mins)

                    Introduction & Demo: Tencent Cloud Native Platform (TCNPlatform) (30 mins)

                    Any other topics from community (15 mins)


Meeting time: 2018/11/28 05:00-06:00 AM(PDT)/21:00-22:00 (Beijing time)

Meeting link: https://zoom.us/j/734959521



FW: harbor moves to cncf incubator

Steven Zou <sz...@...>
 

FYI!

 

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: James Zabala <jz...@...>
Date: Wednesday, November 14, 2018 at 09:58
To: cnabu-adl <cna...@...>, Dirk Hohndel <d...@...>
Cc: Alan Ren <...@...>, Haining Henry Zhang <haini...@...>
Subject: harbor moves to cncf incubator

 

All,

 

The Harbor team just stood on stage during the opening keynote at CloudNativeCon / KubeCon Shanghai as part of an announcement that Harbor is moving from Sandbox to the CNCF Incubator! It is an incredible honor for the project to join other widely adopted and well-respected incubated projects.

 

Congratulations to the Harbor team for building such an incredible open source project and community.

 

 

James

 

________________________________________

From: <cncf...@...> on behalf of Chris Aniszczyk <canis...@...>

Date: Tuesday, November 13, 2018 at 5:14 PM

To: CNCF TOC <cncf...@...>

Subject: [cncf-toc] [RESULT] Harbor moving to incubation (PASSED)

 

The vote for Harbor moving to the incubation maturity level has been approved.

 

Thanks all for voting and your project feedback!

 

--

Chris Aniszczyk (@cra) | +1-512-961-6719


[harbor-dev] CNCF project Harbor community meeting

Yan Wang <wan...@...>
 

Hello everyone,


  As planned, in this community meeting, we’ll give the whole community an early preview of the following new features which are planned in release 1.7:

·         HA by Harbor Helm Chart


  Your feedbacks are very important to continuously refine the features. We hope you can reserve time to attend this meeting. Looking forward to seeing you at the meeting!


--
You received this message because you are subscribed to the Google Groups "harbor-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-dev+unsu...@....
To post to this group, send email to harbo...@....
Visit this group at https://groups.google.com/group/harbor-dev.
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-dev/DM6PR05MB45855D7270723E4A2A081F6CBCF50%40DM6PR05MB4585.namprd05.prod.outlook.com.
For more options, visit https://groups.google.com/d/optout.



CNCF project Harbor community meeting

Steven Zou <sz...@...>
 

Hello everyone,


  As planned, in this community meeting, we’ll give the whole community an early preview of the following new features which are planned in release 1.7:

  • Online GC
  • Chart repository enhancements (label supporting etc.)


  Your feedbacks are very important to continuously refine the features. We hope you can reserve time to attend this meeting. Looking forward to seeing you at the meeting!



Community meeting of 10/10 minutes are updated

Steven Zou <sz...@...>
 

Hi all,

 

  The meeting minutes of 10/10 community meeting is ready, please check https://github.com/goharbor/community/blob/master/MEETING_SCHEDULE.md. Meanwhile, the meeting schedule is also updated, we’ll demo Online GC feature in next meeting.

 

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 


Re: About restful APIs for job services

Steven Zou <sz...@...>
 

@Herman Zhu

 

  Now the job service document is available at https://github.com/goharbor/harbor/tree/master/src/jobservice please check. Thanks!

 

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <harb...@...> on behalf of Herman Zhu <zhuh...@...>
Date: Tuesday, October 2, 2018 at 13:10
To: harbor-users <harb...@...>
Subject: About restful APIs for job services

 

Hi Steven,

 

#3945
Is there a doc for that restful APIs?

 

I want to post some job to job services server,

so, I need to know post what kind of data.

 

I want to replication single tag to dst_registry_url.

 

BRs

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users+unsu...@....
To post to this group, send email to harbor...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/4a649005-24c5-44b3-a0f6-74b6cd648908%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: harbor performance testing result & tool

Steven Zou <sz...@...>
 

What’s perf testing env?  Is it possible limited by the io/network resource limitations?

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <harb...@...> on behalf of Zhenhua Dong <dong...@...>
Date: Wednesday, October 10, 2018 at 20:55
To: "har...@..." <harb...@...>
Subject: Re: harbor performance testing result & tool

 

our team has done some bench mark. however, we found the several threads run in parallel has no benefit during docker push scenario. Is it normal? Do you know what factor blocks the performance 

 

BRs/Zhenhua

 

On Fri, Sep 28, 2018 at 2:10 PM Zhenhua Dong <dongz...@...> wrote:

Hi Steven

 

I am glad to contribute something on the topic, however, I am not sure whether i can find enough time on the topic.  I have  a team work on harbor, I will try to combine it with team tasks. 

 

Whatever, please involve me if there are some discussion on the topic. 

 

BRs/Zhenhua

On Thursday, September 27, 2018 at 11:39:18 AM UTC+8, Steven Zou wrote:

Thanks for providing the benchmark reference. About the perf test for Harbor, we have started to consider that. But to be honest, it cannot be ready in short time due to resource limitations. As we’re an open community and welcoming contributions from the community. If you’re interested, could you please do something on this topic? We can discuss related thing in the community meeting or via social channels like slack if needed.

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <har...@...> on behalf of Zhenhua Dong <do...@...>
Date: Thursday, September 27, 2018 at 08:28
To: harbor-users <har...@...>
Subject: Re: harbor performance testing result & tool

 

Hi Steven

 

Thanks for the update.  

 

I find one simple script to benchmark "docker pull/push/delete". 

 

It would be better if we have some dimension guide which based on performance test result.  

 

BRs/Zhenhua



On Wednesday, September 26, 2018 at 12:06:20 PM UTC+8, Zhenhua Dong wrote:

Hi 

 

Do you know where i can find the performance testing result of harbor and relation testing tool?

 

BRs/Zhenhua

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-...@....
To post to this group, send email to harb...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/0e85ca2a-b24c-406a-950f-11e1c9c17176%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users+unsu...@....
To post to this group, send email to harbor...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/a84b331e-0926-4357-811e-41b86e821908%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users+unsu...@....
To post to this group, send email to harbor...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/CAAXViEWEmOORLmd3Kq8NF-jDBuE-xXuWUaPVe%2BQd-UAKULvLDw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


Re: harbor performance testing result & tool

Zhenhua Dong <dongz...@...>
 

our team has done some bench mark. however, we found the several threads run in parallel has no benefit during docker push scenario. Is it normal? Do you know what factor blocks the performance 

BRs/Zhenhua

On Fri, Sep 28, 2018 at 2:10 PM Zhenhua Dong <dongz...@...> wrote:
Hi Steven

I am glad to contribute something on the topic, however, I am not sure whether i can find enough time on the topic.  I have  a team work on harbor, I will try to combine it with team tasks. 

Whatever, please involve me if there are some discussion on the topic. 

BRs/Zhenhua

On Thursday, September 27, 2018 at 11:39:18 AM UTC+8, Steven Zou wrote:

Thanks for providing the benchmark reference. About the perf test for Harbor, we have started to consider that. But to be honest, it cannot be ready in short time due to resource limitations. As we’re an open community and welcoming contributions from the community. If you’re interested, could you please do something on this topic? We can discuss related thing in the community meeting or via social channels like slack if needed.

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <harb...@...> on behalf of Zhenhua Dong <dong...@...>
Date: Thursday, September 27, 2018 at 08:28
To: harbor-users <harb...@...>
Subject: Re: harbor performance testing result & tool

 

Hi Steven

 

Thanks for the update.  

 

I find one simple script to benchmark "docker pull/push/delete". 

 

It would be better if we have some dimension guide which based on performance test result.  

 

BRs/Zhenhua



On Wednesday, September 26, 2018 at 12:06:20 PM UTC+8, Zhenhua Dong wrote:

Hi 

 

Do you know where i can find the performance testing result of harbor and relation testing tool?

 

BRs/Zhenhua

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-...@....
To post to this group, send email to harb...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/0e85ca2a-b24c-406a-950f-11e1c9c17176%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users...@....
To post to this group, send email to harbor...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/a84b331e-0926-4357-811e-41b86e821908%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: Not able to add LDAP Groups

DaoJun Zhang <dao...@...>
 

The LDAP group is different with email group, you can not use email group here.

First you need to confirm that the requirement is meet:

https://github.com/goharbor/harbor/blob/master/docs/manage_role_by_ldap_group.md#prerequisite

 

Then you need to create a LDAP group contains specified users.

 

From: <harb...@...> on behalf of Chethan S <chetha...@...>
Date: Wednesday, October 10, 2018 at 1:25 PM
To: harbor-users <harb...@...>
Subject: Not able to add LDAP Groups

 

I was hoping to use the newly introduced LDAP groups functionality to quickly add users to Harbor but not having much luck with that. 

 

My Objective

In Harbor's Administration > Groups, I should be able to specify an email group like team...@... or just the teamname. Currently, this approach results in an error -  LDAP Group DN is not found: DN: teamname

 

My Configuration

  1. LDAP Group Base DN: DC=domainname,DC=com
  2. LDAP Group filter: objectclass=groupOfNames
  3. LDAP Group GID: uid (also tried cn)
  4. LDAP Group Scope: Subtree
  5. LDAP Group Admin DN: blank

Our IT department was not able to help in this regard as they felt Harbor has intricate requirements. Did anyone here get things to work?

 

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users+unsu...@....
To post to this group, send email to harbor...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/38b42502-177f-43c8-9bf3-cfed6db1ec18%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Not able to add LDAP Groups

Chethan S <chethanu...@...>
 

I was hoping to use the newly introduced LDAP groups functionality to quickly add users to Harbor but not having much luck with that. 

My Objective
In Harbor's Administration > Groups, I should be able to specify an email group like team...@... or just the teamname. Currently, this approach results in an error -  LDAP Group DN is not found: DN: teamname

My Configuration
  1. LDAP Group Base DN: DC=domainname,DC=com
  2. LDAP Group filter: objectclass=groupOfNames
  3. LDAP Group GID: uid (also tried cn)
  4. LDAP Group Scope: Subtree
  5. LDAP Group Admin DN: blank
Our IT department was not able to help in this regard as they felt Harbor has intricate requirements. Did anyone here get things to work?


CNCF Project Harbor community call: Governance model discussion

Steven Zou <sz...@...>
 

Hello everyone,


  Welcome to join Harbor community conf call! In this meeting, we have a very important topic: introduce, discuss and collect feedback on the Harbor governance model, which defines the primary principles and flows to operate and promote the Harbor community. As a member of the Harbor community, your comments and suggestions are very important to the whole community. We hope you can reserve time to attend this significant meeting. Looking forward to seeing you at the meeting!


Meeting link: https://zoom.us/j/734959521


Agenda:


  • Opening and latest updates of Harbor project (5 mins)
  • Harbor related activities in KubeCon by Henry Zhang (5 mins)
  • Governance model discussion by James (50 mins)





Re: About restful APIs for job services

Steven Zou <sz...@...>
 

@Herman Zhu

 

  We’re planning to do enhancements to the job service. If you’re interested in this part,  we’re welcoming u to join to do contributions.

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <harb...@...> on behalf of Herman Zhu <zhuh...@...>
Date: Tuesday, October 2, 2018 at 13:23
To: harbor-users <harb...@...>
Subject: Re: About restful APIs for job services

 

Post the json data to job server 

{"job":{"name":"IMAGE_TRANSFER","parameters":{"dst_registry_insecure":false,"dst_registry_password":"SGFyYm9yMTIzNDUK","dst_registry_url":"http://192.168.191.157","dst_registry_username":"admin","repository":"library/rust","src_registry_insecure":true,"src_registry_url":"http://192.168.191.156","tags":"aa5551d785"},"metadata":{"kind":"Generic","unique":false},"status_hook":"test"}}


job server response the data

 

{"job":{"id":"3613fa8b32655b179a1f2f7d","status":"Pending","name":"IMAGE_TRANSFER","kind":"Generic","unique":false,"ref_link":"/api/v1/jobs/3613fa8b32655b179a1f2f7d","enqueue_time":1538408243,"update_time":1538408243,"hook_status":"activated"}}

 

job server log is 

 

Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [INFO] Job incoming: IMAGE_TRANSFER:3613fa8b32655b179a1f2f7d

Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [ERROR] [service_logger.go:63]: Job 'IMAGE_TRANSFER:3613fa8b32655b179a1f2f7d' exit with error: Runtime error: interface conversion: interface {} is string, not []interface {}

Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""

Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""

Oct  1 23:37:27 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:27Z [WARNING] Failed to process 'mark_die_at' request with error: seems 3613fa8b32655b179a1f2f7d is not a dead job

Oct  1 23:37:29 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:29Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""

Oct  1 23:37:29 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:29Z [WARNING] Failed to process 'mark_die_at' request with error: seems 3613fa8b32655b179a1f2f7d is not a dead job

Oct  1 23:37:30 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:30Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""

Oct  1 23:37:39 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:39Z [ERROR] [service_logger.go:63]: Failed to process 'report_status' request with error: Post test: unsupported protocol scheme "" (3 times tried)

Oct  1 23:37:42 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:42Z [ERROR] [service_logger.go:63]: Failed to process 'report_status' request with error: Post test: unsupported protocol scheme "" (3 times tried)

Oct  1 23:37:42 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:42Z [ERROR] [service_logger.go:63]: Failed to process 'mark_die_at' request with error: seems 3613fa8b32655b179a1f2f7d is not a dead job (3 times tried)

 

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users+unsu...@....
To post to this group, send email to harbor...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/d97390cc-eb4f-4bec-8f92-c058813b644b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: About restful APIs for job services

Steven Zou <sz...@...>
 

Then you can check status of job with ‘/api/v1/jobs/3613fa8b32655b179a1f2f7d

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <harb...@...> on behalf of Herman Zhu <zhuh...@...>
Date: Tuesday, October 2, 2018 at 13:23
To: harbor-users <harb...@...>
Subject: Re: About restful APIs for job services

 

Post the json data to job server 

{"job":{"name":"IMAGE_TRANSFER","parameters":{"dst_registry_insecure":false,"dst_registry_password":"SGFyYm9yMTIzNDUK","dst_registry_url":"http://192.168.191.157","dst_registry_username":"admin","repository":"library/rust","src_registry_insecure":true,"src_registry_url":"http://192.168.191.156","tags":"aa5551d785"},"metadata":{"kind":"Generic","unique":false},"status_hook":"test"}}


job server response the data

 

{"job":{"id":"3613fa8b32655b179a1f2f7d","status":"Pending","name":"IMAGE_TRANSFER","kind":"Generic","unique":false,"ref_link":"/api/v1/jobs/3613fa8b32655b179a1f2f7d","enqueue_time":1538408243,"update_time":1538408243,"hook_status":"activated"}}

 

job server log is 

 

Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [INFO] Job incoming: IMAGE_TRANSFER:3613fa8b32655b179a1f2f7d

Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [ERROR] [service_logger.go:63]: Job 'IMAGE_TRANSFER:3613fa8b32655b179a1f2f7d' exit with error: Runtime error: interface conversion: interface {} is string, not []interface {}

Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""

Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""

Oct  1 23:37:27 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:27Z [WARNING] Failed to process 'mark_die_at' request with error: seems 3613fa8b32655b179a1f2f7d is not a dead job

Oct  1 23:37:29 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:29Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""

Oct  1 23:37:29 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:29Z [WARNING] Failed to process 'mark_die_at' request with error: seems 3613fa8b32655b179a1f2f7d is not a dead job

Oct  1 23:37:30 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:30Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""

Oct  1 23:37:39 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:39Z [ERROR] [service_logger.go:63]: Failed to process 'report_status' request with error: Post test: unsupported protocol scheme "" (3 times tried)

Oct  1 23:37:42 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:42Z [ERROR] [service_logger.go:63]: Failed to process 'report_status' request with error: Post test: unsupported protocol scheme "" (3 times tried)

Oct  1 23:37:42 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:42Z [ERROR] [service_logger.go:63]: Failed to process 'mark_die_at' request with error: seems 3613fa8b32655b179a1f2f7d is not a dead job (3 times tried)

 

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users+unsu...@....
To post to this group, send email to harbor...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/d97390cc-eb4f-4bec-8f92-c058813b644b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: About restful APIs for job services

Steven Zou <sz...@...>
 

Unfortunately, there is no doc about this part. We had a plan to add doc for job restful API,  but not completed till now as resource limitation.

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <harb...@...> on behalf of Herman Zhu <zhuh...@...>
Date: Tuesday, October 2, 2018 at 13:10
To: harbor-users <harb...@...>
Subject: About restful APIs for job services

 

Hi Steven,

 

#3945
Is there a doc for that restful APIs?

 

I want to post some job to job services server,

so, I need to know post what kind of data.

 

I want to replication single tag to dst_registry_url.

 

BRs

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users+unsu...@....
To post to this group, send email to harbor...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/4a649005-24c5-44b3-a0f6-74b6cd648908%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: About restful APIs for job services

Herman Zhu <zhuhui...@...>
 

Post the json data to job server 
{"job":{"name":"IMAGE_TRANSFER","parameters":{"dst_registry_insecure":false,"dst_registry_password":"SGFyYm9yMTIzNDUK","dst_registry_url":"http://192.168.191.157","dst_registry_username":"admin","repository":"library/rust","src_registry_insecure":true,"src_registry_url":"http://192.168.191.156","tags":"aa5551d785"},"metadata":{"kind":"Generic","unique":false},"status_hook":"test"}}

job server response the data

{"job":{"id":"3613fa8b32655b179a1f2f7d","status":"Pending","name":"IMAGE_TRANSFER","kind":"Generic","unique":false,"ref_link":"/api/v1/jobs/3613fa8b32655b179a1f2f7d","enqueue_time":1538408243,"update_time":1538408243,"hook_status":"activated"}}

job server log is 

Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [INFO] Job incoming: IMAGE_TRANSFER:3613fa8b32655b179a1f2f7d
Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [ERROR] [service_logger.go:63]: Job 'IMAGE_TRANSFER:3613fa8b32655b179a1f2f7d' exit with error: Runtime error: interface conversion: interface {} is string, not []interface {}
Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""
Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""
Oct  1 23:37:27 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:27Z [WARNING] Failed to process 'mark_die_at' request with error: seems 3613fa8b32655b179a1f2f7d is not a dead job
Oct  1 23:37:29 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:29Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""
Oct  1 23:37:29 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:29Z [WARNING] Failed to process 'mark_die_at' request with error: seems 3613fa8b32655b179a1f2f7d is not a dead job
Oct  1 23:37:30 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:30Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""
Oct  1 23:37:39 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:39Z [ERROR] [service_logger.go:63]: Failed to process 'report_status' request with error: Post test: unsupported protocol scheme "" (3 times tried)
Oct  1 23:37:42 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:42Z [ERROR] [service_logger.go:63]: Failed to process 'report_status' request with error: Post test: unsupported protocol scheme "" (3 times tried)
Oct  1 23:37:42 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:42Z [ERROR] [service_logger.go:63]: Failed to process 'mark_die_at' request with error: seems 3613fa8b32655b179a1f2f7d is not a dead job (3 times tried)



About restful APIs for job services

Herman Zhu <zhuhui...@...>
 

Hi Steven,

#3945
Is there a doc for that restful APIs?


I want to post some job to job services server,

so, I need to know post what kind of data.


I want to replication single tag to dst_registry_url.


BRs


Re: harbor performance testing result & tool

Steven Zou <sz...@...>
 

Definitely!

 

Let’s have a talk after the National Public holiday. I’d like to learn more about the harbor related work your team have done.

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <harb...@...> on behalf of Zhenhua Dong <dong...@...>
Date: Friday, September 28, 2018 at 14:11
To: harbor-users <harb...@...>
Subject: Re: harbor performance testing result & tool

 

Hi Steven

 

I am glad to contribute something on the topic, however, I am not sure whether i can find enough time on the topic.  I have  a team work on harbor, I will try to combine it with team tasks. 

 

Whatever, please involve me if there are some discussion on the topic. 

 

BRs/Zhenhua

On Thursday, September 27, 2018 at 11:39:18 AM UTC+8, Steven Zou wrote:

Thanks for providing the benchmark reference. About the perf test for Harbor, we have started to consider that. But to be honest, it cannot be ready in short time due to resource limitations. As we’re an open community and welcoming contributions from the community. If you’re interested, could you please do something on this topic? We can discuss related thing in the community meeting or via social channels like slack if needed.

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <harb...@...> on behalf of Zhenhua Dong <dong...@...>
Date: Thursday, September 27, 2018 at 08:28
To: harbor-users <harb...@...>
Subject: Re: harbor performance testing result & tool

 

Hi Steven

 

Thanks for the update.  

 

I find one simple script to benchmark "docker pull/push/delete". 

 

It would be better if we have some dimension guide which based on performance test result.  

 

BRs/Zhenhua



On Wednesday, September 26, 2018 at 12:06:20 PM UTC+8, Zhenhua Dong wrote:

Hi 

 

Do you know where i can find the performance testing result of harbor and relation testing tool?

 

BRs/Zhenhua

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-...@....
To post to this group, send email to harb...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/0e85ca2a-b24c-406a-950f-11e1c9c17176%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users+unsu...@....
To post to this group, send email to harbor...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/a84b331e-0926-4357-811e-41b86e821908%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: harbor performance testing result & tool

Zhenhua Dong <dongz...@...>
 

Hi Steven

I am glad to contribute something on the topic, however, I am not sure whether i can find enough time on the topic.  I have  a team work on harbor, I will try to combine it with team tasks. 

Whatever, please involve me if there are some discussion on the topic. 

BRs/Zhenhua


On Thursday, September 27, 2018 at 11:39:18 AM UTC+8, Steven Zou wrote:

Thanks for providing the benchmark reference. About the perf test for Harbor, we have started to consider that. But to be honest, it cannot be ready in short time due to resource limitations. As we’re an open community and welcoming contributions from the community. If you’re interested, could you please do something on this topic? We can discuss related thing in the community meeting or via social channels like slack if needed.

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <harb...@...> on behalf of Zhenhua Dong <dong...@...>
Date: Thursday, September 27, 2018 at 08:28
To: harbor-users <harb...@...>
Subject: Re: harbor performance testing result & tool

 

Hi Steven

 

Thanks for the update.  

 

I find one simple script to benchmark "docker pull/push/delete". 

 

It would be better if we have some dimension guide which based on performance test result.  

 

BRs/Zhenhua



On Wednesday, September 26, 2018 at 12:06:20 PM UTC+8, Zhenhua Dong wrote:

Hi 

 

Do you know where i can find the performance testing result of harbor and relation testing tool?

 

BRs/Zhenhua

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users...@googlegroups.com.
To post to this group, send email to harb...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/0e85ca2a-b24c-406a-950f-11e1c9c17176%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: Pulling large images keeps failing

James Zabala <jza...@...>
 

Hi Chethan – does this issue happen with smaller images?

Happy to discuss on Slack if that's easier.

________________________________________
From: harbor...@... <harbor...@...> on behalf of Daniel Jiang <jia...@...>
Sent: Thursday, September 27, 2018 6:24:21 AM
To: Chethan S; harbor-users
Subject: Re: Pulling large images keeps failing

Did you monitor the resource usage of both docker hosts(Linux and Windows)?


Best Regards

Daniel Jiang | 姜坦
Engineer, VMware R&D, Beijing
+86 10-59934536


On 27/09/2018, 6:14 PM, "harbor...@...<mailto:harbor...@...> on behalf of Chethan S" <harbor...@...<mailto:harbor...@...> on behalf of chethanu...@...<mailto:chethanu...@...>> wrote:

We have few very large Windows Docker images (upward of 50 GB) and pulling them from Harbor keeps failing. The pull operation appears stalled - we observed that to be very slow (takes hours) even with the source (Docker hosted Harbor) and destination (Windows Server 2016 initiating the pull) hosted on the same vSphere server. Later weird errors like unexpected EOF appears and it's over.

I am wondering how to troubleshoot this and also how to improve Harbor performance to avoid slow downloads? Any advice would be helpful.


[stalled.png]

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users...@...<mailto:harbor-users...@...>.
To post to this group, send email to harbor...@...<mailto:harbor...@...>.
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/500cf4ee-6570-43cc-bc42-673280ed2467%40googlegroups.com<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Fmsgid%2Fharbor-users%2F500cf4ee-6570-43cc-bc42-673280ed2467%2540googlegroups.com%3Futm_medium%3Demail%26utm_source%3Dfooter&data=02%7C01%7Cjzabala%40vmware.com%7C2453c40d495048860ff608d6246365ae%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C1%7C0%7C636736406694454770&sdata=nJvlvKhCQqXZEYecTBXTxD23GKVTReS7DoIPQE1UTss%3D&reserved=0>.
For more options, visit https://groups.google.com/d/optout<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Foptout&data=02%7C01%7Cjzabala%40vmware.com%7C2453c40d495048860ff608d6246365ae%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C1%7C0%7C636736406694464779&sdata=Px6AvSoFsvuckov3zVFvqmzmX08XxY2oxEVR7mx5Rbg%3D&reserved=0>.


--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users...@...<mailto:harbor-users...@...>.
To post to this group, send email to harbor...@...<mailto:harbor...@...>.
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/E1B38736-DED5-439E-80F9-EDB0B87A2080%40vmware.com<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Fmsgid%2Fharbor-users%2FE1B38736-DED5-439E-80F9-EDB0B87A2080%2540vmware.com%3Futm_medium%3Demail%26utm_source%3Dfooter&data=02%7C01%7Cjzabala%40vmware.com%7C2453c40d495048860ff608d6246365ae%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C1%7C0%7C636736406694474784&sdata=KiXURV%2Bz0ibwJUnjQ8DXbwHNm2ZMuXMOAynvWN6TlLA%3D&reserved=0>.
For more options, visit https://groups.google.com/d/optout<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Foptout&data=02%7C01%7Cjzabala%40vmware.com%7C2453c40d495048860ff608d6246365ae%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C1%7C0%7C636736406694474784&sdata=mWAg1pXS57fVjgWvstAKRp%2F8Ns4IW8GPZglF8jrY8lw%3D&reserved=0>.


Re: Pulling large images keeps failing

Daniel Jiang <jia...@...>
 

Did you monitor the resource usage of both docker hosts(Linux and Windows)?

 

 

Best Regards

— 

Daniel Jiang  | 姜坦

Engineer, VMware R&D, Beijing

+86 10-59934536

 

 

On 27/09/2018, 6:14 PM, "harbor...@... on behalf of Chethan S" <harbor...@... on behalf of chethanu...@...> wrote:

 

We have few very large Windows Docker images (upward of 50 GB) and pulling them from Harbor keeps failing. The pull operation appears stalled - we observed that to be very slow (takes hours) even with the source (Docker hosted Harbor) and destination (Windows Server 2016 initiating the pull) hosted on the same vSphere server. Later weird errors like unexpected EOF appears and it's over. 

 

I am wondering how to troubleshoot this and also how to improve Harbor performance to avoid slow downloads? Any advice would be helpful. 

 

stalled.png

 

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users+unsu...@....
To post to this group, send email to harbor...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/500cf4ee-6570-43cc-bc42-673280ed2467%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

241 - 260 of 298