Date   

CNCF Project Harbor community call: Governance model discussion

Steven Zou <sz...@...>
 

Hello everyone,


  Welcome to join Harbor community conf call! In this meeting, we have a very important topic: introduce, discuss and collect feedback on the Harbor governance model, which defines the primary principles and flows to operate and promote the Harbor community. As a member of the Harbor community, your comments and suggestions are very important to the whole community. We hope you can reserve time to attend this significant meeting. Looking forward to seeing you at the meeting!


Meeting link: https://zoom.us/j/734959521


Agenda:


  • Opening and latest updates of Harbor project (5 mins)
  • Harbor related activities in KubeCon by Henry Zhang (5 mins)
  • Governance model discussion by James (50 mins)





Re: About restful APIs for job services

Steven Zou <sz...@...>
 

@Herman Zhu

 

  We’re planning to do enhancements to the job service. If you’re interested in this part,  we’re welcoming u to join to do contributions.

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <harb...@...> on behalf of Herman Zhu <zhuh...@...>
Date: Tuesday, October 2, 2018 at 13:23
To: harbor-users <harb...@...>
Subject: Re: About restful APIs for job services

 

Post the json data to job server 

{"job":{"name":"IMAGE_TRANSFER","parameters":{"dst_registry_insecure":false,"dst_registry_password":"SGFyYm9yMTIzNDUK","dst_registry_url":"http://192.168.191.157","dst_registry_username":"admin","repository":"library/rust","src_registry_insecure":true,"src_registry_url":"http://192.168.191.156","tags":"aa5551d785"},"metadata":{"kind":"Generic","unique":false},"status_hook":"test"}}


job server response the data

 

{"job":{"id":"3613fa8b32655b179a1f2f7d","status":"Pending","name":"IMAGE_TRANSFER","kind":"Generic","unique":false,"ref_link":"/api/v1/jobs/3613fa8b32655b179a1f2f7d","enqueue_time":1538408243,"update_time":1538408243,"hook_status":"activated"}}

 

job server log is 

 

Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [INFO] Job incoming: IMAGE_TRANSFER:3613fa8b32655b179a1f2f7d

Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [ERROR] [service_logger.go:63]: Job 'IMAGE_TRANSFER:3613fa8b32655b179a1f2f7d' exit with error: Runtime error: interface conversion: interface {} is string, not []interface {}

Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""

Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""

Oct  1 23:37:27 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:27Z [WARNING] Failed to process 'mark_die_at' request with error: seems 3613fa8b32655b179a1f2f7d is not a dead job

Oct  1 23:37:29 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:29Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""

Oct  1 23:37:29 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:29Z [WARNING] Failed to process 'mark_die_at' request with error: seems 3613fa8b32655b179a1f2f7d is not a dead job

Oct  1 23:37:30 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:30Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""

Oct  1 23:37:39 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:39Z [ERROR] [service_logger.go:63]: Failed to process 'report_status' request with error: Post test: unsupported protocol scheme "" (3 times tried)

Oct  1 23:37:42 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:42Z [ERROR] [service_logger.go:63]: Failed to process 'report_status' request with error: Post test: unsupported protocol scheme "" (3 times tried)

Oct  1 23:37:42 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:42Z [ERROR] [service_logger.go:63]: Failed to process 'mark_die_at' request with error: seems 3613fa8b32655b179a1f2f7d is not a dead job (3 times tried)

 

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users+unsu...@....
To post to this group, send email to harbor...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/d97390cc-eb4f-4bec-8f92-c058813b644b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: About restful APIs for job services

Steven Zou <sz...@...>
 

Then you can check status of job with ‘/api/v1/jobs/3613fa8b32655b179a1f2f7d

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <harb...@...> on behalf of Herman Zhu <zhuh...@...>
Date: Tuesday, October 2, 2018 at 13:23
To: harbor-users <harb...@...>
Subject: Re: About restful APIs for job services

 

Post the json data to job server 

{"job":{"name":"IMAGE_TRANSFER","parameters":{"dst_registry_insecure":false,"dst_registry_password":"SGFyYm9yMTIzNDUK","dst_registry_url":"http://192.168.191.157","dst_registry_username":"admin","repository":"library/rust","src_registry_insecure":true,"src_registry_url":"http://192.168.191.156","tags":"aa5551d785"},"metadata":{"kind":"Generic","unique":false},"status_hook":"test"}}


job server response the data

 

{"job":{"id":"3613fa8b32655b179a1f2f7d","status":"Pending","name":"IMAGE_TRANSFER","kind":"Generic","unique":false,"ref_link":"/api/v1/jobs/3613fa8b32655b179a1f2f7d","enqueue_time":1538408243,"update_time":1538408243,"hook_status":"activated"}}

 

job server log is 

 

Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [INFO] Job incoming: IMAGE_TRANSFER:3613fa8b32655b179a1f2f7d

Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [ERROR] [service_logger.go:63]: Job 'IMAGE_TRANSFER:3613fa8b32655b179a1f2f7d' exit with error: Runtime error: interface conversion: interface {} is string, not []interface {}

Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""

Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""

Oct  1 23:37:27 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:27Z [WARNING] Failed to process 'mark_die_at' request with error: seems 3613fa8b32655b179a1f2f7d is not a dead job

Oct  1 23:37:29 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:29Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""

Oct  1 23:37:29 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:29Z [WARNING] Failed to process 'mark_die_at' request with error: seems 3613fa8b32655b179a1f2f7d is not a dead job

Oct  1 23:37:30 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:30Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""

Oct  1 23:37:39 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:39Z [ERROR] [service_logger.go:63]: Failed to process 'report_status' request with error: Post test: unsupported protocol scheme "" (3 times tried)

Oct  1 23:37:42 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:42Z [ERROR] [service_logger.go:63]: Failed to process 'report_status' request with error: Post test: unsupported protocol scheme "" (3 times tried)

Oct  1 23:37:42 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:42Z [ERROR] [service_logger.go:63]: Failed to process 'mark_die_at' request with error: seems 3613fa8b32655b179a1f2f7d is not a dead job (3 times tried)

 

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users+unsu...@....
To post to this group, send email to harbor...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/d97390cc-eb4f-4bec-8f92-c058813b644b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: About restful APIs for job services

Steven Zou <sz...@...>
 

Unfortunately, there is no doc about this part. We had a plan to add doc for job restful API,  but not completed till now as resource limitation.

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <harb...@...> on behalf of Herman Zhu <zhuh...@...>
Date: Tuesday, October 2, 2018 at 13:10
To: harbor-users <harb...@...>
Subject: About restful APIs for job services

 

Hi Steven,

 

#3945
Is there a doc for that restful APIs?

 

I want to post some job to job services server,

so, I need to know post what kind of data.

 

I want to replication single tag to dst_registry_url.

 

BRs

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users+unsu...@....
To post to this group, send email to harbor...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/4a649005-24c5-44b3-a0f6-74b6cd648908%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: About restful APIs for job services

Herman Zhu <zhuhui...@...>
 

Post the json data to job server 
{"job":{"name":"IMAGE_TRANSFER","parameters":{"dst_registry_insecure":false,"dst_registry_password":"SGFyYm9yMTIzNDUK","dst_registry_url":"http://192.168.191.157","dst_registry_username":"admin","repository":"library/rust","src_registry_insecure":true,"src_registry_url":"http://192.168.191.156","tags":"aa5551d785"},"metadata":{"kind":"Generic","unique":false},"status_hook":"test"}}

job server response the data

{"job":{"id":"3613fa8b32655b179a1f2f7d","status":"Pending","name":"IMAGE_TRANSFER","kind":"Generic","unique":false,"ref_link":"/api/v1/jobs/3613fa8b32655b179a1f2f7d","enqueue_time":1538408243,"update_time":1538408243,"hook_status":"activated"}}

job server log is 

Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [INFO] Job incoming: IMAGE_TRANSFER:3613fa8b32655b179a1f2f7d
Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [ERROR] [service_logger.go:63]: Job 'IMAGE_TRANSFER:3613fa8b32655b179a1f2f7d' exit with error: Runtime error: interface conversion: interface {} is string, not []interface {}
Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""
Oct  1 23:37:25 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:25Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""
Oct  1 23:37:27 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:27Z [WARNING] Failed to process 'mark_die_at' request with error: seems 3613fa8b32655b179a1f2f7d is not a dead job
Oct  1 23:37:29 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:29Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""
Oct  1 23:37:29 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:29Z [WARNING] Failed to process 'mark_die_at' request with error: seems 3613fa8b32655b179a1f2f7d is not a dead job
Oct  1 23:37:30 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:30Z [WARNING] Failed to process 'report_status' request with error: Post test: unsupported protocol scheme ""
Oct  1 23:37:39 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:39Z [ERROR] [service_logger.go:63]: Failed to process 'report_status' request with error: Post test: unsupported protocol scheme "" (3 times tried)
Oct  1 23:37:42 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:42Z [ERROR] [service_logger.go:63]: Failed to process 'report_status' request with error: Post test: unsupported protocol scheme "" (3 times tried)
Oct  1 23:37:42 172.18.0.1 jobservice[23019]: 2018-10-01T15:37:42Z [ERROR] [service_logger.go:63]: Failed to process 'mark_die_at' request with error: seems 3613fa8b32655b179a1f2f7d is not a dead job (3 times tried)



About restful APIs for job services

Herman Zhu <zhuhui...@...>
 

Hi Steven,

#3945
Is there a doc for that restful APIs?


I want to post some job to job services server,

so, I need to know post what kind of data.


I want to replication single tag to dst_registry_url.


BRs


Re: harbor performance testing result & tool

Steven Zou <sz...@...>
 

Definitely!

 

Let’s have a talk after the National Public holiday. I’d like to learn more about the harbor related work your team have done.

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <harb...@...> on behalf of Zhenhua Dong <dong...@...>
Date: Friday, September 28, 2018 at 14:11
To: harbor-users <harb...@...>
Subject: Re: harbor performance testing result & tool

 

Hi Steven

 

I am glad to contribute something on the topic, however, I am not sure whether i can find enough time on the topic.  I have  a team work on harbor, I will try to combine it with team tasks. 

 

Whatever, please involve me if there are some discussion on the topic. 

 

BRs/Zhenhua

On Thursday, September 27, 2018 at 11:39:18 AM UTC+8, Steven Zou wrote:

Thanks for providing the benchmark reference. About the perf test for Harbor, we have started to consider that. But to be honest, it cannot be ready in short time due to resource limitations. As we’re an open community and welcoming contributions from the community. If you’re interested, could you please do something on this topic? We can discuss related thing in the community meeting or via social channels like slack if needed.

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <harb...@...> on behalf of Zhenhua Dong <dong...@...>
Date: Thursday, September 27, 2018 at 08:28
To: harbor-users <harb...@...>
Subject: Re: harbor performance testing result & tool

 

Hi Steven

 

Thanks for the update.  

 

I find one simple script to benchmark "docker pull/push/delete". 

 

It would be better if we have some dimension guide which based on performance test result.  

 

BRs/Zhenhua



On Wednesday, September 26, 2018 at 12:06:20 PM UTC+8, Zhenhua Dong wrote:

Hi 

 

Do you know where i can find the performance testing result of harbor and relation testing tool?

 

BRs/Zhenhua

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-...@....
To post to this group, send email to harb...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/0e85ca2a-b24c-406a-950f-11e1c9c17176%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users+unsu...@....
To post to this group, send email to harbor...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/a84b331e-0926-4357-811e-41b86e821908%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: harbor performance testing result & tool

Zhenhua Dong <dongz...@...>
 

Hi Steven

I am glad to contribute something on the topic, however, I am not sure whether i can find enough time on the topic.  I have  a team work on harbor, I will try to combine it with team tasks. 

Whatever, please involve me if there are some discussion on the topic. 

BRs/Zhenhua


On Thursday, September 27, 2018 at 11:39:18 AM UTC+8, Steven Zou wrote:

Thanks for providing the benchmark reference. About the perf test for Harbor, we have started to consider that. But to be honest, it cannot be ready in short time due to resource limitations. As we’re an open community and welcoming contributions from the community. If you’re interested, could you please do something on this topic? We can discuss related thing in the community meeting or via social channels like slack if needed.

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <harb...@...> on behalf of Zhenhua Dong <dong...@...>
Date: Thursday, September 27, 2018 at 08:28
To: harbor-users <harb...@...>
Subject: Re: harbor performance testing result & tool

 

Hi Steven

 

Thanks for the update.  

 

I find one simple script to benchmark "docker pull/push/delete". 

 

It would be better if we have some dimension guide which based on performance test result.  

 

BRs/Zhenhua



On Wednesday, September 26, 2018 at 12:06:20 PM UTC+8, Zhenhua Dong wrote:

Hi 

 

Do you know where i can find the performance testing result of harbor and relation testing tool?

 

BRs/Zhenhua

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users...@googlegroups.com.
To post to this group, send email to harb...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/0e85ca2a-b24c-406a-950f-11e1c9c17176%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: Pulling large images keeps failing

James Zabala <jza...@...>
 

Hi Chethan – does this issue happen with smaller images?

Happy to discuss on Slack if that's easier.

________________________________________
From: harbor...@... <harbor...@...> on behalf of Daniel Jiang <jia...@...>
Sent: Thursday, September 27, 2018 6:24:21 AM
To: Chethan S; harbor-users
Subject: Re: Pulling large images keeps failing

Did you monitor the resource usage of both docker hosts(Linux and Windows)?


Best Regards

Daniel Jiang | 姜坦
Engineer, VMware R&D, Beijing
+86 10-59934536


On 27/09/2018, 6:14 PM, "harbor...@...<mailto:harbor...@...> on behalf of Chethan S" <harbor...@...<mailto:harbor...@...> on behalf of chethanu...@...<mailto:chethanu...@...>> wrote:

We have few very large Windows Docker images (upward of 50 GB) and pulling them from Harbor keeps failing. The pull operation appears stalled - we observed that to be very slow (takes hours) even with the source (Docker hosted Harbor) and destination (Windows Server 2016 initiating the pull) hosted on the same vSphere server. Later weird errors like unexpected EOF appears and it's over.

I am wondering how to troubleshoot this and also how to improve Harbor performance to avoid slow downloads? Any advice would be helpful.


[stalled.png]

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users...@...<mailto:harbor-users...@...>.
To post to this group, send email to harbor...@...<mailto:harbor...@...>.
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/500cf4ee-6570-43cc-bc42-673280ed2467%40googlegroups.com<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Fmsgid%2Fharbor-users%2F500cf4ee-6570-43cc-bc42-673280ed2467%2540googlegroups.com%3Futm_medium%3Demail%26utm_source%3Dfooter&data=02%7C01%7Cjzabala%40vmware.com%7C2453c40d495048860ff608d6246365ae%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C1%7C0%7C636736406694454770&sdata=nJvlvKhCQqXZEYecTBXTxD23GKVTReS7DoIPQE1UTss%3D&reserved=0>.
For more options, visit https://groups.google.com/d/optout<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Foptout&data=02%7C01%7Cjzabala%40vmware.com%7C2453c40d495048860ff608d6246365ae%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C1%7C0%7C636736406694464779&sdata=Px6AvSoFsvuckov3zVFvqmzmX08XxY2oxEVR7mx5Rbg%3D&reserved=0>.


--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users...@...<mailto:harbor-users...@...>.
To post to this group, send email to harbor...@...<mailto:harbor...@...>.
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/E1B38736-DED5-439E-80F9-EDB0B87A2080%40vmware.com<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Fmsgid%2Fharbor-users%2FE1B38736-DED5-439E-80F9-EDB0B87A2080%2540vmware.com%3Futm_medium%3Demail%26utm_source%3Dfooter&data=02%7C01%7Cjzabala%40vmware.com%7C2453c40d495048860ff608d6246365ae%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C1%7C0%7C636736406694474784&sdata=KiXURV%2Bz0ibwJUnjQ8DXbwHNm2ZMuXMOAynvWN6TlLA%3D&reserved=0>.
For more options, visit https://groups.google.com/d/optout<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Foptout&data=02%7C01%7Cjzabala%40vmware.com%7C2453c40d495048860ff608d6246365ae%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C1%7C0%7C636736406694474784&sdata=mWAg1pXS57fVjgWvstAKRp%2F8Ns4IW8GPZglF8jrY8lw%3D&reserved=0>.


Re: Pulling large images keeps failing

Daniel Jiang <jia...@...>
 

Did you monitor the resource usage of both docker hosts(Linux and Windows)?

 

 

Best Regards

— 

Daniel Jiang  | 姜坦

Engineer, VMware R&D, Beijing

+86 10-59934536

 

 

On 27/09/2018, 6:14 PM, "harbor...@... on behalf of Chethan S" <harbor...@... on behalf of chethanu...@...> wrote:

 

We have few very large Windows Docker images (upward of 50 GB) and pulling them from Harbor keeps failing. The pull operation appears stalled - we observed that to be very slow (takes hours) even with the source (Docker hosted Harbor) and destination (Windows Server 2016 initiating the pull) hosted on the same vSphere server. Later weird errors like unexpected EOF appears and it's over. 

 

I am wondering how to troubleshoot this and also how to improve Harbor performance to avoid slow downloads? Any advice would be helpful. 

 

stalled.png

 

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users+unsu...@....
To post to this group, send email to harbor...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/500cf4ee-6570-43cc-bc42-673280ed2467%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Pulling large images keeps failing

Chethan S <chethanu...@...>
 

We have few very large Windows Docker images (upward of 50 GB) and pulling them from Harbor keeps failing. The pull operation appears stalled - we observed that to be very slow (takes hours) even with the source (Docker hosted Harbor) and destination (Windows Server 2016 initiating the pull) hosted on the same vSphere server. Later weird errors like unexpected EOF appears and it's over. 

I am wondering how to troubleshoot this and also how to improve Harbor performance to avoid slow downloads? Any advice would be helpful. 

stalled.png



Re: harbor performance testing result & tool

Steven Zou <sz...@...>
 

Thanks for providing the benchmark reference. About the perf test for Harbor, we have started to consider that. But to be honest, it cannot be ready in short time due to resource limitations. As we’re an open community and welcoming contributions from the community. If you’re interested, could you please do something on this topic? We can discuss related thing in the community meeting or via social channels like slack if needed.

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <harb...@...> on behalf of Zhenhua Dong <dong...@...>
Date: Thursday, September 27, 2018 at 08:28
To: harbor-users <harb...@...>
Subject: Re: harbor performance testing result & tool

 

Hi Steven

 

Thanks for the update.  

 

I find one simple script to benchmark "docker pull/push/delete". 

https://docs.openstack.org/developer/performance-docs/test_plans/container_repositories/plan.html#script-for-collecting-performance-metrics-of-docker-repository

 

It would be better if we have some dimension guide which based on performance test result.  

 

BRs/Zhenhua



On Wednesday, September 26, 2018 at 12:06:20 PM UTC+8, Zhenhua Dong wrote:

Hi 

 

Do you know where i can find the performance testing result of harbor and relation testing tool?

 

BRs/Zhenhua

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users+unsu...@....
To post to this group, send email to harbor...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/0e85ca2a-b24c-406a-950f-11e1c9c17176%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: harbor performance testing result & tool

Zhenhua Dong <dongz...@...>
 

Hi Steven

Thanks for the update.  

I find one simple script to benchmark "docker pull/push/delete". 
https://docs.openstack.org/developer/performance-docs/test_plans/container_repositories/plan.html#script-for-collecting-performance-metrics-of-docker-repository

It would be better if we have some dimension guide which based on performance test result.  

BRs/Zhenhua


On Wednesday, September 26, 2018 at 12:06:20 PM UTC+8, Zhenhua Dong wrote:
Hi 

Do you know where i can find the performance testing result of harbor and relation testing tool?

BRs/Zhenhua


Re: harbor performance testing result & tool

Steven Zou <sz...@...>
 

Zhenhua,

 

So far, we don’t have the pref results/tools you want. But please stay tuned for later updates.

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 9F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <harb...@...> on behalf of Zhenhua Dong <dong...@...>
Date: Wednesday, September 26, 2018 at 12:06
To: harbor-users <harb...@...>
Subject: harbor performance testing result & tool

 

Hi 

 

Do you know where i can find the performance testing result of harbor and relation testing tool?

 

BRs/Zhenhua

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users+unsu...@....
To post to this group, send email to harbor...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/66d1f145-fce1-44c1-831a-4a4c770c4ca4%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


harbor performance testing result & tool

Zhenhua Dong <dongz...@...>
 

Hi 

Do you know where i can find the performance testing result of harbor and relation testing tool?

BRs/Zhenhua


Cancel the community meeting of this week

Steven Zou <sz...@...>
 

As this week is very close to two public holidays of China and most members in China may have started their vocations, we’ll cancel the community meeting of this week. Let’s meet at the meeting of Oct.

 

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 8F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 


Re: How to import an LDAP/AD group to Harbor and assign project roles to it?

Chethan S <chethanu...@...>
 

I never thought that would make a difference. Checked on a private window and it's showing up as expected. Thank you very much. 


On Friday, 14 September 2018 12:11:26 UTC+5:30, daojunz wrote:

Can you please clear the browser cache and try again?

 

From: <harb...@...> on behalf of Chethan S <cheth...@...>
Date: Friday, September 14, 2018 at 2:06 PM
To: harbor-users <harb...@...>
Subject: Re: How to import an LDAP/AD group to Harbor and assign project roles to it?

 

I am on 1.6.0 but I don't see the groups section in my LDAP configuration UI. These are the only options I see - 

 

018-09-14 11_35_04-Harbor.png

 

 

What should I do to see them? The relevant sections are enabled in harbor.cfg. 

On Friday, 14 September 2018 11:06:53 UTC+5:30, daojunz wrote:

You can refer this online guide :

https://github.com/goharbor/harbor/blob/master/docs/manage_role_by_ldap_group.md

 

 

From: <harb...@...> on behalf of Chethan S <cheth...@...>
Date: Friday, September 14, 2018 at 12:37 PM
To: harbor-users <harb...@...>
Subject: How to import an LDAP/AD group to Harbor and assign project roles to it?

 

Under the new features heading of v 1.6.0, I noticed this statement - Support LDAP group: User can import an LDAP/AD group to Harbor and assign project roles to it. However, I am not able to figure out how to do that. Need some inputs here.

 

Also, the way we are doing things now is adding individual users - 

  1. Users are allowed to sign-up using domain credentials and we assign them to right projects OR
  2. We assign users to projects using domain aliases and let them know - wish email alerts could be sent in these cases

As the number of projects is expected to grow, we are hoping to use efficient methods. I'm interested to know how you all handle LDAP integrated accounts.

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users...@googlegroups.com.
To post to this group, send email to harb...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/98299fa3-581f-4d1a-b39b-292261c9436a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users...@googlegroups.com.
To post to this group, send email to harb...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/55b1f15a-77ca-40d1-8d4c-a41de907e90f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: How to import an LDAP/AD group to Harbor and assign project roles to it?

DaoJun Zhang <dao...@...>
 

Can you please clear the browser cache and try again?

 

From: <harb...@...> on behalf of Chethan S <chetha...@...>
Date: Friday, September 14, 2018 at 2:06 PM
To: harbor-users <harb...@...>
Subject: Re: How to import an LDAP/AD group to Harbor and assign project roles to it?

 

I am on 1.6.0 but I don't see the groups section in my LDAP configuration UI. These are the only options I see - 

 

018-09-14 11_35_04-Harbor.png

 

 

What should I do to see them? The relevant sections are enabled in harbor.cfg. 

On Friday, 14 September 2018 11:06:53 UTC+5:30, daojunz wrote:

You can refer this online guide :

https://github.com/goharbor/harbor/blob/master/docs/manage_role_by_ldap_group.md

 

 

From: <harb...@...> on behalf of Chethan S <cheth...@...>
Date: Friday, September 14, 2018 at 12:37 PM
To: harbor-users <harb...@...>
Subject: How to import an LDAP/AD group to Harbor and assign project roles to it?

 

Under the new features heading of v 1.6.0, I noticed this statement - Support LDAP group: User can import an LDAP/AD group to Harbor and assign project roles to it. However, I am not able to figure out how to do that. Need some inputs here.

 

Also, the way we are doing things now is adding individual users - 

  1. Users are allowed to sign-up using domain credentials and we assign them to right projects OR
  2. We assign users to projects using domain aliases and let them know - wish email alerts could be sent in these cases

As the number of projects is expected to grow, we are hoping to use efficient methods. I'm interested to know how you all handle LDAP integrated accounts.

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-...@....
To post to this group, send email to harb...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/98299fa3-581f-4d1a-b39b-292261c9436a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users+unsu...@....
To post to this group, send email to harbor...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/55b1f15a-77ca-40d1-8d4c-a41de907e90f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: How to import an LDAP/AD group to Harbor and assign project roles to it?

Chethan S <chethanu...@...>
 

Here is the screenshot of the about option. I should also add that I upgraded from 1.5.2 last week.

2018-09-14 12_08_51-Harbor.png





On Friday, 14 September 2018 12:07:17 UTC+5:30, Steven Zou wrote:

Could you please check the Harbor version by opening the about dialog?  You can click the `about` menu item under the username menu at the right top.

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 8F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <harb...@...> on behalf of Chethan S <cheth...@...>
Date: Friday, September 14, 2018 at 14:06
To: harbor-users <harb...@...>
Subject: Re: How to import an LDAP/AD group to Harbor and assign project roles to it?

 

I am on 1.6.0 but I don't see the groups section in my LDAP configuration UI. These are the only options I see - 

 

2018-09-14 11_35_04-Harbor.png

 

 

What should I do to see them? The relevant sections are enabled in harbor.cfg. 

On Friday, 14 September 2018 11:06:53 UTC+5:30, daojunz wrote:

You can refer this online guide :

https://github.com/goharbor/harbor/blob/master/docs/manage_role_by_ldap_group.md

 

 

From: <harb...@...> on behalf of Chethan S <cheth...@...>
Date: Friday, September 14, 2018 at 12:37 PM
To: harbor-users <harb...@...>
Subject: How to import an LDAP/AD group to Harbor and assign project roles to it?

 

Under the new features heading of v 1.6.0, I noticed this statement - Support LDAP group: User can import an LDAP/AD group to Harbor and assign project roles to it. However, I am not able to figure out how to do that. Need some inputs here.

 

Also, the way we are doing things now is adding individual users - 

  1. Users are allowed to sign-up using domain credentials and we assign them to right projects OR
  2. We assign users to projects using domain aliases and let them know - wish email alerts could be sent in these cases

As the number of projects is expected to grow, we are hoping to use efficient methods. I'm interested to know how you all handle LDAP integrated accounts.

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users...@googlegroups.com.
To post to this group, send email to harb...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/98299fa3-581f-4d1a-b39b-292261c9436a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users...@googlegroups.com.
To post to this group, send email to harb...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/55b1f15a-77ca-40d1-8d4c-a41de907e90f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: How to import an LDAP/AD group to Harbor and assign project roles to it?

Steven Zou <sz...@...>
 

Could you please check the Harbor version by opening the about dialog?  You can click the `about` menu item under the username menu at the right top.

 

thanks&regards

-- 

Steven (邹佳)

 

Engineer, CNA, VMware R&D

 

Mail: sz...@...

Cell: +8618600021252

Addr: 8F Tower C, Raycom Info Tech Park, No. 2 Kexueyuan South Road Haidian District, Beijing 100738 China

 

 

 

From: <harb...@...> on behalf of Chethan S <chetha...@...>
Date: Friday, September 14, 2018 at 14:06
To: harbor-users <harb...@...>
Subject: Re: How to import an LDAP/AD group to Harbor and assign project roles to it?

 

I am on 1.6.0 but I don't see the groups section in my LDAP configuration UI. These are the only options I see - 

 

2018-09-14 11_35_04-Harbor.png

 

 

What should I do to see them? The relevant sections are enabled in harbor.cfg. 

On Friday, 14 September 2018 11:06:53 UTC+5:30, daojunz wrote:

You can refer this online guide :

https://github.com/goharbor/harbor/blob/master/docs/manage_role_by_ldap_group.md

 

 

From: <harb...@...> on behalf of Chethan S <cheth...@...>
Date: Friday, September 14, 2018 at 12:37 PM
To: harbor-users <harb...@...>
Subject: How to import an LDAP/AD group to Harbor and assign project roles to it?

 

Under the new features heading of v 1.6.0, I noticed this statement - Support LDAP group: User can import an LDAP/AD group to Harbor and assign project roles to it. However, I am not able to figure out how to do that. Need some inputs here.

 

Also, the way we are doing things now is adding individual users - 

  1. Users are allowed to sign-up using domain credentials and we assign them to right projects OR
  2. We assign users to projects using domain aliases and let them know - wish email alerts could be sent in these cases

As the number of projects is expected to grow, we are hoping to use efficient methods. I'm interested to know how you all handle LDAP integrated accounts.

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-...@....
To post to this group, send email to harb...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/98299fa3-581f-4d1a-b39b-292261c9436a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "harbor-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to harbor-users+unsu...@....
To post to this group, send email to harbor...@....
To view this discussion on the web visit https://groups.google.com/d/msgid/harbor-users/55b1f15a-77ca-40d1-8d4c-a41de907e90f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

241 - 260 of 288