{"id":7389,"date":"2024-04-25T10:58:19","date_gmt":"2024-04-25T09:58:19","guid":{"rendered":"https:\/\/tomaskalabis.com\/wordpress\/?p=7389"},"modified":"2024-04-25T11:10:26","modified_gmt":"2024-04-25T10:10:26","slug":"cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources","status":"publish","type":"post","link":"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/","title":{"rendered":"Cannot start VM with vGPU &#8211; insufficient amount of graphic resources"},"content":{"rendered":"\n\n\n<h3>Cannot start VM with vGPU &#8211; insufficient amount of graphic resources<\/h3>\n<p>One of my customers uses vGPU with VMware Horizon infrastructure. We configured a desktop pool with 32 VMs with vGPU, the VM &#8211; W10-214-9-VDI would not start even though only 31 VMs out of 32 were running. This means that there were free resources on the graphics card for one VM, but it still wouldn&#8217;t start and the attempts ended with an error message:\u00a0<\/p>\n<p><a href=\"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.47.55.png\"><img decoding=\"async\" loading=\"lazy\" class=\"size-full wp-image-7390 aligncenter\" src=\"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.47.55.png\" alt=\"\" width=\"489\" height=\"163\" srcset=\"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.47.55.png 489w, https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.47.55-288x96.png 288w\" sizes=\"(max-width: 489px) 100vw, 489px\" \/><\/a><\/p>\n<p><em>The amount of graphics resource available in the parent resource pool is insufficient for the operation. Failed to start the virtual machine. Module DevicePowerOn power on failed. Could not initialize plugin &#8218;libnvidia-vgx.so&#8216; for vGPU &#8218;grid_m10-2q&#8216;. No graphics device is available for vGPU &#8218;grid_m10-2q&#8216;.<\/em><\/p>\n<p><a href=\"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.38.24.png\"><img decoding=\"async\" loading=\"lazy\" class=\"size-large wp-image-7391 aligncenter\" src=\"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.38.24-494x179.png\" alt=\"\" width=\"494\" height=\"179\" srcset=\"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.38.24-494x179.png 494w, https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.38.24-288x104.png 288w, https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.38.24-768x278.png 768w, https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.38.24.png 918w\" sizes=\"(max-width: 494px) 100vw, 494px\" \/><\/a><\/p>\n<p>when I looked at the graphics card settings on the esx node, I saw that one graphics card has only 3 used nodes and one is free. So why it doesn&#8217;t want to boot the VM when the slot is free ?<\/p>\n<p><a href=\"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-12.10.01.png\"><img decoding=\"async\" loading=\"lazy\" class=\"size-large wp-image-7395 aligncenter\" src=\"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-12.10.01-494x472.png\" alt=\"\" width=\"494\" height=\"472\" srcset=\"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-12.10.01-494x472.png 494w, https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-12.10.01-288x275.png 288w, https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-12.10.01.png 584w\" sizes=\"(max-width: 494px) 100vw, 494px\" \/><\/a><\/p>\n<p><a href=\"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.54.43.png\"><img decoding=\"async\" loading=\"lazy\" class=\"size-large wp-image-7392 aligncenter\" src=\"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.54.43-494x62.png\" alt=\"\" width=\"494\" height=\"62\" srcset=\"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.54.43-494x62.png 494w, https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.54.43-288x36.png 288w, https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.54.43-768x96.png 768w, https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.54.43.png 771w\" sizes=\"(max-width: 494px) 100vw, 494px\" \/><\/a><\/p>\n<p>so I connected to the ESX node via SSH and ran the nvidia-smi command. Let&#8217;s check out some &#8222;ghost virtual machines&#8220; on these GPUs. What was interesting was that <strong>nvidia-smi<\/strong> repots 32 running VMs, but there are actually only 31. This means we have some sort of stuck process. After a while, I discovered that the process for W10-214-23-VDI is duplicated. So I proceeded with the command &#8211; <strong>nvidia-smi | grep W10-214-23-VDI<\/strong><\/p>\n<p><a href=\"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.57.36.png\"><img decoding=\"async\" loading=\"lazy\" class=\"size-large wp-image-7393 aligncenter\" src=\"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.57.36-494x36.png\" alt=\"\" width=\"494\" height=\"36\" srcset=\"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.57.36-494x36.png 494w, https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.57.36-288x21.png 288w, https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2024\/04\/Screenshot-2024-04-25-at-11.57.36.png 736w\" sizes=\"(max-width: 494px) 100vw, 494px\" \/><\/a><\/p>\n<p>so I terminated the process via the &#8222;kill -9 PID&#8220; command and then the GPU slot was freed and the problematic VM in VMWare booted.<\/p>\n<p>\u00a0<\/p>\n<p>\u00a0<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Cannot start VM with vGPU &#8211; insufficient amount of graphic resources One of my customers uses vGPU with VMware Horizon infrastructure. We configured a desktop pool with 32 VMs with &#8230;<\/p>\n","protected":false},"author":2,"featured_media":7010,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[204,224],"tags":[374,376,80],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Cannot start VM with vGPU - insufficient amount of graphic resources - tomaskalabis.com<\/title>\n<meta name=\"description\" content=\"The amount of graphics resource available in the parent resource pool is insufficient for the operation. Failed to start the virtual machine.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/\" \/>\n<meta property=\"og:locale\" content=\"cs_CZ\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Cannot start VM with vGPU - insufficient amount of graphic resources - tomaskalabis.com\" \/>\n<meta property=\"og:description\" content=\"The amount of graphics resource available in the parent resource pool is insufficient for the operation. Failed to start the virtual machine.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/\" \/>\n<meta property=\"og:site_name\" content=\"tomaskalabis.com\" \/>\n<meta property=\"article:published_time\" content=\"2024-04-25T09:58:19+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-04-25T10:10:26+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2021\/12\/vmware-vsphere-logo.png\" \/>\n\t<meta property=\"og:image:width\" content=\"166\" \/>\n\t<meta property=\"og:image:height\" content=\"166\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Tomas Kalabis\" \/>\n<meta name=\"twitter:label1\" content=\"Napsal(a)\" \/>\n\t<meta name=\"twitter:data1\" content=\"Tomas Kalabis\" \/>\n\t<meta name=\"twitter:label2\" content=\"Odhadovan\u00e1 doba \u010dten\u00ed\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minuty\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/\",\"url\":\"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/\",\"name\":\"Cannot start VM with vGPU - insufficient amount of graphic resources - tomaskalabis.com\",\"isPartOf\":{\"@id\":\"https:\/\/tomaskalabis.com\/wordpress\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2021\/12\/vmware-vsphere-logo.png\",\"datePublished\":\"2024-04-25T09:58:19+00:00\",\"dateModified\":\"2024-04-25T10:10:26+00:00\",\"author\":{\"@id\":\"https:\/\/tomaskalabis.com\/wordpress\/#\/schema\/person\/8e7e83f618a561ed3734a38cef4cf1d6\"},\"description\":\"The amount of graphics resource available in the parent resource pool is insufficient for the operation. Failed to start the virtual machine.\",\"breadcrumb\":{\"@id\":\"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/#breadcrumb\"},\"inLanguage\":\"cs\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"cs\",\"@id\":\"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/#primaryimage\",\"url\":\"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2021\/12\/vmware-vsphere-logo.png\",\"contentUrl\":\"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2021\/12\/vmware-vsphere-logo.png\",\"width\":166,\"height\":166},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/tomaskalabis.com\/wordpress\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Cannot start VM with vGPU &#8211; insufficient amount of graphic resources\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/tomaskalabis.com\/wordpress\/#website\",\"url\":\"https:\/\/tomaskalabis.com\/wordpress\/\",\"name\":\"tomaskalabis.com\",\"description\":\"my personal blog\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/tomaskalabis.com\/wordpress\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"cs\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/tomaskalabis.com\/wordpress\/#\/schema\/person\/8e7e83f618a561ed3734a38cef4cf1d6\",\"name\":\"Tomas Kalabis\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"cs\",\"@id\":\"https:\/\/tomaskalabis.com\/wordpress\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/9f7e4796b38d5720e8a07b918f423311?s=96&d=retro&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/9f7e4796b38d5720e8a07b918f423311?s=96&d=retro&r=g\",\"caption\":\"Tomas Kalabis\"},\"sameAs\":[\"https:\/\/x.com\/tomaskalabis\"],\"url\":\"https:\/\/tomaskalabis.com\/wordpress\/author\/kalabis\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Cannot start VM with vGPU - insufficient amount of graphic resources - tomaskalabis.com","description":"The amount of graphics resource available in the parent resource pool is insufficient for the operation. Failed to start the virtual machine.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/","og_locale":"cs_CZ","og_type":"article","og_title":"Cannot start VM with vGPU - insufficient amount of graphic resources - tomaskalabis.com","og_description":"The amount of graphics resource available in the parent resource pool is insufficient for the operation. Failed to start the virtual machine.","og_url":"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/","og_site_name":"tomaskalabis.com","article_published_time":"2024-04-25T09:58:19+00:00","article_modified_time":"2024-04-25T10:10:26+00:00","og_image":[{"width":166,"height":166,"url":"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2021\/12\/vmware-vsphere-logo.png","type":"image\/png"}],"author":"Tomas Kalabis","twitter_misc":{"Napsal(a)":"Tomas Kalabis","Odhadovan\u00e1 doba \u010dten\u00ed":"3 minuty"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/","url":"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/","name":"Cannot start VM with vGPU - insufficient amount of graphic resources - tomaskalabis.com","isPartOf":{"@id":"https:\/\/tomaskalabis.com\/wordpress\/#website"},"primaryImageOfPage":{"@id":"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/#primaryimage"},"image":{"@id":"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/#primaryimage"},"thumbnailUrl":"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2021\/12\/vmware-vsphere-logo.png","datePublished":"2024-04-25T09:58:19+00:00","dateModified":"2024-04-25T10:10:26+00:00","author":{"@id":"https:\/\/tomaskalabis.com\/wordpress\/#\/schema\/person\/8e7e83f618a561ed3734a38cef4cf1d6"},"description":"The amount of graphics resource available in the parent resource pool is insufficient for the operation. Failed to start the virtual machine.","breadcrumb":{"@id":"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/#breadcrumb"},"inLanguage":"cs","potentialAction":[{"@type":"ReadAction","target":["https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/"]}]},{"@type":"ImageObject","inLanguage":"cs","@id":"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/#primaryimage","url":"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2021\/12\/vmware-vsphere-logo.png","contentUrl":"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2021\/12\/vmware-vsphere-logo.png","width":166,"height":166},{"@type":"BreadcrumbList","@id":"https:\/\/tomaskalabis.com\/wordpress\/cannot-start-vm-with-vgpu-insufficient-amount-of-graphic-resources\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/tomaskalabis.com\/wordpress\/"},{"@type":"ListItem","position":2,"name":"Cannot start VM with vGPU &#8211; insufficient amount of graphic resources"}]},{"@type":"WebSite","@id":"https:\/\/tomaskalabis.com\/wordpress\/#website","url":"https:\/\/tomaskalabis.com\/wordpress\/","name":"tomaskalabis.com","description":"my personal blog","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/tomaskalabis.com\/wordpress\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"cs"},{"@type":"Person","@id":"https:\/\/tomaskalabis.com\/wordpress\/#\/schema\/person\/8e7e83f618a561ed3734a38cef4cf1d6","name":"Tomas Kalabis","image":{"@type":"ImageObject","inLanguage":"cs","@id":"https:\/\/tomaskalabis.com\/wordpress\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/9f7e4796b38d5720e8a07b918f423311?s=96&d=retro&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9f7e4796b38d5720e8a07b918f423311?s=96&d=retro&r=g","caption":"Tomas Kalabis"},"sameAs":["https:\/\/x.com\/tomaskalabis"],"url":"https:\/\/tomaskalabis.com\/wordpress\/author\/kalabis\/"}]}},"jetpack_featured_media_url":"https:\/\/tomaskalabis.com\/wordpress\/wp-content\/uploads\/2021\/12\/vmware-vsphere-logo.png","_links":{"self":[{"href":"https:\/\/tomaskalabis.com\/wordpress\/wp-json\/wp\/v2\/posts\/7389"}],"collection":[{"href":"https:\/\/tomaskalabis.com\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/tomaskalabis.com\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/tomaskalabis.com\/wordpress\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/tomaskalabis.com\/wordpress\/wp-json\/wp\/v2\/comments?post=7389"}],"version-history":[{"count":2,"href":"https:\/\/tomaskalabis.com\/wordpress\/wp-json\/wp\/v2\/posts\/7389\/revisions"}],"predecessor-version":[{"id":7396,"href":"https:\/\/tomaskalabis.com\/wordpress\/wp-json\/wp\/v2\/posts\/7389\/revisions\/7396"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/tomaskalabis.com\/wordpress\/wp-json\/wp\/v2\/media\/7010"}],"wp:attachment":[{"href":"https:\/\/tomaskalabis.com\/wordpress\/wp-json\/wp\/v2\/media?parent=7389"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/tomaskalabis.com\/wordpress\/wp-json\/wp\/v2\/categories?post=7389"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/tomaskalabis.com\/wordpress\/wp-json\/wp\/v2\/tags?post=7389"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}