Windows 10 22H2, Xeon E5 2696v3, 32 RAM.
Nvidia RTX 3060 12gb as primary GPU
AMD RX 5600XT 6gb as secondary GPU
Devices are in the list
-
cuda nvidia works, but VERY slow. 0.62it/s Automatic1111 web-ui give me 5-6 it/s with xformers.
-
Vulcan 5600XT show 2.62 it/s but got error
Found device AMD Radeon RX 5600 XT. Using target triple rdna2-unknown-windows. Tuned models are currently not supported for this setting. Using cached models from c:\temp\... 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 17.7kB/s] 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 17.8kB/s] loading existing vmfb from: C:\Software\Stable_Diffusion\SHARK\web\euler_scale_model_input_fp16_vulkan-00000000-0500-0000-0000-000000000000.vmfb WARNING: [Loader Message] Code 0 : windows_read_data_files_in_registry: Registry lookup failed to get layer manifest files. Using cached models from c:\temp\... 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 17.3kB/s] 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 16.7kB/s] loading existing vmfb from: C:\Software\Stable_Diffusion\SHARK\web\euler_step_fp16_vulkan-00000000-0500-0000-0000-000000000000.vmfb WARNING: [Loader Message] Code 0 : windows_read_data_files_in_registry: Registry lookup failed to get layer manifest files. Using cached models from c:\temp\... 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 16.3kB/s] 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 16.7kB/s] loading existing vmfb from: C:\Software\Stable_Diffusion\SHARK\web\vae2base_19dec_fp16_vulkan-00000000-0500-0000-0000-000000000000.vmfb WARNING: [Loader Message] Code 0 : windows_read_data_files_in_registry: Registry lookup failed to get layer manifest files. Using cached models from c:\temp\... 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 16.8kB/s] 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 16.8kB/s] loading existing vmfb from: C:\Software\Stable_Diffusion\SHARK\web\unet_19dec_v2p1base_fp16_64_vulkan-00000000-0500-0000-0000-000000000000.vmfb WARNING: [Loader Message] Code 0 : windows_read_data_files_in_registry: Registry lookup failed to get layer manifest files. Using cached models from c:\temp\... 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 16.0kB/s] 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 15.2kB/s] loading existing vmfb from: C:\Software\Stable_Diffusion\SHARK\web\clip_19dec_v2p1base_fp32_64_vulkan-00000000-0500-0000-0000-000000000000.vmfb WARNING: [Loader Message] Code 0 : windows_read_data_files_in_registry: Registry lookup failed to get layer manifest files. 20it [00:07, 2.62it/s] Traceback (most recent call last): File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\gradio\routes.py", line 321, in run_predict output = await app.blocks.process_api( File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\gradio\blocks.py", line 1015, in process_api result = await self.call_function(fn_index, inputs, iterator, request) File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\gradio\blocks.py", line 856, in call_function prediction = await anyio.to_thread.run_sync( File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\anyio\to_thread.py", line 31, in run_sync return await get_asynclib().run_sync_in_worker_thread( File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\anyio\_backends\_asyncio.py", line 937, in run_sync_in_worker_thread return await future File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\anyio\_backends\_asyncio.py", line 867, in run result = context.run(func, *args) File "C:\Software\Stable_Diffusion\SHARK\web\models\stable_diffusion\main.py", line 196, in stable_diff_inf images = vae.forward((latents_numpy,)) File "C:\Software\Stable_Diffusion\SHARK\shark\shark_inference.py", line 142, in forward return self.shark_runner.run(inputs, send_to_host) File "C:\Software\Stable_Diffusion\SHARK\shark\shark_runner.py", line 95, in run return get_results( File "C:\Software\Stable_Diffusion\SHARK\shark\iree_utils\compile_utils.py", line 362, in get_results result = compiled_vm(*device_inputs) File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\iree\runtime\function.py", line 130, in __call__ self._invoke(arg_list, ret_list) File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\iree\runtime\function.py", line 154, in _invoke self._vm_context.invoke(self._vm_function, arg_list, ret_list) RuntimeError: Error invoking function: D:\a\SHARK-Runtime\SHARK-Runtime\c\runtime\src\iree\hal\drivers\vulkan\vma_allocator.cc:316: RESOURCE_EXHAUSTED; VK_ERROR_OUT_OF_DEVICE_MEMORY; vmaCreateBuffer; while invoking native function hal.device.queue.alloca; while calling import; [ 1] native hal.device.queue.alloca:0 - [ 0] bytecode module.forward:3102 [ <stdin>:188:10 at <stdin>:21:3, <stdin>:198:10 at <stdin>:21:3, <stdin>:199:15 at <stdin>:21:3, <stdin>:208:10 at <stdin>:21:3, <stdin>:212:10 at <stdin>:21:3, <stdin>:230:11 at <stdin>:21:3, <stdin>:235:11 at <stdin>:21:3, <stdin>:245:11 at <stdin>:21:3, <stdin>:289:11 at <stdin>:21:3, <stdin>:324:11 at <stdin>:21:3, <stdin>:329:19 at <stdin>:21:3, <stdin>:337:11 at <stdin>:21:3, <stdin>:355:11 at <stdin>:21:3, <stdin>:360:11 at <stdin>:21:3, <stdin>:370:11 at <stdin>:21:3, <stdin>:412:11 at <stdin>:21:3, <stdin>:446:11 at <stdin>:21:3, <stdin>:459:11 at <stdin>:21:3, <stdin>:465:11 at <stdin>:21:3, <stdin>:488:11 at <stdin>:21:3, <stdin>:493:11 at <stdin>:21:3, <stdin>:503:11 at <stdin>:21:3, <stdin>:545:11 at <stdin>:21:3, <stdin>:573:11 at <stdin>:21:3, <stdin>:606:11 at <stdin>:21:3, <stdin>:629:11 at <stdin>:21:3, <stdin>:593:11 at <stdin>:21:3, <stdin>:663:12 at <stdin>:21:3, <stdin>:692:12 at <stdin>:21:3, <stdin>:716:12 at <stdin>:21:3, <stdin>:621:11 at <stdin>:21:3, <stdin>:721:12 at <stdin>:21:3, <stdin>:729:12 at <stdin>:21:3, <stdin>:746:12 at <stdin>:21:3, <stdin>:741:12 at <stdin>:21:3, <stdin>:773:12 at <stdin>:21:3, <stdin>:778:12 at <stdin>:21:3, <stdin>:788:12 at <stdin>:21:3, <stdin>:830:12 at <stdin>:21:3, <stdin>:864:12 at <stdin>:21:3, <stdin>:877:12 at <stdin>:21:3, <stdin>:895:12 at <stdin>:21:3, <stdin>:900:12 at <stdin>:21:3, <stdin>:910:12 at <stdin>:21:3, <stdin>:952:12 at <stdin>:21:3, <stdin>:986:12 at <stdin>:21:3, <stdin>:999:12 at <stdin>:21:3, <stdin>:1005:12 at <stdin>:21:3, <stdin>:1032:12 at <stdin>:21:3, <stdin>:1037:12 at <stdin>:21:3, <stdin>:1047:12 at <stdin>:21:3, <stdin>:1089:12 at <stdin>:21:3, <stdin>:1123:12 at <stdin>:21:3, <stdin>:1136:12 at <stdin>:21:3, <stdin>:1154:12 at <stdin>:21:3, <stdin>:1159:12 at <stdin>:21:3, <stdin>:1169:12 at <stdin>:21:3, <stdin>:1211:12 at <stdin>:21:3, <stdin>:1245:12 at <stdin>:21:3, <stdin>:1258:12 at <stdin>:21:3, <stdin>:1264:12 at <stdin>:21:3, <stdin>:1291:12 at <stdin>:21:3, <stdin>:1296:12 at <stdin>:21:3, <stdin>:1306:12 at <stdin>:21:3, <stdin>:1348:12 at <stdin>:21:3, <stdin>:1382:12 at <stdin>:21:3, <stdin>:1395:12 at <stdin>:21:3, <stdin>:1413:12 at <stdin>:21:3, <stdin>:1418:12 at <stdin>:21:3, <stdin>:1428:12 at <stdin>:21:3, <stdin>:1470:12 at <stdin>:21:3, <stdin>:1504:12 at <stdin>:21:3, <stdin>:1517:12 at <stdin>:21:3, <stdin>:1523:12 at <stdin>:21:3, <stdin>:1550:12 at <stdin>:21:3, <stdin>:1555:12 at <stdin>:21:3, <stdin>:1565:12 at <stdin>:21:3, <stdin>:1607:12 at <stdin>:21:3, <stdin>:1641:12 at <stdin>:21:3, <stdin>:1654:12 at <stdin>:21:3, <stdin>:1672:12 at <stdin>:21:3, <stdin>:1677:12 at <stdin>:21:3, <stdin>:1687:12 at <stdin>:21:3, <stdin>:1729:12 at <stdin>:21:3, <stdin>:1763:12 at <stdin>:21:3, <stdin>:1776:12 at <stdin>:21:3, <stdin>:1777:12 at <stdin>:21:3, <stdin>:1800:19 at <stdin>:21:3, <stdin>:1789:12 at <stdin>:21:3, <stdin>:1808:12 at <stdin>:21:3, <stdin>:1812:12 at <stdin>:21:3, <stdin>:1828:12 at <stdin>:21:3, <stdin>:1833:12 at <stdin>:21:3, <stdin>:1843:12 at <stdin>:21:3, <stdin>:1885:12 at <stdin>:21:3, <stdin>:1920:12 at <stdin>:21:3, <stdin>:1933:12 at <stdin>:21:3, <stdin>:1951:12 at <stdin>:21:3, <stdin>:1956:12 at <stdin>:21:3, <stdin>:1966:12 at <stdin>:21:3, <stdin>:2008:12 at <stdin>:21:3, <stdin>:2042:12 at <stdin>:21:3, <stdin>:2055:12 at <stdin>:21:3, <stdin>:2061:12 at <stdin>:21:3, <stdin>:2084:12 at <stdin>:21:3, <stdin>:2089:12 at <stdin>:21:3, <stdin>:2099:12 at <stdin>:21:3, <stdin>:2141:12 at <stdin>:21:3, <stdin>:2175:12 at <stdin>:21:3, <stdin>:2188:12 at <stdin>:21:3, <stdin>:2206:12 at <stdin>:21:3, <stdin>:2211:12 at <stdin>:21:3, <stdin>:2221:12 at <stdin>:21:3, <stdin>:2263:12 at <stdin>:21:3, <stdin>:2297:12 at <stdin>:21:3, <stdin>:2310:12 at <stdin>:21:3, <stdin>:2316:12 at <stdin>:21:3, <stdin>:2339:12 at <stdin>:21:3, <stdin>:2344:12 at <stdin>:21:3, <stdin>:2354:12 at <stdin>:21:3, <stdin>:2396:12 at <stdin>:21:3, <stdin>:2430:12 at <stdin>:21:3, <stdin>:2443:12 at <stdin>:21:3, <stdin>:2461:12 at <stdin>:21:3, <stdin>:2466:12 at <stdin>:21:3, <stdin>:2476:12 at <stdin>:21:3, <stdin>:2518:12 at <stdin>:21:3, <stdin>:2552:12 at <stdin>:21:3, <stdin>:2565:12 at <stdin>:21:3, <stdin>:2566:12 at <stdin>:21:3, <stdin>:2589:19 at <stdin>:21:3, <stdin>:2578:12 at <stdin>:21:3, <stdin>:2597:12 at <stdin>:21:3, <stdin>:2601:12 at <stdin>:21:3, <stdin>:2617:12 at <stdin>:21:3, <stdin>:2622:12 at <stdin>:21:3, <stdin>:2632:12 at <stdin>:21:3, <stdin>:2674:12 at <stdin>:21:3, <stdin>:2709:12 at <stdin>:21:3, <stdin>:2723:12 at <stdin>:21:3, <stdin>:2727:12 at <stdin>:21:3, <stdin>:2743:12 at <stdin>:21:3, <stdin>:2748:12 at <stdin>:21:3, <stdin>:2758:12 at <stdin>:21:3, <stdin>:2800:12 at <stdin>:21:3, <stdin>:2835:12 at <stdin>:21:3, <stdin>:2840:19 at <stdin>:21:3, <stdin>:2848:12 at <stdin>:21:3, <stdin>:2859:12 at <stdin>:21:3, <stdin>:2853:12 at <stdin>:21:3, <stdin>:2882:12 at <stdin>:21:3, <stdin>:2887:12 at <stdin>:21:3, <stdin>:2897:12 at <stdin>:21:3, <stdin>:2939:12 at <stdin>:21:3, <stdin>:2973:12 at <stdin>:21:3, <stdin>:2986:12 at <stdin>:21:3, <stdin>:3004:12 at <stdin>:21:3, <stdin>:3009:12 at <stdin>:21:3, <stdin>:3019:12 at <stdin>:21:3, <stdin>:3061:12 at <stdin>:21:3, <stdin>:3095:12 at <stdin>:21:3, <stdin>:3108:12 at <stdin>:21:3, <stdin>:3114:12 at <stdin>:21:3, <stdin>:3137:12 at <stdin>:21:3, <stdin>:3142:12 at <stdin>:21:3, <stdin>:3152:12 at <stdin>:21:3, <stdin>:3194:12 at <stdin>:21:3, <stdin>:3228:12 at <stdin>:21:3, <stdin>:3241:12 at <stdin>:21:3, <stdin>:3259:12 at <stdin>:21:3, <stdin>:3264:12 at <stdin>:21:3, <stdin>:3274:12 at <stdin>:21:3, <stdin>:3316:12 at <stdin>:21:3, <stdin>:3350:12 at <stdin>:21:3, <stdin>:3363:12 at <stdin>:21:3, <stdin>:3364:12 at <stdin>:21:3, <stdin>:3387:19 at <stdin>:21:3, <stdin>:3376:12 at <stdin>:21:3, <stdin>:3395:12 at <stdin>:21:3, <stdin>:3399:12 at <stdin>:21:3, <stdin>:3415:12 at <stdin>:21:3, <stdin>:3420:12 at <stdin>:21:3, <stdin>:3430:12 at <stdin>:21:3, <stdin>:3472:12 at <stdin>:21:3, <stdin>:3507:12 at <stdin>:21:3, <stdin>:3521:12 at <stdin>:21:3, <stdin>:3541:12 at <stdin>:21:3, <stdin>:3546:12 at <stdin>:21:3, <stdin>:3556:12 at <stdin>:21:3, <stdin>:3598:12 at <stdin>:21:3, <stdin>:3633:12 at <stdin>:21:3, <stdin>:3638:19 at <stdin>:21:3, <stdin>:3646:12 at <stdin>:21:3, <stdin>:3657:12 at <stdin>:21:3, <stdin>:3651:12 at <stdin>:21:3, <stdin>:3680:12 at <stdin>:21:3, <stdin>:3685:12 at <stdin>:21:3, <stdin>:3695:12 at <stdin>:21:3, <stdin>:3737:12 at <stdin>:21:3, <stdin>:3771:12 at <stdin>:21:3, <stdin>:3784:12 at <stdin>:21:3, <stdin>:3802:12 at <stdin>:21:3, <stdin>:3807:12 at <stdin>:21:3, <stdin>:3817:12 at <stdin>:21:3, <stdin>:3859:12 at <stdin>:21:3, <stdin>:3893:12 at <stdin>:21:3, <stdin>:3906:12 at <stdin>:21:3, <stdin>:3912:12 at <stdin>:21:3, <stdin>:3935:12 at <stdin>:21:3, <stdin>:3940:12 at <stdin>:21:3, <stdin>:3950:12 at <stdin>:21:3, <stdin>:3992:12 at <stdin>:21:3, <stdin>:4026:12 at <stdin>:21:3, <stdin>:4039:12 at <stdin>:21:3, <stdin>:4057:12 at <stdin>:21:3, <stdin>:4062:12 at <stdin>:21:3, <stdin>:4072:12 at <stdin>:21:3, <stdin>:4114:12 at <stdin>:21:3, <stdin>:4148:12 at <stdin>:21:3, <stdin>:4161:12 at <stdin>:21:3, <stdin>:4162:12 at <stdin>:21:3, <stdin>:4190:12 at <stdin>:21:3, <stdin>:4195:12 at <stdin>:21:3, <stdin>:4205:12 at <stdin>:21:3, <stdin>:4247:12 at <stdin>:21:3, <stdin>:4281:12 at <stdin>:21:3, <stdin>:4295:12 at <stdin>:21:3, <stdin>:4286:19 at <stdin>:21:3 ]
for vulkan on nvidia I get error too
Found device NVIDIA GeForce RTX 3060. Using target triple rdna2-unknown-windows. Tuned models are currently not supported for this setting. Using cached models from c:\temp\... 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 17.6kB/s] 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 17.2kB/s] loading existing vmfb from: C:\Software\Stable_Diffusion\SHARK\web\euler_scale_model_input_fp16_vulkan-3290c55c-57a2-5e0d-b28b-58081544255c.vmfb WARNING: [Loader Message] Code 0 : windows_read_data_files_in_registry: Registry lookup failed to get layer manifest files. Using cached models from c:\temp\... 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 15.4kB/s] 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 15.9kB/s] loading existing vmfb from: C:\Software\Stable_Diffusion\SHARK\web\euler_step_fp16_vulkan-3290c55c-57a2-5e0d-b28b-58081544255c.vmfb WARNING: [Loader Message] Code 0 : windows_read_data_files_in_registry: Registry lookup failed to get layer manifest files. Using cached models from c:\temp\... 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 16.2kB/s] 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 16.3kB/s] loading existing vmfb from: C:\Software\Stable_Diffusion\SHARK\web\vae2base_19dec_fp16_vulkan-3290c55c-57a2-5e0d-b28b-58081544255c.vmfb WARNING: [Loader Message] Code 0 : windows_read_data_files_in_registry: Registry lookup failed to get layer manifest files. Using cached models from c:\temp\... 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 17.2kB/s] 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 17.2kB/s] loading existing vmfb from: C:\Software\Stable_Diffusion\SHARK\web\unet_19dec_v2p1base_fp16_64_vulkan-3290c55c-57a2-5e0d-b28b-58081544255c.vmfb WARNING: [Loader Message] Code 0 : windows_read_data_files_in_registry: Registry lookup failed to get layer manifest files. Using cached models from c:\temp\... 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 16.8kB/s] 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 16.7kB/s] loading existing vmfb from: C:\Software\Stable_Diffusion\SHARK\web\clip_19dec_v2p1base_fp32_64_vulkan-3290c55c-57a2-5e0d-b28b-58081544255c.vmfb WARNING: [Loader Message] Code 0 : windows_read_data_files_in_registry: Registry lookup failed to get layer manifest files. Traceback (most recent call last): File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\gradio\routes.py", line 321, in run_predict output = await app.blocks.process_api( File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\gradio\blocks.py", line 1015, in process_api result = await self.call_function(fn_index, inputs, iterator, request) File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\gradio\blocks.py", line 856, in call_function prediction = await anyio.to_thread.run_sync( File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\anyio\to_thread.py", line 31, in run_sync return await get_asynclib().run_sync_in_worker_thread( File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\anyio\_backends\_asyncio.py", line 937, in run_sync_in_worker_thread return await future File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\anyio\_backends\_asyncio.py", line 867, in run result = context.run(func, *args) File "C:\Software\Stable_Diffusion\SHARK\web\models\stable_diffusion\main.py", line 106, in stable_diff_inf model_cache.set_models(device_key) File "C:\Software\Stable_Diffusion\SHARK\web\models\stable_diffusion\cache_objects.py", line 98, in set_models self.clip = get_clip() File "C:\Software\Stable_Diffusion\SHARK\web\models\stable_diffusion\opt_params.py", line 99, in get_clip return get_shark_model(bucket, model_name, iree_flags) File "C:\Software\Stable_Diffusion\SHARK\web\models\stable_diffusion\utils.py", line 58, in get_shark_model return _compile_module(shark_module, model_name, extra_args) File "C:\Software\Stable_Diffusion\SHARK\web\models\stable_diffusion\utils.py", line 23, in _compile_module shark_module.load_module(vmfb_path, extra_args=extra_args) File "C:\Software\Stable_Diffusion\SHARK\shark\shark_inference.py", line 209, in load_module ) = load_flatbuffer( File "C:\Software\Stable_Diffusion\SHARK\shark\iree_utils\compile_utils.py", line 314, in load_flatbuffer return get_iree_module(flatbuffer_blob, device, func_name) File "C:\Software\Stable_Diffusion\SHARK\shark\iree_utils\compile_utils.py", line 283, in get_iree_module vm_module = ireert.VmModule.from_flatbuffer( ValueError: Error creating vm module from FlatBuffer: D:\a\SHARK-Runtime\SHARK-Runtime\c\runtime\src\iree\vm\bytecode_module.c:117: INVALID_ARGUMENT; FlatBuffer data is not present or less than 16 bytes (0 total)
for CPU I get error too
Tuned models are currently not supported for this setting. Using cached models from c:\temp\... 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 16.3kB/s] 100%|███████████████████████████████████████████████████████████████████████████████████████| 640/640 [00:00<00:00, 16.3kB/s] No vmfb found. Compiling and saving to C:\Software\Stable_Diffusion\SHARK\web\euler_scale_model_input_fp16_cpu.vmfb "uname" не является внутренней или внешней командой, исполняемой программой или пакетным файлом. Traceback (most recent call last): File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\gradio\routes.py", line 321, in run_predict output = await app.blocks.process_api( File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\gradio\blocks.py", line 1015, in process_api result = await self.call_function(fn_index, inputs, iterator, request) File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\gradio\blocks.py", line 856, in call_function prediction = await anyio.to_thread.run_sync( File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\anyio\to_thread.py", line 31, in run_sync return await get_asynclib().run_sync_in_worker_thread( File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\anyio\_backends\_asyncio.py", line 937, in run_sync_in_worker_thread return await future File "C:\Software\Stable_Diffusion\SHARK\shark.venv\lib\site-packages\anyio\_backends\_asyncio.py", line 867, in run result = context.run(func, *args) File "C:\Software\Stable_Diffusion\SHARK\web\models\stable_diffusion\main.py", line 106, in stable_diff_inf model_cache.set_models(device_key) File "C:\Software\Stable_Diffusion\SHARK\web\models\stable_diffusion\cache_objects.py", line 94, in set_models self.schedulers = get_schedulers(args.version) File "C:\Software\Stable_Diffusion\SHARK\web\models\stable_diffusion\cache_objects.py", line 64, in get_schedulers schedulers["SharkEulerDiscrete"].compile() File "C:\Software\Stable_Diffusion\SHARK\web\models\stable_diffusion\schedulers.py", line 99, in compile self.scaling_model = get_shark_model( File "C:\Software\Stable_Diffusion\SHARK\web\models\stable_diffusion\utils.py", line 58, in get_shark_model return _compile_module(shark_module, model_name, extra_args) File "C:\Software\Stable_Diffusion\SHARK\web\models\stable_diffusion\utils.py", line 33, in _compile_module path = shark_module.save_module( File "C:\Software\Stable_Diffusion\SHARK\shark\shark_inference.py", line 188, in save_module return export_iree_module_to_vmfb( File "C:\Software\Stable_Diffusion\SHARK\shark\iree_utils\compile_utils.py", line 328, in export_iree_module_to_vmfb flatbuffer_blob = compile_module_to_flatbuffer( File "C:\Software\Stable_Diffusion\SHARK\shark\iree_utils\compile_utils.py", line 245, in compile_module_to_flatbuffer args += get_iree_device_args(device, extra_args) File "C:\Software\Stable_Diffusion\SHARK\shark\iree_utils\compile_utils.py", line 37, in get_iree_device_args return get_iree_cpu_args() File "C:\Software\Stable_Diffusion\SHARK\shark\iree_utils\cpu_utils.py", line 34, in get_iree_cpu_args subprocess.run( File "C:\Users\F2\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 524, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command 'uname -s -m' returned non-zero exit status 1.
So it wont work for me at all, uses strange model files, no speedup for cuda.
![[SD] Update all the utilities to make web and CLI codebase closer](https://avatars.githubusercontent.com/u/22908967?v=4)
11 Dec 15, 2022
1.4k Jan 5, 2023
8.1k Dec 30, 2022
123 Mar 17, 2021
3k Dec 23, 2022
59 Dec 5, 2022
6.9k Dec 31, 2022
14.5k Jan 5, 2023
179 Dec 20, 2022
128 Nov 18, 2022
25 Dec 5, 2022
4.7k Jan 3, 2023
5 Apr 5, 2022
4.4k Dec 30, 2022
1 Nov 27, 2021
939 Dec 29, 2022
156 Dec 19, 2022