29 lines
1.3 KiB
Markdown
29 lines
1.3 KiB
Markdown
<!--- Licensed to the Apache Software Foundation (ASF) under one -->
|
|
<!--- or more contributor license agreements. See the NOTICE file -->
|
|
<!--- distributed with this work for additional information -->
|
|
<!--- regarding copyright ownership. The ASF licenses this file -->
|
|
<!--- to you under the Apache License, Version 2.0 (the -->
|
|
<!--- "License"); you may not use this file except in compliance -->
|
|
<!--- with the License. You may obtain a copy of the License at -->
|
|
|
|
<!--- http://www.apache.org/licenses/LICENSE-2.0 -->
|
|
|
|
<!--- Unless required by applicable law or agreed to in writing, -->
|
|
<!--- software distributed under the License is distributed on an -->
|
|
<!--- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY -->
|
|
<!--- KIND, either express or implied. See the License for the -->
|
|
<!--- specific language governing permissions and limitations -->
|
|
<!--- under the License. -->
|
|
|
|
# MLC-LLM WebAssembly Runtime
|
|
|
|
This folder contains MLC-LLM WebAssembly Runtime.
|
|
|
|
Please refer to https://llm.mlc.ai/docs/install/emcc.html.
|
|
|
|
The main step is running `make` under this folder, a step included in `web/prep_emcc_deps.sh`.
|
|
|
|
`make` creates `web/dist/wasm/mlc_wasm_runtime.bc`, which will be included in the model library wasm
|
|
when we compile the model. Thus during runtime, runtimes like WebLLM can directly reuse source
|
|
code from MLC-LLM.
|