Page MenuHomePhorge

No OneTemporary

Authored By
Unknown
Size
710 B
Referenced Files
None
Subscribers
None
diff --git a/python/fastembed-server.py b/python/fastembed-server.py
new file mode 100644
index 000000000..fa3f7c82b
--- /dev/null
+++ b/python/fastembed-server.py
@@ -0,0 +1,21 @@
+from fastembed import TextEmbedding
+from fastapi import FastAPI
+from pydantic import BaseModel
+
+model = TextEmbedding("snowflake/snowflake-arctic-embed-xs")
+
+app = FastAPI()
+
+class EmbeddingRequest(BaseModel):
+ model: str
+ prompt: str
+
+@app.post("/api/embeddings")
+def embeddings(request: EmbeddingRequest):
+ embeddings = next(model.embed(request.prompt)).tolist()
+ return {"embedding": embeddings}
+
+if __name__ == "__main__":
+ import uvicorn
+
+ uvicorn.run(app, host="0.0.0.0", port=11345)

File Metadata

Mime Type
text/x-diff
Expires
Wed, Nov 18, 6:28 PM (1 d, 19 h)
Storage Engine
blob
Storage Format
Raw Data
Storage Handle
1840660
Default Alt Text
(710 B)

Event Timeline