Metadata-Version: 2.1
Name: arcee-align
Version: 0.0.6
Summary: The open source toolkit for finetuning and deploying LLMs
Home-page: https://arcee.ai/
Author: Arcee
Author-email: jacob@arcee.ai
License: UNKNOWN
Platform: UNKNOWN
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.7
Description-Content-Type: text/markdown
Requires-Dist: accelerate (==0.20.1)
Requires-Dist: datasets (==2.12.0)
Requires-Dist: langchain (==0.0.198)
Requires-Dist: openai (==0.27.8)
Requires-Dist: peft (==0.3.0)
Requires-Dist: transformers (==4.30.1)
Requires-Dist: trl (==0.4.6)
Provides-Extra: dev
Requires-Dist: black (==22.3.0) ; extra == 'dev'
Requires-Dist: flake8 ; extra == 'dev'
Requires-Dist: isort ; extra == 'dev'
Requires-Dist: pytest ; extra == 'dev'
Requires-Dist: twine ; extra == 'dev'
Requires-Dist: wheel ; extra == 'dev'

# Arcee

:tulip:	The open source toolkit for finetuning and deploying LLMs :tulip:

### Finetune LLMS

```
from arcee.models import LM
from arcee.data import Instuctions

lm = LM("falcon30b")
instructions = Instructions("./datasets/stripe-api.json")
lm.train(instructions)

lm.predict("Place an order for the LLM-9000 product for 100 USD to the card 3007200039992000")
```

### Deploy LLMS

Authenticate

```
import arcee
arcee.login()
```

Deploy to the Arcee cloud

```
project = arcee.create_project("stripe-api-operator")
#project = arcee.load_project(...)

#regulated under 7b params for free
#only PEFT uploadable for free

hosted_lm = project.deploy(llm)
hosted_lm.url
hosted_lm.predict("Place an order for the LLM-9000 product for 100 USD to the card 3007200039992000")

#view a streaming web app of the llm
project.demo()
```

### LangChain Integration

```
from langchain import Arcee
#goes in llms/arcee.py

prompt_template = "Write a stripe API request for the following: {order}."

llm = Arcee(temperature=0)
llm_chain = LLMChain(
    llm=llm,
    prompt=PromptTemplate.from_template(prompt_template)
)
llm_chain("Place an order for the LLM-9000 product for 100 USD to the card 3007200039992000")
```




