Text Generation
Transformers
PyTorch
English
crystalcoder
llm
code
custom_code
Eval Results (legacy)
Instructions to use LLM360/CrystalChat with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use LLM360/CrystalChat with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="LLM360/CrystalChat", trust_remote_code=True)# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("LLM360/CrystalChat", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use LLM360/CrystalChat with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "LLM360/CrystalChat" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "LLM360/CrystalChat", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/LLM360/CrystalChat
- SGLang
How to use LLM360/CrystalChat with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "LLM360/CrystalChat" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "LLM360/CrystalChat", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "LLM360/CrystalChat" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "LLM360/CrystalChat", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use LLM360/CrystalChat with Docker Model Runner:
docker model run hf.co/LLM360/CrystalChat
Commit History
Delete cc-eval-lang-compare.png 48f06b0 verified
Update README.md 63fef20 verified
Upload test2.png b6ab53c verified
Update README.md 374f200 verified
Upload test1.png b86ea8d verified
Update README.md b3cc9d6 verified
Rename cc-std-eval-benchmarks.png to cc-eval-std-benchmarks.png b1a6a56 verified
Rename cc-std-eval.png to cc-std-eval-benchmarks.png 90abd53 verified
Delete cc-eval-std-benchmarks.png 753cbba verified
Upload cc-std-eval.png f57bb81 verified
Update README.md 3db9e99 verified
Rename lang-no-backgroud.png to cc-eval-lang-compare.png 7730329 verified
Delete cc-eval-lang-compare.png 450b1ce verified
Update README.md 3467fdb verified
Upload lang-no-backgroud.png ab2a451 verified
Update README.md 887ace8 verified
Update README.md 8f9abff verified
Update README.md 7214e55 verified
Update README.md 76d6397 verified
Rename cc-std-benchmarks.png to cc-eval-std-benchmarks.png e632201 verified
Rename langage comparison - dotted line.png to cc-eval-lang-compare.png 534d3d5 verified
Rename standard benchmarks iwth dotted linesPicture1.png to cc-std-benchmarks.png ea521b9 verified
Upload 3 files 62a2952 verified
Update README.md 6312547 verified
Update README.md 2f2a1c8 verified
Update README.md d6cd77d
Update README.md ed4ff73
Update README.md c5f8676
Update README.md 6be81f3
Upload folder using huggingface_hub bd4b02d
Update README.md c5386f2
Update README.md 99f98df
Update README.md c40be13
initial commit c0c250e
Yuqi Wang commited on