Instructions to use munyew/meralion-oncology-lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use munyew/meralion-oncology-lora with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("C:/Projects/meralion-server/models/meralion_2_3b") model = PeftModel.from_pretrained(base_model, "munyew/meralion-oncology-lora") - Notebooks
- Google Colab
- Kaggle
| { | |
| "auto_map": { | |
| "AutoProcessor": "processing_meralion2.MERaLiON2Processor" | |
| }, | |
| "do_normalize": true, | |
| "fixed_speech_embeds_length": 100, | |
| "processor_class": "MERaLiON2Processor", | |
| "speech_token_index": 255999, | |
| "time_duration_limit": 300, | |
| "whisper_chunk_size": 30 | |
| } | |