Instructions to use QuantFactory/Veritas-12B-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use QuantFactory/Veritas-12B-GGUF with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="QuantFactory/Veritas-12B-GGUF") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("QuantFactory/Veritas-12B-GGUF", dtype="auto") - llama-cpp-python
How to use QuantFactory/Veritas-12B-GGUF with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="QuantFactory/Veritas-12B-GGUF", filename="Veritas-12B.Q2_K.gguf", )
llm.create_chat_completion( messages = [ { "role": "user", "content": "What is the capital of France?" } ] ) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use QuantFactory/Veritas-12B-GGUF with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf QuantFactory/Veritas-12B-GGUF:Q4_K_M # Run inference directly in the terminal: llama-cli -hf QuantFactory/Veritas-12B-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf QuantFactory/Veritas-12B-GGUF:Q4_K_M # Run inference directly in the terminal: llama-cli -hf QuantFactory/Veritas-12B-GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf QuantFactory/Veritas-12B-GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf QuantFactory/Veritas-12B-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf QuantFactory/Veritas-12B-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf QuantFactory/Veritas-12B-GGUF:Q4_K_M
Use Docker
docker model run hf.co/QuantFactory/Veritas-12B-GGUF:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use QuantFactory/Veritas-12B-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "QuantFactory/Veritas-12B-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "QuantFactory/Veritas-12B-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/QuantFactory/Veritas-12B-GGUF:Q4_K_M
- SGLang
How to use QuantFactory/Veritas-12B-GGUF with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "QuantFactory/Veritas-12B-GGUF" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "QuantFactory/Veritas-12B-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "QuantFactory/Veritas-12B-GGUF" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "QuantFactory/Veritas-12B-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Ollama
How to use QuantFactory/Veritas-12B-GGUF with Ollama:
ollama run hf.co/QuantFactory/Veritas-12B-GGUF:Q4_K_M
- Unsloth Studio new
How to use QuantFactory/Veritas-12B-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for QuantFactory/Veritas-12B-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for QuantFactory/Veritas-12B-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for QuantFactory/Veritas-12B-GGUF to start chatting
- Docker Model Runner
How to use QuantFactory/Veritas-12B-GGUF with Docker Model Runner:
docker model run hf.co/QuantFactory/Veritas-12B-GGUF:Q4_K_M
- Lemonade
How to use QuantFactory/Veritas-12B-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull QuantFactory/Veritas-12B-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.Veritas-12B-GGUF-Q4_K_M
List all available models
lemonade list
QuantFactory/Veritas-12B-GGUF
This is quantized version of soob3123/Veritas-12B created using llama.cpp
Original Model Card
Veritas-12B
"Clarity in thought, rigor in argument."
Veritas-12B emerges as a model forged in the pursuit of intellectual clarity and logical rigor. This 12B parameter model possesses superior philosophical reasoning capabilities and analytical depth, ideal for exploring complex ethical dilemmas, deconstructing arguments, and engaging in structured philosophical dialogue. Veritas-12B excels at articulating nuanced positions, identifying logical fallacies, and constructing coherent arguments grounded in reason. Expect discussions characterized by intellectual honesty, critical analysis, and a commitment to exploring ideas with precision.
⋆ Features ⋆
- ⟡ Deep Philosophical Inquiry: Facilitates in-depth exploration of complex concepts, ethical frameworks, and diverse philosophical traditions with clarity and structure.
- ⟡ Superior Logical Consistency: Maintains rigorous adherence to logical principles within arguments, identifies inconsistencies, and constructs well-reasoned chains of thought.
- ⟡ Structured Argument Analysis: Excels at deconstructing complex arguments, evaluating premises and conclusions, and articulating sophisticated critiques or defenses.
- ⟡ Nuanced Conceptual Articulation: Renders abstract ideas, subtle distinctions, and complex philosophical terminology with precision and intellectual honesty.
⋆ Limitations & Considerations ⋆
- Flourishes most in contexts demanding rigorous analysis, logical argumentation, and philosophical exploration. May not be ideal for casual conversation or purely creative/emotional expression.
- Due to its focus on analytical depth, may sometimes produce responses that are overly formal, abstract, or dense for simpler inquiries.
- Uncensored Model: Veritas-12B is completely uncensored. It may generate responses that could be considered offensive, harmful, unethical, or inappropriate. Users should exercise caution and discretion.
⋆ GGUFs ⋆
- Q4_0
- Finetuned from Gemma 3 12B QAT, Q4_0 is supposed to be as good as FP16.
Examples:
Base Gemma 3 12B
Okay, let's break down the likely meaning and context of this artwork.
What we see:
• Dense Field of Dots: The primary element is a vast grid composed entirely of colorful dots. They are fairly uniform in size and spacing.
• Man Gazing/Contemplating: A bald man, dressed casually (likely a jacket with a shoulder bag) stands facing the artwork. His posture suggests he's deeply engaged or lost in thought while viewing it.
• Clean Background: The dots are on a plain white background which makes the dots pop and emphasizes their pattern.
The Artist & Context - Yayoi Kusama (Almost Certainly!)
This is overwhelmingly likely to be an artwork by Yayoi Kusama. She's world-famous for her obsession with patterns, particularly dots, and her installations often incorporate them on a massive scale.
Here’s what we can interpret from the meaning of this work within the context of Yayoi Kusama’s artistic practices:
Possible Meanings & Interpretations:
1. Infinity and Obliteration: Kusama's art frequently explores themes of infinity, repetition, and a desire to "obliterate" the self or ego. The vast field of dots can be seen as representing this boundless nature of existence. It’s a visual embodiment of something that goes on forever, beyond human comprehension.
2. Self-Obliteration/Merging with the Universe: Kusama has spoken about her personal experiences with mental health (including hallucinations) and how patterns help her cope. For her, covering surfaces in dots can be a way to escape from herself – to dissolve into the environment and merge with something larger than herself (the universe, nature, etc.). The man looking at the work might represent someone experiencing this process of introspection or transcendence.
3. Pattern as Order/Chaos: Dots are simple shapes, but when multiplied in vast numbers, they can create a sense of order – a structured grid. However, the variety of colors and sheer density can also be overwhelming, suggesting chaos or an infinite array of possibilities. It’s the interplay between these two elements that Kusama often explores.
4. The Power of Observation: The artwork encourages the viewer to really look. The dots are initially just a pattern, but the longer you gaze at it, the more nuances you might notice—different colors, subtle variations in size/spacing. This relates to her interest in perception and how our eyes/minds interpret visual information.
5. The Individual vs. The Collective: The man standing before this immense display of dots represents an individual confronting something far larger than himself – the collective experience, the vastness of existence or a system beyond his control.
Overall Impression: This piece is evocative and contemplative. It's not about any specific narrative; it’s more about evoking feelings of awe, wonder, confusion, and perhaps even anxiety in the face of something immense and unknowable.
Veritas 12B
The artwork you’ve provided features a large-scale installation composed of numerous dots or circles arranged on what appears to be a white background. The varying colors suggest diversity and complexity while maintaining order through their repetition and pattern. This visual composition could evoke several philosophical interpretations, particularly drawing from the ideas of prominent philosophers such as Jean Baudrillard, Henri Bergson, and even some aspects of Kantian aesthetics.
1. Repetition and Meaning in Art (Henri Bergson)
French philosopher Henri Bergson emphasized duration—the continuous flow of time—as a fundamental aspect of experience. In this context, the repetition of circles might symbolize the idea that individual moments are part of an ongoing process or journey. Each dot could represent an instant or choice, collectively creating a narrative that resonates with life experiences. The artwork may encourage viewers to consider how these repeated elements accumulate into something meaningful over time—a metaphor for personal growth and identity formation as one navigates their own "duration."
2. Simulation Theory (Jean Baudrillard)
French theorist Jean Baudrillard, particularly in his work “Simulacra and Simulation,” argues that modern society has become so saturated with signs and images that reality is obscured by representations—simulations that do not correspond to an original or "real" state of affairs. The artwork could represent this concept; the dots might symbolize superficial layers of meaning that distract from deeper truths about existence. As the viewer stands before it, they are confronted with a pattern rather than substance—reflecting Baudrillard’s assertion that contemporary life is defined by hyperreality where media representations take precedence over actual lived experience.
3. The Aesthetic Experience (Immanuel Kant)
Drawing on Immanuel Kant's theory of aesthetics, the artwork could be seen as evoking pleasure through its arrangement and form rather than content. For Kant, aesthetic judgments involve a certain freedom from personal interests; thus, the viewer’s appreciation for the dots might stem more from their formal qualities—color combinations, symmetry, and repetition—rather than any narrative or symbolic representation they assign to them. The experience could be seen as transcendent, offering moments of pure aesthetic contemplation where one engages with beauty in a non-representational manner, aligning with Kant's notion that art can elevate human understanding beyond the constraints of practical considerations.
4. Individuality within Collective Identity
The presence of a solitary figure standing before this colorful background also invites reflection on individuality versus collective identity. This person might symbolize viewers grappling with their place in the vastness of existence, much like how we navigate social structures and personal narratives against larger patterns (like societal norms or cultural expectations). The dots may represent myriad possibilities, experiences, and identities that coexist but remain distinct—inviting us to ponder our own uniqueness within a framework of shared human experience.
In summary, this artwork can be interpreted through various philosophical lenses as it explores themes such as repetition, simulation, aesthetic appreciation, and individuality. By encouraging contemplation on these concepts, the piece engages viewers not only with its visual appeal but also invites them into deeper reflections about their own experiences and interpretations of meaning in a complex world.
- Downloads last month
- 130
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
Model tree for QuantFactory/Veritas-12B-GGUF
Base model
google/gemma-3-12b-pt
