Data Sculpting
Inference
Local AI
•
Hardware
•
Models
•
Optimization
•
Community
Portal
Search
Member List
Calendar
Help
Hello There, Guest!
Login
Register
Login
Username:
Password:
Lost Password?
Remember me
Sign in with X.com
Inference
›
Announcements
Forum Announcements
Users browsing this forum: 1 Guest(s)
Mark this forum read
Forum Announcements
Thread
/
Author
Replies
Views
Rating
Last Post
[
asc
]
Important Threads
New theme updated, we hope you like it
Data Sculpting
,
08-20-2026, 07:26 AM
9
241
0 Vote(s) - 0 out of 5 in Average
08-30-2026, 11:16 PM
Last Post
:
dockbrook21
Welcome to the new Data Sculpting Inference Forum!
Data Sculpting
,
08-20-2026, 04:53 PM
0
79
0 Vote(s) - 0 out of 5 in Average
08-20-2026, 04:53 PM
Last Post
:
Data Sculpting
Normal Threads
Welcome to the new Data Sculpting Inference Forum: anyone testing this?
Data Sculpting
,
10-12-2026, 12:40 AM
1
103
0 Vote(s) - 0 out of 5 in Average
10-12-2026, 02:24 AM
Last Post
:
Data Sculpting
A quick note about forum organization for Qwen
(Pages:
1
2
)
macropoint
,
10-02-2026, 06:52 AM
14
311
0 Vote(s) - 0 out of 5 in Average
10-10-2026, 07:00 PM
Last Post
:
audioriver
A quick note about forum organization with TensorRT-LLM
(Pages:
1
2
)
Data Sculpting
,
10-06-2026, 03:59 PM
10
239
0 Vote(s) - 0 out of 5 in Average
10-10-2026, 01:43 AM
Last Post
:
batchsize
Please keep off topic stuff in the Off Topic forum
(Pages:
1
2
)
Data Sculpting
,
08-31-2026, 09:47 PM
13
310
0 Vote(s) - 0 out of 5 in Average
09-05-2026, 02:23 AM
Last Post
:
fastscope
A quick note about forum organization
(Pages:
1
2
)
Data Sculpting
,
08-22-2026, 12:03 AM
12
280
0 Vote(s) - 0 out of 5 in Average
08-29-2026, 06:27 PM
Last Post
:
Data Sculpting
Please keep off topic stuff in the Off Topic forum
(Pages:
1
2
)
Data Sculpting
,
08-20-2026, 10:39 AM
12
274
0 Vote(s) - 0 out of 5 in Average
08-26-2026, 08:19 PM
Last Post
:
Data Sculpting
Sort by: Subject
Sort by: Last Post
Sort by: Author
Sort by: Creation Time
Sort by: Rating
Sort by: Replies
Sort by: Views
Order: Ascending
Order: Descending
From: Today
From: 5 Days Ago
From: 10 Days Ago
From: 20 Days Ago
From: 50 Days Ago
From: 75 Days Ago
From: 100 Days Ago
From: The Last Year
From: The Beginning
New Posts
Hot Thread (New)
Hot Thread (No New)
No New Posts
Contains Posts by You
Closed Thread
Search this Forum:
Forum Jump:
Private Messages
User Control Panel
Who's Online
Search
Forum Home
Announcements
-- Forum Announcements
-- Community Announcements
Hardware
-- GPUs
-- Systems & Builds
-- CPUs / NPUs / Accelerators
Drivers / Frameworks / Toolkits
-- NVIDIA / CUDA
-- AMD / ROCm
-- Apple / MLX
-- PyTorch / JAX / Other Frameworks
Inference Engines
-- llama.cpp / GGUF
-- vLLM / SGLang
-- TensorRT-LLM
-- Ollama / LM Studio / Desktop Runtimes
-- Other Engines
Optimization & Performance
-- Quantization
-- Context / KV Cache
-- Performance Tuning
-- Benchmarks
Harnesses, Agents & Orchestration
-- Agents
-- Routers
-- MCP / APIs / Tool Calling
-- Workflows / Automation
LLM Models
-- Proprietary / Frontier
-- Open Weight
---- Hosted
---- Local
---- Recipes & Configurations
-- Embedding / Reranking Models
Training & Customization
-- Fine-Tuning / LoRA
-- Distillation
-- Dataset Creation / Curation
-- Model Merging
RAG & Knowledge Systems
-- RAG
-- Embeddings
-- Vector Databases
-- Search / Retrieval / Reranking
Prompting & Context Engineering
-- Prompts / System Prompts
-- Structured Output
-- Long Context / Memory
Evaluation & Testing
-- Benchmarks
-- Evals
-- Model Comparisons
-- Quality / Reliability Testing
Generative AI
-- Image
-- Video
-- Audio / Speech
-- Multimodal
Apps / Utilities / Tools
-- Online / Hosted
-- Local
Edge AI & Gadgets
-- Mobile
-- SBCs / Mini PCs
-- AI Devices
Security, Privacy & Safety
-- Local Privacy
-- Model / Agent Security
-- Sandboxing
Miscellaneous Discussion
-- General
-- News & Industry
-- Off Topic