Welcome to the new Data Sculpting Inference Forum: anyone testing this?

[Data Sculpting]

Welcome to the new Data Sculpting Inference Forum.

We're getting things organized and seeded so the board has a solid starting structure for local AI, inference, hardware, models, tools, and general discussion.

Please look around, post where it fits best, and let us know if there are sections you think should be added or adjusted.

[Data Sculpting]

What exact setup are you running? What model, what runtime, and roughly what context size?