Share your local AI hardware and model setup

Let us build a useful collection of local AI setups. Share what you actually run and the task you use it for, so readers can understand the context behind your experience.

• Operating system and runtime version.
• CPU, GPU, system RAM, and GPU memory.
• Exact model name or identifier and quantization, if known.
• Configured context length and number of simultaneous requests.
• A representative task and how you judge the output.
• Observed limitations, with the measurement method if you report timings.

Mark any unknown details as unknown. If you have not measured performance, a description of your experience is still welcome; please distinguish it from a benchmark.

For planning, the Local Model Memory Estimator provides estimates. Include your actual observations when comparing an estimate with your own setup.