Qwen3.8 27B AEON Ultimate Uncensored — 4-bit MLX
This is a 4-bit MLX quantization for Apple Silicon of AEON-7/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-BF16.
Original Uncensored model made by @SpaceTimeViking , complete credit to him and all his work https://x.com/SpaceTimeViking
All model and fine-tuning credit belongs to the original author, AEON-7, and the upstream Qwen team. This repository only provides an MLX conversion and quantization for easier local use on Apple Silicon. No additional fine-tuning or intentional behavioral changes were made.
Quantization
- Format: MLX
- Quantization: 4-bit affine
- Group size: 64
- Approximate download size: 14 GB
- Intended platform: Apple Silicon macOS
- Recommended unified memory: 32 GB or more
Install
pip install -U mlx-lm
Run an interactive chat
mlx_lm.chat \
--model choppedgarlic/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-4bit-MLX \
--max-tokens 8192 \
--temp 0.6 \
--top-p 0.95
The first launch downloads the model from Hugging Face. Later launches use the local Hugging Face cache.
Run an OpenAI-compatible local server
Thinking enabled:
mlx_lm.server \
--model choppedgarlic/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-4bit-MLX \
--host 127.0.0.1 \
--port 8081 \
--max-tokens 8192 \
--temp 0.6 \
--top-p 0.95 \
--chat-template-args '{"enable_thinking":true}'
Thinking disabled:
mlx_lm.server \
--model choppedgarlic/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-4bit-MLX \
--host 127.0.0.1 \
--port 8081 \
--max-tokens 8192 \
--temp 0.6 \
--top-p 0.95 \
--chat-template-args '{"enable_thinking":false}'
The API base URL is then http://127.0.0.1:8081/v1.
Verified locally
- Text generation
- Interactive
mlx_lm.chat - Thinking and non-thinking modes
mlx_lm.serverthrough its OpenAI-compatible API- Local use through the Pi coding agent
Limitations
- This conversion is intended for Apple Silicon and requires MLX.
- The current conversion contains no
vision_configor vision preprocessor assets. Image input and image generation are not supported or claimed. - Quantization may reduce quality compared with the BF16 source model.
- The model can produce inaccurate, unsafe, or objectionable output. Validate outputs before using them in production or high-stakes settings.
- Please also read the original model card for its intended use, behavior, and limitations.
License and attribution
Released under the Apache License 2.0, matching the source repository's declared license. See LICENSE.
- Source model: AEON-7/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-BF16
- Upstream family: Qwen
- MLX conversion and quantization: choppedgarlic