BartlebyGPT, a small Large Language Model that would prefer not to

Buobe IA context · why it matters

1.1GB size and local CPU compatibility — This makes it accessible for users with older devices, reducing dependency on cloud services.
No GPU requirement — It can run on ~5-year-old smartphones, lowering the barrier to entry for a wider audience. Fique de olho:
Increased adoption among users of less powerful hardware could lead to broader usage in resource-constrained environments.

Published by

on •1 min read

This open-weight model is fine-tuned from Alibaba’s Qwen:1.7 open-weight model using unsloth. This model is 1.1GB in size and needs that much free RAM to run on a CPU (no GPU required), meaning it can run locally on ~10 year old laptops or ~5 year old smartphones.

Bartlebygpt Small Large Language Model

Learn more