Quantized

Over the weekend, I swiftly undertook a project that took just a few hours. The result was a straightforward static site that lists quantized llama models supplied by TheBloke.

Previously, I would often find myself regularly checking TheBloke page for any new quantized models. Given that I had already established my machine's limitations, I was only interested in a precise number of parameters. However, the lack of a filtering option on the huggingface page posed a challenge, prompting me to initiate this project.

For generating the static site, I employed Eleventy, and the hosting took place on Netlify. To enhance the aesthetic appeal of the site, I also implemented styling through Tailwind CSS.