If you know what a user is gonna do next, you can prefill your KV cache with candidate contexts and significantly improve your time-to-first-token. The Interaction I was revisiting an interaction idea I had a bit ago- if we have a great mod…
Is ice cream one word? Two? Listen to a radio show on linguistics/NLP/random fun facts to learn more? I’m thinking of starting a live radio show on random fun facts. I need to pitch it to a program director at WREK (GT’s radio station), so
I’ve been getting some great questions about undergrad research at Georgia Tech :) Here are some generalized (and very opinionated) tips. A quick heads up: most of these opinions are reflective of undergraduate computer science research at