TLDR AI · DEEP DIVES & ANALYSIS
I TRIED TO MAKE AI WRITING SOUND HUMAN BY BANNING AI WORDS THROUGH LOGIT_BIAS
Summary from the TLDR AI newsletter
logit_bias is an API setting that changes how likely a model is to select specific tokens. A researcher created a blacklist of words, converted the words into token IDs, and assigned those IDs a negative value to try to reduce the chances of a model using those words at an API level. This didn't work - it just made it harder for the model to select the next token, making resulting sentences sometimes look like they came from a less capable model.