How Many Guesses Does It Take to Crack an AI's "Random" Number?
Technical analysis of model internals useful for developers working with model security and randomization capabilities.
AI Summary
A researcher analyzed logits from open models to measure their random number generation predictability by calculating bits of entropy and guesses-to-crack metrics.
Excerpt
I read the exact answer distribution from the logits of open models, base and instruction-tuned, and turned it into bits and guesses-to-crack. The post How Many Guesses Does It Take to Crack an AI's "Random" Number? appeared first on Towards Data Science.
