Another thing. Isnt it weird how if you flip a coin 100 times and it for example does 50 heads in a row then 50 tails in a row that we could totally represent this in way less than 100
If it was 100 heads, and it always was, sure, you could save that in zero bits. If it was often 100 heads, it could be 1 bit for this special case, and a cost of one bit for all othercases. Like, the first bit is always 0 if it's not 100 heads (even this is a bit oversimplified)So you would need 1 bit if 100 heads, 101 bits if not.
