Install Theme

So: what’s the deal with Akaike information criterion vs. Bayesian information criterion?  "Information theory” and “Bayesianism” are both things with a lot of very devoted adherents and here they appear superficially to give different answers

  1. khintchine reblogged this from lambdaphagy
  2. nostalgebraist reblogged this from raginrayguns and added:
    This is all very interesting. Another property you’d want is invariance under general changes of variables, which L2...
  3. raginrayguns reblogged this from lambdaphagy and added:
    Okay, I tried to think this through a bit with L2 distance, and I think I’m dropping several levels in HabitRPG as a...
  4. lambdaphagy reblogged this from nostalgebraist and added:
    Oops, didn’t have a chance to get to this earlier. Others have already chimed in with sensible responses, but here’s...
  5. almostcoralchaos reblogged this from dataandphilosophy
  6. eolianthane reblogged this from nostalgebraist and added:
    KL (and AIC) can be put in the MML formalism pretty naturally. KL literally tells you the number of extra bits using a...
  7. dataandphilosophy reblogged this from nostalgebraist and added:
    I poked at this a while back, because my textbook introduced both with little information, and what other (unknown...
  8. epistemic-horror reblogged this from nostalgebraist and added:
    (IANA real statistician; any or all of this may be wrong)I’m not sure it’s that surprising? The AIC is derived by...
  9. vaniver reblogged this from nostalgebraist and added:
    They correspond to different priors. AIC has a bit better underlying framework (from an information theory point of...