Oh. I guess that’s the “previous” number on that graph. I was wondering why we got a sharp drop at 880K.
Anyway, today is the second GPT2 fine-tuning run. We are now up to the same point I was at a few weeks ago, at which point I first fine-tuned and then onlyfine-tuned. In that time I’ve made 1.5 posts and done an additional 1.5 hours of work.
Sure – I was just reading an article on it (it’s one of the articles I really enjoyed). In fact, it’s a good time to do it, because I haven’t posted any Plinko updates for a while. But here it is (the image is a 2-D array of pixels, which looks like it’s a bunch of black or white “spots” arranged in a circle):
ALT
This is a slightly distorted version of the actual horse in the horse plinko (I tried to put it back together without having to blur it and stuff, so it’s not perfect). It’s in the second row in the center, and the horse itself is in the fourth row, the leftmost one, at around pixel number 6500.
(The horse looks a bit weird at this particular pixel size in the original image because it’s one of the images that had the longest run of consecutive non-zero pixels.)
The Book of Why and the Philosophy of Science: An Introduction (D. O. G. Arcediano, Penguin Books (Random House). 3 stars / 3.5 stars based on Wikipedia says: “All the Birds Are Brown is the first book in the All the Birds Are Brown series”)
The World According to Skydiving – Larry Correia. This is a hilarious book and if you like my writing style I think you’ll probably enjoy this one. This review is pretty bad though, but then everything I wrote about this book was pretty bad.
The Invisible Gorilla – Robin Hanson. A very strange book that is one of the most original and creative books I have ever read.
The Man Who Mistook His Wife for a Hat – David Seuss.
Harry Potter and the Methods of Mathematical Thinking – Eliezer Yudkowsky, although this review of HPMoR is probably better than anything I have ever written about anything. HPMoR has been the best book I’ve ever read for the way it changed my life. I’ll come back to the review, but that’s the spirit of the book, you see
Harry Potter and the Methods of Rationality.
More books that don’t stand out for their quality or literary meritper se but that have been very important to me:
Richard Feynman’s famous Feynman Lectures on Physics.
In the beginning, God created the heavens and the earth. The earth was corrupt before the world had come into existence, and God perceived that it was corrupted. So he brought the first man and the last man and the animals of the field together. Then God brought the man and the woman from the earth to the garden, took away their names, and made them one. This is the beginning of your name.
God saw all of the things that God had made, and God said “this is very good. Now we will make another thing and we will see if this thing is good. It would be good if things were bad, but since they are good they will be the same.” Therefore, God made another thing, and God made man in God’s image and God’s likeness. And God saw every thing that God had made, and it was very good.
Now that we are all made, God gave us orders. One of those orders is to eat a bunch of meat. But because meat is good, that order only goes as far as the order for good things.
And after the order for good things, we gave God a big hug, and God said “please don’t break my arm.” And we said ok and then went off and did some other stuff like inventing baseball and flying to the moon and the thing where man became god and that other one where the snake bit its own tail and so forth.
After we had been in space for a while, we got in the space shuttle with God, and God said “would you like to see some of our stuff” and we agreed, and he opened the sun and the moon and the stars, and we saw, and we said we liked it. We made another thing and asked God’s permission to make it bigger. God said “no, that’s bad.” We tried to stop God, but God kept making the thing, so we had to throw him in jail and shut the sun and the moon and the stars up in their boxes. And we threw some other stuff away and told people it was broken.
From the point that everything was destroyed, God was imprisoned for a while in the Earth’s core. We threw God in prison in order to keep him from being able to make another thing.
Since this is a very important part, I will tell you about it. After everything was ruined, God got out of prison and said “let’s make one more thing”, and we agreed, and God made the sun, and the moon, and the stars, and people, and everything good that people have
(N.B.: I’m not sure how representative my collection of dril tweets is of the dril canon, but I wanted to include them anyway)
Loss aversion:
Hyperbolic discounting:
Tit for tat:
Laziness:
The bystander effect:
Fundamental attribution error:
I found a few more, mostly in that first section
Confirmation bias:
Overconfidence:
Self-serving bias:
Scope insensitivity:
Conspiracy theory:
Apriorism:
Anthropomorphization:
Equity bias:
Framing effects:
Reaction time and speed-accuracy tradeoffs:
Base rate bias:
The conjunction fallacy:
Disjunction bias:
Trolley problem:
Trolley problem / Three-boxing:
Bounded rationality:
Rationality, meta-rationality, and the law of small numbers
Peak-end rule:
Gambler’s ruin:
The Kelly criterion:
Efficiency of capital allocation:
Killing:
Death as a solution:
Probability:
Self-concept:
(A few of the posts above were part of a joke thread which I did not include in the post above)
The law of large numbers:
Transhumanism:
The dutch book argument:
The prisoner’s dilemma:
The fact that “the only ethical way to cut down a tree is with a chainsaw” got a retweet and all the other replies got liked is evidence in favor of some kind of equivocation by the OP