Install Theme

natashajaques asked:

Hey, I just read your post about how attention relates to CNNs/RNNs, and I loved it! The intuitive explanations are so good! I was thinking about tweeting it, but I noticed you did make one slight error. Attention was first invented for machine translation, in the paper "Neural Machine Translation by Jointly Learning to Align and Translate" by Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio.

Thanks. I think that still falls under the category of “processing pairs of texts,” although you’re doing NLU for one text and NLG for the other, rather than NLU for both as in textual entailment / NLI. I realize my post does kind of make it sound like attention was invented for NLI, but in context I don’t think the distinction is very important?

Like, one of the things that makes the transformer literature less intuitive than it could be is the fact that the transformer also originated in MT, leading to the distinction between the “transformer encoder"and the "transformer decoder,” which is mostly historical baggage at this point. “Attention between different sequences” vs. “self-attention” still seems like an important distinction at the relevant level of generality, but distinctions between different types of paired-sequence tasks don’t change any of the intuition.

She translates the teachings she receives from mycelium (mushrooms), bees and stardust into useable social skills for human beings.

Tropicalesque Home-A-Wave Dog-Strings (トロピカレスク・ホームアヴェイヴ・ドッグストリングス, Toropikaresuku Hoomuaueivu Doggusutoringusu) was a vampire servant of Deathtopia Virtuoso Suicide-Master.

nimbora-nava:
“Akseli Gallen Kallela
”

nimbora-nava:

Akseli Gallen Kallela

(via myfairynuffstuff)

argumate:

kontextmaschine:

The more I interact with post-millennials the more convinced I am that the internet’s (and society’s) shift in the last decade hasn’t been about “social media” but about smartphones, that the internet isn’t even a place you go anymore but something omnipresent everyone takes with them, so there’s no experience you have in isolation cut off from the akasha.

“Grew up with a smartphone” starting to seem as significant a distinction as “grew up with the internet” was for us.

yes totally, I mean it’s a cliche that everyone is on their phones all the time and yet still everyone is on their phones all the fucking time and some people haven’t known any other world.

Occasionally I think about this in connection with an otherwise trivial memory from my adolescence.

I was on a few video game-related Internet forums as a teenager in the early-to-mid 2000s, and I was pretty heavily involved in them, but none of my IRL friends had ever been on anything like them. Since smartphones weren’t a thing, if I was at a friend’s house and wanted to check for replies to my latest post, I’d have to ask to use their computer.

I was self-conscious about this being a dorky thing to do — my friends were extremely dorky themselves, but if anything that intensified the teenage crab-bucket atmosphere — and I tried to defuse the awkwardness by lampshading it: turning “Rob has to do his forum checks” into a self-deprecating injoke as though it were some embarrassing addiction I suffered from. This was successful as far as it went, and for a time “forum check” became one of those meme-like phrases that automatically qualifies as a bit of mildly funny, mocking banter whenever anyone says it, even outside of anything otherwise resembling a joke.

Anyway, every once in a while I remember this, and think about how I’m surrounded by people doing “forum checks” whenever I’m in public, on buses, in stations and lobbies, in the middle of the sidewalk, everywhere. (This is about the mainstream rise of social media and not just smartphones, but without the smartphones there wouldn’t be the image — forum checks literally all around me, now simply one of the default human activities.)

birdblogwhichisforbirds:
“Vampire Sauce (THEORETICAL)
”

birdblogwhichisforbirds:

Vampire Sauce (THEORETICAL)

(via dagny-hashtaggart)

artist-savrasov:
“Ipatiev monastery in the winter night, 1870, Aleksey Savrasov
”

artist-savrasov:

Ipatiev monastery in the winter night, 1870, Aleksey Savrasov

nintendork:
“are ya ready kids
”

nintendork:

are ya ready kids

(via dagny-hashtaggart)

nostalgebraist:

nostalgebraist:

We predicted that individuals scoring highest on the Cautious/Social Norm Compliant scale would be significantly more likely to be members of an organized, conventional religious group, as this is consistent with genetic data associating aspects of the serotonin system with religiosity (Lorenzi et al., 2005; Ott et al., 2005) and traditionalism (Golimbet et al., 2004).

oh is that why, huh

I’m taking the personality questionnaire that this dumb study is about and

image

🤔

image

Your Hogwarts House: Female