Decoder
A technology podcast produced by The Verge that examines business decisions, power structures, and industry trends within the technology sector. Each episode features in-depth discussions with executives and industry figures on topics shaping the direction of tech companies and the broader industry landscape.
Timeline (last 90 days)
The decoder adds two mechanisms on top of the encoder: masked self-attention and cross-attention; masked self-attention ensures that during generation only previously produced tokens can be seen, while cross-attention allows the decoder to query the encoder's output.
Jonathan Kanter engaged in a conversation on the latest episode of the Decoder podcast about whether AI needs antitrust exemptions.
The Decoder episode is the first installment of its Business Future series.
The computation flow of a single Decoder layer is: the input vector passes through Self-Attention and Add & Norm, then through FFN and Add & Norm, producing the output vector
The current wave of tech backlash differs from previous ones in that it has shifted from localized criticism targeting individual companies to a systemic questioning of the entire tech industry's operating model (a legitimacy crisis).
All Facts (3)
The decoder adds two mechanisms on top of the encoder: masked self-attention and cross-attention; masked self-attention ensures that during generation only previously produced tokens can be seen, while cross-attention allows the decoder to query the encoder's output.
50%UnverifiedThe computation flow of a single Decoder layer is: the input vector passes through Self-Attention and Add & Norm, then through FFN and Add & Norm, producing the output vector
50%UnverifiedThe current wave of tech backlash differs from previous ones in that it has shifted from localized criticism targeting individual companies to a systemic questioning of the entire tech industry's operating model (a legitimacy crisis).
50%