VectorHack

Machine learning news and insights


Import AI 219: Climate change and function approximation; Access Now leaves PAI; LSTMs are smarter than they seem

jack-clark.net 1d

LSTMs: Smarter than they appear:…Turns out you don’t need to use a Transformer to develop rich, combinatorial representations…Long Short-Term Memory networks are one of the widely-used deep learning architectures. Until recently, if you wanted to develop sophisticated natural language understanding AI systems, you’d use an LSTM. Then in the past couple of years, people have started switching over to using...




Import AI 218: Testing bias with CrowS; how Africans are building a domestic NLP community; COVID becomes a surveillance excuse

jack-clark.net 7d

Can Africa build its own thriving NLP community? The Masakhane community suggests the answer is ‘yes’:…AKA: Here’s what it takes to bootstrap low-resource language research…Africa has an AI problem. Specifically, Africa contains a variety of languages, some of which are broadly un-digitized, but spoken by millions of native speakers. In our new era of AI, this is a problem: if...




Import AI 217: Deepfaked congressmen and deepfaked kids; steering GPT3 with GeDi; Amazon’s robots versus its humans

jack-clark.net 15d

Amazon funds AI research center at Columbia:Amazon is giving Columbia University $1 million  a year for a new research center, for the next five years. Investments like this typically function as:a) a downpayment on future graduates, which Amazon will likely gain some privileged recruiting opportunities toward.b) a PR/Policy branding play, so when people say ‘hey why are you hiring everyone...
















Import AI 213: DeepFakes can lipsync now; plus hiding military gear with adversarial examples.

jack-clark.net on 7 September

Facebook wants people to use differential privacy, so Facebook has made the technology faster:…Opacus; software that deals with the speed-problem of differential privacy…Facebook has released Opacus, a software library for training PyTorch models with a privacy-preserving technology called Differential Privacy (DP). The library is fast, integrated with PyTorch (so inherently quite usable), and is being used by one of the...