VectorHack

Machine learning news and insights

research

eng

product

threads

press

Import AI 234: Pre-training with fractals; compute&countries; GANS for good

jack-clark.net 3d

Where we’re going we don’t need data – we’ll pre-train on FRACTALS!!!!…This research technique is straight out of a Baudrillard notebook…In Simulacra and Simulation by French philosopher Jean Baudrillard, he argues that human society has become reliant on simulations of reality, with us trafficking in abstractions – international finance, televised wars – that feel in some way more real than...
Import AI 233: AI needs AI designers; estimating COVID risk with AI; the dreams of an old computer programmer.

jack-clark.net 10d

Facebook trains a COVID-risk-estimating X-ray image analysis system:…Collaboration with NYU yields a COVID-spotting AI model…Facebook has worked with NYU to analyze chest X-rays from people with COVID and has created an AI system that can roughly estimate risks for different people. One of the things this work sheds light on is the different amounts of data we need for training...
Import AI 232: Google trains a trillion parameter model; South Korean chatbot blows up; AI doesn’t use as much electricity as you think

jack-clark.net 17d

Uh-oh, Parler is about to step on a big ‘ol algorithm rake:…CEO says algorithms can filter hate speech. Good luck with that!…Parler, the social network used by far right activists and subsequently pulled offline due to failing to meet T&Cs from a variety of infrastructure services (including Amazon Web Services), has a plan to come back: it’s going to use...
Import AI 231: US army builds nightvision facial recognition; 800GB of text for training GPT-3 models; fighting COVID with a mask detector

jack-clark.net 24d

Fighting COVID with a janky mask detector:…It’s getting really, really easy to homebrew surveillance tech…Researchers with Texas A&M university, the University of Wisconsin-Milwaukee, and the State University of New York at Binghamtom, have built a basic AI model that can detect whether construction site workers are wearing COVID masks or not. The model itself is super basic – they finetune...
Import AI 230: SuperGLUE solved (uh oh!); Graphcore raises $222m; spotting malware with SOREL

jack-clark.net on 4 January

Finally – the US government passes a bunch of AI legislation:…Senate and the House overall POTUS veto; NDAA passes…The US government is finally getting serious about artificial intelligence, thanks to the passing of the NDAA – a mammoth military funding bill that includes a ton of different bits of AI legislation within itself. There’s a rundown of the contents of...
Import AI 229: Apple builds a Hypersim dataset; ways to attack ML; Google censors its research

jack-clark.net on 28 December

Apple builds Hypersim, a dataset to help it understand your house:…High-resolution synthetic scenes = fuel for machine learning algorithms…Apple has built Hypersim, a dataset of high-resolution synthetic scenes with per-pixel labels. Hypersim consists of 77,400 images spread across 461 distinct indoor scenes; Apple bought the synthetic scenes from artists, then built a rendering pipeline to help it generate lots of...
Import AI 228: Alibaba uses AI to spot knockoff brands; China might encode military messages into synthetic whale songs; what 36 experts think is needed for fair AI in India

jack-clark.net on 21 December

China might be using AI to synthesize whale songs for its military:…The future of warfare: whalesong steganography…China has been trying to synthesize the sounds of whales and dolphins, potentially as a way to encode secret messages to direct submarines and other submersible machines, according to a somewhat speculative article in Hakai Magazine.“Modern technological advances in sensors and computing have allowed...
Import AI 226: AlphaFold; a Chinese GPT2; Timnit Gebru leaves Google

jack-clark.net on 7 December

DeepMind cracks the protein folding problem:…AlphaFold’s protein structure predictions start to match reality…AlphaFold, a system built by DeepMind to predict the structures of proteins, has done astonishingly well at the Critical Assessment of protein Structure Prediction (CASP) competition. AlphaFold’s “predictions have an average error (RMSD) of approximately 1.6 Angstroms, which is comparable to the width of an atom (or 0.1...