May I draw your attention to this hilarious example of fooling an image recognition algorithm with a small patch of carefully engineered noise?
https://arxiv.org/abs/1801.02608
That's brillant. Should be usefull in the future.
@janellecshane good doggo
@janellecshane Well to be fair it looked very much like a Scotch Terrier to begin with
@janellecshane I am totally not a bot by the way
@pagrus yeah sure. I'll just need you to retake this "I'm not a robot" captcha real quick
@janellecshane um sure. I have to make a couple calls first though
@janellecshane maybe the computer is right and the second image really *is* a scotch terrier
after all, why should we trust our flawed biological eyes over a perfect machine?
@janellecshane is there somewhere documentation to make this happen ?
@marsxyz the paper in the link is open-access, so there's a start
@janellecshane doggy mcdogface?!
@janellecshane Neural nets can be really good at classifying things within the bounds of their training data, and can go completely off the handle once you leave those bounds even a little.
@janellecshane « Whoooo's a good boat ? It's you ! Yes it is ! »
@janellecshane Please make sure the self-driving cars are programmed to avoid both scotch terriers and medium-sized boats.
@rotatingskull Apparently, no guarantees.
@janellecshane I am definitely ready to give my car keys to a robot now.
@janellecshane This one where they print an actual sticker is cool as well: https://arxiv.org/abs/1712.09665
@YaLTeR Very cool! Much bigger and less noiselike sticker, but still impressive to see it really working. Also impressed that the "toasterlike" sticker was more convincing than an actual toaster.
@janellecshane TBH I hope that the folk at Cheltenham are paying attention to this; otherwise with UK budget cuts and replacement of humans by machines it won't be long before seniors end up complaining about getting speeding tickets for walking their dogs (at 6 km/h max!), or vets in Coventry [1] gets an official Notice to Mariners to bring Scottish Terriers to the Coastguard for a seaworthiness check 😆
[1] Coventry is landlocked 😉
@janellecshane Let's fill the internet with this kind of garbage.
It would be awesome to see all the algorithms fail!!
@janellecshane Adversarial training definitely going to be needed if people want to let these systems make any decision of significance without supervision. It's like SEO except you're trying to trick the algo into doing much more valuable things than give you eyeballs
@janellecshane That's why I put some slight noise on most of the images I publish and are from the real world. :)
@janellecshane This reminds me a lot of this anti-facial-recognition makeup paper that was making the rounds a while back.
@janellecshane I have recently been wondering whether or not someone has figured out how to do this for music, after Shazam incorrectly recognised a song as three separate obscure songs. Could it be possible for someone to use this to get a slice of the streams of a famous piece of music by getting their own track misrecognised as it?
@janellecshane that's more interesting is the area classification. Like bounding boxes and crazy color fills. A whole-image fooling is so 2016 tbh.
@janellecshane That's my dog!
@janellecshane We need more info about this!
@janellecshane Okay, but which is it?
@janellecshane This is why we still can't have nice things in an ML world.
@janellecshane I see no error here all I see is a scotch terier that needs petting/
@janellecshane WHY IS THERE A PICTURE OF A BOAT AND A DOG?
@brokenfingers it's a good dog, bront.
@janellecshane this is making me wonder if you could put noise squares on t-shirts or glasses or something to fuck with face recognition.
@tastytentacles I think you would need noise squares specifically tailored to the software that's looking at you. Maybe they'll discover something that's more universal.
@janellecshane yah hopefully, I find the idea of a t-shirt that causes every CCTV camera to categorise you as a small dog really funny.
kinda like the watch dogs balaclava that never made any sense to me.
@tastytentacles Yes, hilarious sci-fi story potential. I have serious plans to write a story along these lines.
@janellecshane would love to read it if you ever release it.
@janellecshane computers are fuckin shit