zzkt + sound   35

Introducing Chromaprint
Many ideas were based on a paper by Yan Ke, Derek Hoiem, and Rahul Sukthankar called "Computer Vision for Music Identification" (2005). In fact, even the Last.fm fingerprinter uses the code published by the authors of this paper. This is where I learned that audio identification is more about machine learning that it is about DSP. Many useful methods for extracting interesting features from audio streams are well-known and the problem is more about how to apply and index them the best way. The basic idea here is to treat audio as a spectral image and index the content of the image. I'll explain this in more detail and how Chromaprint uses this in a following post.

Another important paper for me was "Pairwise Boosted Audio Fingerprint" (2009) by Dalwon Jang, Chang D. Yoo, Sunil Lee, Sungwoong Kim and Ton Kalker (Ton Kalker is a co-author of a historically important paper "Robust Audio Hashing for Content Identification" (2001) published by Philips Research), which combined previous experiments of the authors with audio identification based on spectral centroid features and the indexing approach similar to the one suggested by Y. Ke, D. Hoiem and R. Sukthankar. For a long time this was the best solution I had and since it was actually not very hard to implement, the most time I spent on tweaking the configuration to get the best results.

The last major change came after I learned about "chroma" features by reading the "Efficient Index-Based Audio Matching" (2008) by Frank Kurth and Meinard Müller. I've read more papers about chroma features later, but this was the first and also the most important one for me and some ideas about processing the feature vectors from it are implemented in Chromaprint. Chroma features are typically used for music identification, as opposed to audio file identification, but I tried to use them with the approach I already had implemented and it nicely improved the quality of the fingerprinting function and actually reduced complexity which allowed me to use much larger training data sets.
Chromaprint  audio  sound  AV  CV  ML  audio-matching  spectral  chroma  FLOSS  2010 
june 2019 by zzkt
A Sound You Can't Unhear (and What It Says About Your Brain)
She starts with a clip that's been digitally altered to sound like jibberish. On first listen, to my ears, it was entirely meaningless. Next, Das plays the original, unaltered clip: a woman's voice saying, "The Constitution Center is at the next stop." Then we hear the jibberish clip again, and woven inside what had sounded like nonsense, we hear "The Constitution Center is at the next stop."

The point is: When our brains know what to expect to hear, they do, even if, in reality, it is impossible. Not one person could decipher that clip without knowing what they were hearing, but with the prompt, it's impossible not to hear the message in the jibberish.

This is a wonderful audio illusion.
audio  perception  audio-illusion  sound  jibberish  pattern  noise 
january 2019 by zzkt
The Sound That Haunted Diplomats in Cuba? Crickets
These noises sound strange, unnatural, and even mechanical because most of us have absolutely no idea what the vast majority of animals sound like. Here, for example, are some lynx that (starting about 40 seconds in) wail like drunk banshees.
sound  noise  animals  nature  archive  acoustic-ecology 
january 2019 by zzkt
Hempton went on to make a vocation of listening. He discovered that the use of a microphone turned him into a better listener, because he learned to take his cue from that tool, which didn’t judge the relative value of the different sounds it was absorbing. Having always in the past striven to listen for the “important” sounds, Hempton stopped trying to prioritize based on his own limited perspective and discovered the majesty of the uncurated soundscape.

In beginning to hear without privileging certain sounds over others, he found that every place on earth has a unique sonic character. But, intriguingly, Hempton defines his different experiences of geographically specific auditory signatures as experiences of silence, which he calls the “poetics of space.”
sound  silence  acoustic-ecology  field-recording  listening  noise-pollution  Gordon-Hempton  Emergence 
january 2019 by zzkt
The Mystery of the Havana Syndrome
Between December 30, 2016, and February 9, 2017, at least three C.I.A. officers working under diplomatic cover in Cuba had reported troubling sensations that seemed to leave serious injuries. When the agency sent reinforcements to Havana, at least two of them were afflicted as well.

All the victims described being bombarded by waves of pressure in their heads. Unlike Lee, though, the C.I.A. officers said that they heard loud sounds, similar to cicadas, which seemed to follow them from one room to another. But when they opened an outside door the sounds abruptly stopped. Some of the victims said that it felt as if they were standing in an invisible beam of energy.
Havana-Syndrome  Cuba  CIA  sonic-weapons  sound  brain-damage  2016  2017  2018 
november 2018 by zzkt
Deep Learning Techniques for Music Generation
This book is a survey and an analysis of different ways of using deep learning (deep artificial neural networks) to generate musical content. At first, we propose a methodology based on four dimensions for our analysis: - objective - What musical content is to be generated? (e.g., melody, accompaniment...); - representation - What are the information formats used for the corpus and for the expected generated output? (e.g., MIDI, piano roll, text...); - architecture - What type of deep neural network is to be used? (e.g., recurrent network, autoencoder, generative adversarial networks...); - strategy - How to model and control the process of generation (e.g., direct feedforward, sampling, unit selection...). For each dimension, we conduct a comparative analysis of various models and techniques. For the strategy dimension, we propose some tentative typology of possible approaches and mechanisms. This classification is bottom-up, based on the analysis of many existing deep-learning based systems for music generation, which are described in this book
arxiv  music  sound  generative  machine-learning  deep-learning 
september 2017 by zzkt
Mika Vainio's quiet influence on electronic music was deafening | Music | The Guardian
Vainio’s influence on ambient and industrial electronic music was somewhat unspoken in his lifetime. He was not a figurehead of a scene, but pretty much all booming palettes of mechanical sound being made today nod in some way to Vainio and his work with Pan Sonic [...] Vainio’s beats weren’t beats at all, they were the sound and feeling of a black hole opening up in the centre of your chest.[...] like “flares, vapour trails, LEDs, neon tubes close to death, heart murmurs, apertures opening and closing in cement walls, tiny mechanised guillotines snipping the heads from tin soldiers, sheets of led unfurling in underground car parks”.
Mika-Vainio  panasonic  sound  music  noise  2017  eulogy 
april 2017 by zzkt
This Is What Jupiter Sounds Like
Scientists have long known that Jupiter is noisy: The planet produces intense radio storms powered by interactions between the planet and its moons, not to mention the wild gases at play on the planet itself. But they didn’t realize that Juno’s entry into Jupiter’s orbit would produce such complex data.

“While this transition from the solar wind into the magnetosphere was predicted to occur at some point in time,” the agency writes in the blog post, “the structure of the boundary between those two regions proved to be unexpectedly complex, with different instruments reporting unusual signatures both before and after the nominal crossing.”
jupiter  Juno  NASA  sound  radio  electromagnetics  magnetosphere 
july 2016 by zzkt
Cross-linguistic onomatopoeias
Because of the nature of onomatopoeia, there are many words which show a similar pronunciation in the languages of the world.
language  noise  sound  onomatopoeia  wikipedia  list 
may 2016 by zzkt
The singing comet
But one observation has taken the RPC scientists somewhat by surprise. The comet seems to be emitting a ‘song’ in the form of oscillations in the magnetic field in the comet’s environment. It is being sung at 40-50 millihertz, far below human hearing, which typically picks up sound between 20 Hz and 20 kHz. To make the music audible to the human ear, the frequencies have been increased by a factor of about 10,000.
67p  rosetta  comet  comet  song  ESA  space  sound 
november 2014 by zzkt
Supersonic Stereo
The sonic boom would be the first thing the target would hear. It would be followed by several sounds played over one another, including both reversed music (rising slightly in pitch as it fades out) and forward-playing music (which would play at half speed and an octave too low), followed by the crash of a stereo demolishing your neighbor’s shed.
sound  supersonic  audio 
march 2013 by zzkt
'A great silence is spreading over the natural world'
"A great silence is spreading over the natural world even as the sound of man is becoming deafening," he writes in a new book, The Great Animal Orchestra. "Little by little the vast orchestra of life, the chorus of the natural world, is in the process of being quietened. There has been a massive decrease in the density and diversity of key vocal creatures, both large and small. The sense of desolation extends beyond mere silence.
environment  sound  silence  ecology  environment  ambient 
january 2013 by zzkt
The Soviet synthesizer that bridged occultism and electronic music - Boing Boing
The Russian avant garde was far ahead of the West in the development of electronic instruments. Leon Theremin, inventor of the first mass produced electronic instrument, is the best remembered experimenter of this period. The Theremin synthesizes motion and sound the same way the ANS sythesizes images and sound. But his eponymous instrument was hardly Theremin's only experiment. "Theremin worked on countless projects, striving to bring music, light, movement, smell and touch together in a single technology," Smirnov and Pchelkina wrote. Scriabin would have been proud.
ANS  Theremin  coil  occult  synaesthesia  history  synthesizer  sound  music  russia  synth 
july 2012 by zzkt
What you're hearing is the way 20th century technology tunneled through a 19th century network
Of all the noises that my children will not understand, the one that is nearest to my heart is not from a song or a television show or a jingle. It's the sound of a modem connecting with another modem across the repurposed telephone infrastructure. It was the noise of being part of the beginning of the Internet.
digital  analogue  audio  noise  history  technology  sound  modem 
june 2012 by zzkt
Neil Harbisson – the cyborg
I decided that using Neil’s existing senses as a host for new artificial senses would be an effective approach. By using sound, I felt that it would give him a good approximation of colour as he has very good pitch perception as he is a keen musician. I was confident that shifting colour into sound would be an appropriate and effective way of re-mapping Neil’s brain, as the natural occurrence of synesthesia seems to suggest that the visual and auditory senses can in some case become overlapping.
extended  sense  synaesthesia  sound  colour  neil  harbisson  technolgy  eyeborg  cyborg 
february 2012 by zzkt
Today's formulaic music.
Discover bytebeat. A new genre of algorithmic music has been developed by demoscene coder viznut, a.k.a. PwP. Sharing genes with chiptunes and facilitated by bitwise operators, bytebeats are decidedly non-traditional music created by short, programmatic formulas. Read about computationally minimal art, the aesthetic that spawned bytebeat. Try your hand at composing (some helpful examples). Read an explanation of how the formulas work.
sound  demoscene  bytebeat  chiptunes  algorithmic  music  livecoding  sythesis  software  music 
january 2012 by zzkt
CymaScope :: Sound Made Visible
The CymaScope is a new type of scientific instrument that makes sound visible. Its development began in 2002, with a prototype that featured a thin, circular, P.V.C. membrane; later we used latex. Fine particulate matter was used as the revealing media. However, it was soon discovered that far greater detail could be obtained by imprinting sonic vibrations on the surface of ultra pure water. The surface tension of water has high flexibility and fast response to imposed vibrations, even with transients as short-lived as a few milliseconds.
sonification  truth-is-stranger-than-fiction  sound  communication  dolphins 
december 2011 by zzkt
Sound recordings: The sound of silence
The American rules infuriate scholars, archivists, musicians and the conservationists who preserve fragile recordings. They fret that by the time the recordings become available, many will be beyond salvation. Some wax cylinders and discs, metal tape, vinyl records and other formats have already begun disintegrating or are slag. The permission to disseminate material—at least for academic use and licensing—could lead to more money for its conservation. As things stand, some institutions are chary about digitising works for fear of potential liability.
recording  copyright  copywrong  publishing  music  sound 
june 2011 by zzkt
Characteristics of Musical Keys
This document contains a selection of information from the Internet about the emotion or mood associated with musical keys. It is not complete nor does it include information found only in print sources.
music  emotion  sound  occident  history  pitch 
may 2011 by zzkt
Project Moonbase
The Historic Sound of the Future
music  sound  future  atemporality  moonbase 
april 2011 by zzkt
Ne-ton | That's not the way to do business: Ne-ton (Non-tone) is an independent music label that focuses on free music in the broadest sense of the term. It encompasses various music genres such as: noise, different kinds of free-form improvisation, ambient, home-made cut&paste experiments, HC hip-hop, and so on, and on, and on. Ne-ton dwells in the parallel world of underground culture. Through the cooperation with artists and labels with a similar approach to music, we celebrate free music as the principle that breaks boundaries.
music  label  sound  noise  serbia 
october 2010 by zzkt
In search of Belgrade’s sonic underbelly
Belgrade is not a polished, shiny city like Prague, it still retains its rawness and Balkanic chaos. Theoretically, cities like these - as is/was the case with all your Berlins - are usually bustling with creativity and have a strong music scene. Somehow, this, admittedly cliched assumption, didn’t actualize with the Serbian capital.
music  belgrade  serbia  noise  sound  soundart  osteuropa 
october 2010 by zzkt
Useful Resources | Isophonics
This page contains links for some useful resources collected for the Music Hack Day - London 2010
sound  audio  music  music-hack-day  computer-music  software 
september 2010 by zzkt

related tags

67p  acoustic-ecology  alfred  algorithmic  ambient  analogue  animals  ANS  archive  art  arxiv  astronomy  atemporality  audio  audio-illusion  audio-matching  AV  belgrade  blog  bloop  brain-damage  bytebeat  china  chiptunes  chris  chroma  Chromaprint  CIA  coil  colour  comet  communication  computer-music  copyright  copywrong  Cuba  CV  cyborg  deep-learning  demoscene  design  digital  disney  dolphins  ecology  electromagnetics  Emergence  emotion  environment  ESA  eulogy  experience  extended  eyeborg  fft  field-recording  FLOSS  fm  future  generative  Gordon-Hempton  hadfield  harbisson  Havana-Syndrome  history  interactive  interviews  ISS  jarry  jibberish  Juno  jupiter  label  language  lisp  list  listening  livecoding  machine-learning  magnetosphere  mathematics  Mika-Vainio  ML  modem  moonbase  mugabes-lunch  music  music-hack-day  mystery  NASA  nature  neil  nigeria  noise  noise-pollution  occident  occult  ocean  onomatopoeia  orbit  osteuropa  panasonic  pataphysics  pattern  perception  pitch  planet  planets  programming  publishing  radio  recording  resources  rosetta  russia  sc3  sense  serbia  silence  software  solar  solarbeat  solarsystem  song  sonic-weapons  sonification  sound  soundart  soundscape  space  spectral  station  supercollider  supersonic  synaesthesia  synth  synthesis  synthesizer  sythesis  technolgy  technology  Theremin  thx  time  topology  truth-is-stranger-than-fiction  ubuweb  unidentified  visualisation  visualization  wikipedia 

Copy this bookmark: