robertogreco + input   39

The iPad as a fast, precise tool for creativity – UX Collective
"Using these five premises, we built the prototype app as follows:

1. Stylus required: We take advantage of everything at the disposal of the average human: two hands (including ten individual fingers) and the stylus as distinct input methods, sometimes used in tandem.

2. Put your hands all over it: Dossier has almost zero chrome, allowing the user’s content to occupy the entire screen, and very few buttons activated by a single tap.

3. No-wait commands: Nothing in the Dossier command vocabulary requires long-press or other delay. The common operation of moving a card via one-finger drag responds instantly, metaphorically like sliding index cards around on a table.

4. Read the manual: Dossier has a cheatsheet available in the main menu which describes the full palette of commands available to the user.

All of this comes together with point 5, the command vocabulary. Commands such as copy, paste, and delete (normally hidden behind long-press context menus on mobile applications) are available by drawing a glyph with your stylus. We recognize glyphs using the $1 Unistroke recognizer as implemented in Swift."

[video: ]

[See also: ]
ipad  ipadpro  creativity  applications  ui  ux  glyphs  input  stylus  2018  juliaroggatz  milošmilikić  adamwiggins 
july 2018 by robertogreco
The Steam Controller: An Analysis - Part 1 - YouTube
"This full length feature documentary explores the origins of the Steam Controller, the complication of controller usage, and the importance the Steam Controller and its software has on gaming as a whole."

[Part 2: ]

[via: "This Steam Controller analysis may make you rethink Valve’s PC gamepad" ]
steamcontoller  input  gamecontrollers  videogames  games  gaming  2017  jamesminicki 
october 2017 by robertogreco
Your Camera Wants to Kill the Keyboard | WIRED
"SNAPCHAT KNEW IT from the start, but in recent months Google and Facebook have all but confirmed it: The keyboard, slowly but surely, is fading into obscurity.

Last week at Google’s annual developer conference, the company presented its vision for how it expects its users—more than a billion people—to interact with technology in the coming years. And for the most part, it didn’t involve typing into a search box. Instead, Google’s brass spent its time onstage touting the company’s speech recognition skills and showing off Google Lens, a new computer vision technology that essentially turns your phone’s camera into a search engine.

Technology has once again reached an inflection point. For years, smartphones relied on hardware keyboards, a holdover from the early days of cell phones. Then came multitouch. Spurred by the wonders of the first smartphone screens, people swiped, typed, and pinched. Now, the way we engage with our phones is changing once again thanks to AI. Snapping a photo works as well, if not better, than writing a descriptive sentence in a search box. Casually chatting with Google Assistant, the company’s omnipresent virtual helper, gets results as fast, if not faster, than opening Chrome and navigating from there. The upshot, as Google CEO Sundar Pichai explained, is that we’re increasingly interacting with our computers in more natural and emotive ways, which could mean using your keyboard a lot less.

Ask the people who build your technology, and they’ll tell you: The camera is the new keyboard. The catchy phrase is becoming something of an industry-wide mantra to describe the constant march toward more visual forms of communication. Just look at Snapchat. The company bet its business on the fact that people would rather trade pictures than strings of words. The idea proved so compelling that Facebook and Instagram unabashedly developed their own versions of the feature. “The camera has already become a pervasive form of communication,” says Roman Kalantari, the head creative technologist at the design studio Fjord. “But what’s the next step after that?”

For Facebook and Snapchat, it was fun-house mirror effects and goofy augmented reality overlays—ways of building on top of photos that you simply can’t with text. Meanwhile, Google took a decidedly more utilitarian approach with Lens, turning the camera into an input device much like the keyboard itself. Point your camera at a tree, and it’ll tell you the variety. Snap a pic of the new restaurant on your block, and it’ll pull up the menu and hours, even help you book a reservation. Perhaps the single most effective demonstration of the technology was also its dullest—focus the lens on a router’s SKU and password, and Google’s image recognition will scan the information, pass it along to your Android phone, and automatically log you into the network.

This simplicity is a big deal. No longer does finding information require typing into a search box. Suddenly the world, in all its complexity, can be understood just by aiming your camera at something. Google isn’t the only company buying into this vision of the future. Amazon’s Fire Phone from 2014 enabled image-based search, which meant you could point the camera at a book or a box of cereal and have the item shipped to you instantly via Amazon Prime. Earlier this year, Pinterest launched the beta version of Lens, a tool that allows users to take a photo of an object in the real world and surface related objects on the Pinterest platform. “We’re getting to the point where using your camera to discover new ideas is as fast and easy as typing,” says Albert Pereta, a creative lead at Pinterest, who led the development at Lens.

Translation: Words can be hard, and it often works better to show than to tell. It’s easier to find the mid-century modern chair with a mahogany leather seat you’re looking for when you can share what it looks like, rather than typing a string of precise keywords. “With a camera, you can complete the task by taking a photo or video of the thing,” explains Gierad Laput, who studies human computer interaction at Carnegie Mellon. “Whereas with a keyboard, you complete this task by typing a description of the thing. You have to come up with the right description and type them accordingly.”

The caveat, of course, is that the image recognition needs to be accurate in order to work. You have agency when you type something into a search box—you can delete, revise, retype. But with a camera, the devices decides what you’re looking at and, even more crucially, assumes what information you want to see in return. The good (or potentially creepy) news is that with every photo taken, search query typed, and command spoken, Google learns more about you, which means over time your results grow increasingly accurate. With its deep trove of knowledge in hand, Google seems determined to smooth out the remaining rough edges of technology. It’ll probably still be a while before the keyboard goes extinct, but with every shot you take on your camera, it’s getting one step closer."
interface  ai  google  communication  images  cameras  2017  snapchat  facebook  smartphones  lizstinson  imagerecognition  pinterest  keyboards  input  romankalantari  technology  amazon  sundarpichai  albertpereta  gieradlaput 
may 2017 by robertogreco
What You Should Know This Week
"Although e-books, including digital textbooks, have added to new features to make them more attractive to readers – the ability to add highlights, the ability to search the entire corpus – these are secondary to students, who still prefer making their own notes and being able to flip to indexes and Tables of Content. And neither print not digital textbooks have managed to address the big problem that college students face: the rising cost. (That is, digital textbooks tend not to be much cheaper.)

Often we tell a story of technology that posits it’s all inevitable: e-books will mean the end of print; computers will mean the end of paper. But technology development and technology adoption do not necessarily march forward like that. We also assume that younger students – labeled “digital natives” as The Washington Post does in its coverage of Baron’s book – necessarily want more technology because they’re more comfortable and more adept with it.

“My major concern,” Baron told TNR, “as a person in higher education, is that we’re not listening. We’re assuming we’re being helpful by lowering price, by making it more convenient, by helping the environment, but we don’t bother asking our students what they think.”"
audreywatters  teaching  learning  pedagogy  print  digital  books  education  students  studentvoice  2015  listening  input  howweteach  howwelearn  technology  edtech  screens  naomibaron  ebooks 
february 2015 by robertogreco
Filtered for top-notch long reads ( 5 Dec., 2014, at Interconnected)

This well-illustrated piece on Chinese Mobile UI trends [ ] is full of great nuggets.

My favourite is that companies have adopted automated "chat" as their official public face. Each brand is a bot that runs inside one of the several apps that users in China have instead of Facebook, Twitter, WhatsApp, etc. How it works:
You can send any kind of message (text, image, voice, etc), and [the bot will] reply, either in an automated fashion or by routing it to a human somewhere. The interface is exactly the same as for chatting with your friends, save for one difference: it has menus at the bottom with shortcuts to the main features of the account.

A couple more features:
Other than that, every feature you can use in a normal chat is available here. WeChat even auto-transcribes the voice messages (mentioned before) into text before passing them to the third-party server running the account. Official accounts can also push news updates to their subscribers. Every media outlet operates one ...

I'm into this, I'm into this. Our western way for interacting with companies (assuming the shitty voice menu things are wildly out-dated) is websites, which we browse. But instead of browsing, a conversation?

So... cultural difference between China and the west, or just one of those forks in the road? Or a glimpse of the future?


Hooked on Labs [ ] (thanks Iain) draws a line between the practice of Robert Hooke in the 1660s and the modern trend for companies to have "labs."
Labs are places where people conduct experiments to test out theories. The new labs proliferating outside the hard sciences are a symptom of the spread of experimentalism as an ideology for how we should shape the future. Curiosity is at the core of experimentalist culture: it holds that knowledge should develop by being testable and therefore provisional ...

I like that the answer to "how should we invent?" can be not a process but a location. Other answers might be "a studio," and "the field," both of which suggest a variety of processes and practices without being pinned down.

I guess my recent preoccupation with coffee mornings is about the same thing. Can the "coffee morning" as a place, with all its informality (which I am desperate to preserve), be a way to dowse the scenius, to allow invention to occur without process?

Also coffee.

And this bit:
One vital source of this conversational approach to science was Copenhagen and the culture that Niels Bohr created around his institute for theoretical physics and his nearby home.

...which reminds me of this terrific story about the development of the theory of electron spin and how it came together as Bohr travelled across Europe by train.

At the beginning of the trip:
Bohr's train to Leiden made a stop in Hamburg, where he was met by Pauli and Stern who had come to the station to ask him what he thought about spin. Bohr must have said that it was very very interesting (his favorite way of expressing that something was wrong), but he could not see how an electron moving in the electric field of the nucleus could experience the magnetic field necessary for producing fine structure.

And as Bohr travels from town to town, he meets scientists, hears arguments, develops his view, and carries information. Great story.

I think of the interactions between scientists as the hidden particles that don't show up in the traces of a cloud chamber. They're there, busy - multiple - far denser and richer and messier than the clean interactions of the citations in scientific papers or at conferences - the invisible trillions of forks that are left out of Feynman diagrams. Those interactions are what really matter, and their stories are the most interesting of all."
mattwebb  2014  china  chinese  interface  input  chat  communication  internet  web  online  browsing  conversation  wechat  labs  openstudioproject  charlesleadbeater  nielsbohr  experiments  experimentation  experimentalism  curiosity  classideas  invention  place  studios  lcproject  informal  informallearning  informality  scenius  process  howwelearn  messiness  interaction  culture  difference  frontiers  us 
december 2014 by robertogreco
Myo + Smartglasses - Give your mobile workers super powers - YouTube
"Thalmic Labs is proud to introduce Myo + Smartglasses, the complete solution for your mobile workforce to stay connected on the job. The Myo armband eliminates the need for remote controls, touch pads, buttons, and voice control for workers in sterile or noisy work environments. This enables workers to stay hands free and heads up in the most demanding environments."
input  myo  via:bopuc  handsfree  inpudevices  motion  movement 
september 2014 by robertogreco
AirType keyless bluetooth keyboard fits in the palm of your hand
"AirType keyless bluetooth keyboard fits in the palm of your hand

a hardware and machine learning startup based out of austin, texas has developed AirType, a keyboard-less keyboard that allows users to type on virtually any surface, or none at all. fitting in the palm of one’s hand, the ‘AirType’ self-learns finger movements and is accompanied by an app that brings dynamic text prediction and correction to each typing experience. the compact piece of technology also adapts to the way users type, meaning typing habits never need to change. for easy transportation, just clip it onto your tablet, and take it with you everywhere. to learn more, see here."

[website: ]
[video: ]
typing  hardware  keyboards  accessories  input  airtype 
july 2014 by robertogreco
DIRTI for iPad, World's first tapioca interface | USER STUDIO
"a 570cm3 dish that contains about 8.600 seeds of dry tapioca grains

Our research led us to wonder if and how we could change the relationship that humans have with tangible controllers: at the time (2011) we were working on trying to control thousands of particles on the screen in the most natural, intuitive fashion possible. We figured there was no better way than by actually controlling real world particles! So when creating this new "DIRTInterface", we set our minds on making something a little less accurate, while a lot more subtle, constantly adapting, almost alive. Tackling the cold, abrupt interaction that traditional controllers impose on us... It was all about interaction design politics ;)

Ok, so what's DIRTI in the first place?

It's the World's first tapioca interface! No really, it enables you to control your computer or your iPad with tapioca or anything else that's semi-transparent and that you can mold, like vanilla ice cream for example. Any non-opaque material that's either granular or liquid will do just fine. It's kind of a real-world interface. And the acronym stands for Dirty Tangible Interface. Tacky? Yeaaaah, we love tacky!

You, the user, interact with your machine by moving the material around in a sand-blasted dish. Anything that you're going to produce from within the Dirty Tangible Interface can not be 100% accurate, but it's infinitely refined, expressive and subtle. And you can't cancel any action or go back to a previous, default position, but you can control any graphics or sounds coming out of your machine with amazing expressivity, just like with real world instruments. Say, a violin. Not even kidding. And who wouldn't like plunging their hands in ice cream?!"
dirti  interface  tactile  touch  ncmideas  particles  texture  software  programming  installation  tangiblecontrollers  controllers  input  via:markllobrera  userstudio  glvo  maisondepetits  centquatre  rolandcahen  diemoschwarz  ircam  raspeberrypi  ios  ipad  destronics  topophonie 
july 2013 by robertogreco
On firehoses and filters: Part 1 – confused of calcutta
"Ever since then, I’ve been spending time thinking about the hows and whys of filtering information, and have arrived “provisionally” at the following conclusions, my three laws of information filtering:

1. Where possible, avoid filtering “on the way in”; let the brain work out what is valuable and what is not.

2. Always filter “on the way out”: think hard about what you say or write for public consumption: why you share what you share.

3. If you must filter “on the way in”, then make sure the filter is at the edge, the consumer, the receiver, the subscriber, and not at the source or publisher."
jprangaswami  filtering  internet  clayshirky  georgeorwell  aldoushuxley  bravenewworld  1984  jonathanzittrain  elipariser  input  output  flow  socialsoftware  curation  curating  sharing  information  2011  from delicious
may 2011 by robertogreco
Swype | Text Input for Screens
"Swype provides a faster and easier way to input text on any screen. With one continuous finger or stylus motion across the screen keyboard, the patented technology enables users to input words faster and easier than other data input methods—at over 40 words per minute. The application is designed to work across a variety of devices such as phones, tablets, game consoles, kiosks, televisions, virtual screens and more."
android  keyboard  mobile  input  swype  applications  writing  touchscreen  usability  ui  typing  interface  iphone  ios  from delicious
august 2010 by robertogreco
Easily type accented characters | Mac OS X | Mac OS X Hints | Macworld
"An easier solution—and one that will look familiar to Windows users who use the US International keyboard layout—is built right into Snow Leopard (Mac OS X 10.6). Launch System Preferences, open the Language & Text pane, and then click the Input Sources tab. In the list of input methods on the left, scroll down and enable U.S. International - PC. Then switch to this input method. (The easiest way to do so is to enable, in the same Input Sources tab, the option to Show Input Menu In Menu Bar, and then choose from that menu the U.S. International - PC layout.)

Now creating diacritical characters is as simple as typing a standard punctuation character and then the desired letter:"
via:preoccupations  macosx  osx  accents  typing  input  mac 
march 2010 by robertogreco
break (tecznotes)
"It's my inputs that are busy, not my outputs."
cv  michalmigurski  input  output 
december 2009 by robertogreco
iPhone Graffiti - HWPen brings handwriting recognition -
"Many folks come from Palm OS handsets, and have fallen in love with their graffiti handwriting recognition, and miss that when they come to the iPhone. HWPen, while still in early stages, could fill that gap as well for the people who just can't live wit
iphone  handwriting  input 
april 2008 by robertogreco
'Mind Gaming' Could Enter Market This Year
"In adapted version of Harry Potter video game, players lift boulders & throw lightning bolts using only their minds. Just as physical movement changed interface of gaming with Wii, the power of the mind may be the next big thing in video games."
biofeedback  interface  games  gaming  future  virtualreality  videogames  interaction  input  technology  brain  control  mind  vr 
march 2008 by robertogreco
glee. by Kokoromi
"Glee. by Kokoromi is a one-player collection game that uses live musical input (from your line-in or MP3 player) to create the gameplay."
audio  games  processing  sound  music  input  gaming  play  geometry  windows  mac  os  x  Linux 
january 2008 by robertogreco
YouTube - videos from Johnny Lee
including Head Tracking for Desktop VR Displays using the WiiRemote, Low-Cost Multi-touch Whiteboard using the Wiimote, Tracking fingers with the Wii Remote
wii  hacks  whiteboards  display  input  wiimote 
december 2007 by robertogreco
Ten things holding back tech - ZDNet UK
"1. Microsoft's stranglehold on the desktop 2. Operator lock-in 3. Input methods 4. Battery life 5. The mania for speed 6. Intellectual property law 7. Skills inequalities 8. Web 2.0 9. National interests 10. The current lack of global wars and/or disaste
future  innovation  technology  trends  progress  information  development  change  microsoft  speed  input  batteries  ip  skills  web2.0  disasters  war  twitter  skype  facebook  leapfrogging  qwerty 
november 2007 by robertogreco
YouTube - LucidTouch - a see-through mobile device
"Revolutionary design for touch-based device used with your fingers holding the back of the gadget to give a clearer view."
touch  usability  multitouch  prototype  interface  input  technology  screen  iphone  ui 
october 2007 by robertogreco
Subtraction: The Little Keyboard That Could—n’t
"Still, that won’t stop me from airing my theory: there is an inherent learning plateau in Apple’s software keyboard, and that plateau falls short of full accuracy."
apple  design  haptics  hardware  iphone  mobile  usability  ux  keyboard  input 
september 2007 by robertogreco
The trouble with computers |
"Computing: They may be powerful, but computers could still be easier to use. Might new forms of interface help?"
computers  interface  design  ux  interactive  interaction  human  input  mobile  ubicomp  phones  iphone  adamgreenfield  multitouch  ubiquitous 
september 2007 by robertogreco
Wired 15.04: Mixed Feelings
"See with your tongue. Navigate with your skin. Fly by the seat of your pants (literally). How researchers can tap the plasticity of the brain to hack our 5 senses — and build a few new ones."
body  brain  cognitive  senses  synesthesia  tactile  tangible  technology  human  hacks  data  perception  psychology  neuroscience  science  research  input  future  evolution  engineering  sensory  haptics  bodies 
may 2007 by robertogreco
Can't Touch This - Jeff Han - Touch Screen
"Working all but alone from his hardware-strewn office, Jeff Han is about to change the face of computing. Not even the big boys are likely to catch him."
jeffhan  multitouch  touchscreen  video  interface  interaction  displays  input  touch 
january 2007 by robertogreco
"Jott converts your voice into emails, text messages, reminders, lists and appointments."
mobile  sound  speech  voice  online  input  conversion  notetaking  tools  software  messaging  phones 
december 2006 by robertogreco
Elekson Gadget Bag Doubles as USB Keyboard - Gizmodo
"It's a prototype from Eleksen, the company that makes fabric buttons. Just look at it, in all its cloth-y, clicky, gadget-protecting goodness!"
design  gadgets  bags  input  keyboards 
december 2006 by robertogreco
PingMag - The Tokyo-based magazine about "Design and Making Things" » Archive » 10 Questions with a Joystick Master
"Roger Ibars‘ project entitled “Hard-wired Devices” uses familiar input devices for unfamiliar purposes. Whether he is making a Nintendo controller program the time on an alarm clock or an old-school retro joystick control a game of Snake on a Nokia
design  games  interface  videogames  input  devices  joystick  electronics  interaction  tactile  pingmag 
september 2006 by robertogreco
soap homepage
"Soap is a pointing device based on hardware found in a mouse, yet works in mid-air. Soap consists of an optical sensor device moving freely inside a hull made of fabric. As the user applies pressure from the outside, the optical sensor moves independent
design  diy  electronics  gadgets  hardware  howto  innovation  interface  input  technology  wireless  make  pc  projects  devices 
september 2006 by robertogreco
Prototype / Interaction Design Cluster / Yaniv Steiner » SmartRetina
"SmartRetina is a lightfast gesture-tracking platform written in Macromedia Flash 8, utilizing its flash.geom. package, flash.display package, Video class, Camera class and their motion-tracking capabilities."
gestures  interface  cameras  input  play  motion  flash  devices 
may 2006 by robertogreco
"the monome 40h is a reconfigurable grid of sixty-four backlit buttons. see the demonstration video."
interface  input  sampling  design  gadgets  electronics  opensource  light  music  devices  sound  video  hardware 
april 2006 by robertogreco
Multi-Touch Interaction Research
"Bi-manual, multi-point, and multi-user interactions on a graphical interaction surface."
interface  input  future  research  concepts  graphics  interactive  human  computers  touch  screen 
february 2006 by robertogreco
Dvorak Keyboard on PowerBook G4
"For some time now, I have known that the commonly used QWERTY keyboard layout is inefficient and that better alternatives exist. I had some free time recently and finally got around to learning the Dvorak layout."
make  howto  diy  gadgets  input  devices  hardware  hacks 
december 2005 by robertogreco
New Standard Keyboard for Kids? - Gizmodo
"At first glace this appeared to be one of those keyboards designed for kids so they can have a grand ol’ time smashing the keys, but after further investigation, this keyboard appears to be for adults and has a new layout. It’s the same 53-key keyboa
children  computers  hardware  input  gadgets  devices 
december 2005 by robertogreco | New infrared technology could exterminate your computer mouse
"In its place would be a ring that allows computer users to manipulate their cursor with the lift of a finger - and without taking their hands off the keyboard. The technology also makes computer presentations a breeze with the use of a remote wand, promi
computers  technology  interface  hardware  input  gadgets  devices 
december 2005 by robertogreco
TactaPad — See ... Touch ... Feel
"Interact with your computer in a direct and natural way. With the TactaPad you can reach into your computer and use both of your hands. Just like the real world."
technology  gadgets  computers  input  interface  tools  hardware  mac  design  productivity  touch 
october 2005 by robertogreco

related tags

accents  accessibility  accessories  adamgreenfield  adamwiggins  ai  airtype  albertpereta  aldoushuxley  alternative  amazon  ambient  android  apple  applications  audio  audreywatters  bags  batteries  biofeedback  bluetooth  bodies  body  books  brain  bravenewworld  browsing  cameras  centquatre  change  charlesleadbeater  chat  children  china  chinese  classideas  clayshirky  cognitive  communication  computers  concepts  control  controllers  conversation  conversion  creativity  culture  curating  curation  curiosity  cv  data  design  destronics  development  devices  diemoschwarz  difference  digital  dirti  disasters  display  displays  diy  ebooks  edtech  education  electronics  elipariser  engineering  evolution  experimentalism  experimentation  experiments  facebook  filtering  flash  flow  frontiers  future  gadgets  gamecontrollers  games  gaming  geometry  georgeorwell  gestures  gieradlaput  glvo  glyphs  google  graphics  hacks  handsfree  handwriting  haptics  hardward  hardware  history  howto  howwelearn  howweteach  human  imagerecognition  images  informal  informality  informallearning  information  innovation  inpudevices  input  installation  interaction  interactive  interface  internet  invention  ios  ip  ipad  ipadpro  iphone  ircam  jamesminicki  jeffhan  jonathanzittrain  joystick  jprangaswami  juliaroggatz  keyboard  keyboards  labs  lcproject  leapfrogging  learning  light  Linux  listening  lizstinson  location  mac  macosx  maisondepetits  make  mattwebb  messaging  messiness  michalmigurski  microsoft  milošmilikić  mind  mobile  motion  movement  multitouch  music  myo  naomibaron  ncmideas  neuroscience  nielsbohr  notetaking  notices  notifications  online  opensource  openstudioproject  os  osx  output  particles  pc  pedagogy  perception  phones  pingmag  pinterest  place  play  predictive  print  process  processing  productivity  programming  progress  projects  prototype  psychology  qwerty  raspeberrypi  research  rolandcahen  romankalantari  sampling  scenius  science  screen  screens  senses  sensory  sharing  skills  skype  smartphones  snapchat  socialsoftware  software  sound  speech  speed  steamcontoller  students  studentvoice  studios  stylus  sundarpichai  swype  synesthesia  tactile  tangible  tangiblecontrollers  teaching  technology  text  texture  tools  topophonie  touch  touchscreen  trends  twitter  typing  ubicomp  ubiquitous  ui  us  usability  userstudio  ux  via:bopuc  via:markllobrera  via:preoccupations  video  videogames  virtualreality  visualization  voice  vr  war  web  web2.0  wechat  whiteboards  wii  wiimote  windows  wireless  writing  x 

Copy this bookmark: