Firehose   350

« earlier    

https - AWS Lambda cannot connect to Kinesis Firehose "Max retries exceeded with url" - Stack Overflow
Currently you can't connect a Lambda task directly to Kinesis Firehose, only to Kineses Streams. One way around this is to let Firehose write a file to S3 and then trigger a Lambda task via S3 event notifications.
kinesis  firehose  lambda  stream  s3 
december 2016 by pskomoroch
Creating an Amazon Kinesis Firehose Delivery Stream - Amazon Kinesis Firehose
Firehose buffers incoming data before delivering it to Amazon S3. You can choose Buffer size (1-128 MBs) or Buffer interval (60-900 seconds), and whichever condition is satisfied first triggers the data delivery to Amazon S3. Please note that in circumstances where data delivery to the destination is falling behind data writing to the delivery stream, Firehose raises the buffer size dynamically to catch up and make sure that all data is delivered to the destination.
kinesis  firehose  s3 
november 2016 by pskomoroch
Twitter’s ‘firehose’ of tweets is incredibly valuable—and just as dangerous • Bloomberg
Benjamin Elgin and Peter Robison:
<p>For years, Twitter has offered access to its “Firehose”—the global deluge of tweets, half a billion a day—to a number of companies that monitor social media. Some of those companies resell the information—mostly to marketers, but also to governments and law enforcement agencies around the world. Some of these authorities use the data to track dissidents, as Bloomberg Businessweek has learned through dozens of interviews with industry insiders and more than 100 requests for public records from law enforcement agencies in the U.S.

There’s nothing illegal about selling Twitter data, but it’s uncomfortable for a company that promotes itself as a medium for free speech and protest. Twitter issues regular transparency reports and has gone to court to fight censorship. Dorsey himself marched with Black Lives Matter activists in 2014, regularly tweeting messages of support and appearing at a conference this June wearing a #staywoke T-shirt. But amid Dorsey’s activism, one data user, Chicago monitoring company Geofeedia, was hired by California police departments after pitching its ability to identify civil rights protesters, according to an American Civil Liberties Union report released in September. Twitter, which touts a policy that prohibits third parties from making content available “to investigate, track or surveil Twitter’s users or their content,” cut ties with Geofeedia in October.

Twitter offers a free, stripped-down version of the full Firehose to the public, and in recent years, at least 17 companies besides Geofeedia have marketed surveillance products that make use of Twitter data to law enforcement organizations.</p>


A warning before you click through: autoplay video ahead.
twitter  firehose 
october 2016 by charlesarthur
Twitter
And this is what I intend to buy instead.
firehose  indiegame  from twitter_favs
june 2016 by daisyk
BELONG
Tech nerds are smart. But they can't seem to get their heads around politics. - Vox
firehose 
november 2015 by srcerer

« earlier    

related tags

absorb  accelerate  access  admin  advertising  aggregation  aggregator  ajax  amazon  analysis  analytics  anonymisation  api  apple  apps  architecture  async  asynchronous_event_processing  aws  backtype  berryflow.com  bharata  bharati  bi  big  big_data  bigdata  brandon  bullshit  business  businessintelligence  businessmodels  cascalog  chat  cloud-dev  cloud  clouddev  cloudfront  cnn  coding  collaboration  corporatesurveillance  course  cover  css  dannysullivan  dashboard  data  data_visualisation  databrokers  datamining  datasift  dbix::class  desk  dev  development  dom  educate  education  eve-online  eventsource  facebook  feedback  firebase  firehose  forwarder  forwarding  foursquare  geography  gif  github  gnip  google  hacker  hbase  html  http  http://berryflow.com/2014/08/blackberry-cascades-exercise-utility/  http://berryflow.com/2014/09/blackberry-passport-versus-media/  http://bharatabharati.wordpress.com/2014/08/15/the-bharatas-of-bharatavarsha-sandhya-jain/  http://www.technologyreview.com/review/529961/in-praise-of-efficient-price-gouging/  ibm  ifttt  indie  indiegame  indieroundup  inflection-point  inspiration  instagram  ipad  javascript  job  js  jubei  kafka  kinesis-firehose  kinesis  lambda  learn  localstack  lynda  manager  map  mapbox  mapping  market  marketing  media  mentor  mit  mobile  monitoring  networking  new  news  newsblur  node-js  notincluded  on  open-source  opensource  orr  personaldata  photo  plumbing  polling  privacy  product  programming  pubnub  pubsub  pusher  python  rabbitmq  rack  rails  raziel  realtime  redis  researchgate  results  review  ruby-gem  ruby-lang  ruby  s3  scalability  science  search  searchengineland  security  self-reliant  server  skills  slides  social  socialmedia  sockets  software  stories  storm  stream  streaming  streamprocessing  streams  support  sync  talk  tcga  techmeme  technology  test  ticker  ticket  tools  trading  tutorial  tweets  tweetthis  twitter  video  web  webapps  webdev  webdevelopment  websocket  websockets  work  workflow  zeromq 

Copy this bookmark:



description:


tags: