Aggregation   5610

« earlier    

Logstash: Collect, Parse, Transform Logs | Elastic
Logstash is an open source, server-side data processing pipeline that ingests data from a multitude of sources simultaneously, transforms it, and then sends it to your favorite “stash.”
log  logging  search  aggregation 
4 weeks ago by bezthomas
ASAP: Automatic Smoothing for Attention Prioritization in Streaming Time Series Visualization
Peter Bailis strikes again.

'Time series visualization of streaming telemetry (i.e., charting of
key metrics such as server load over time) is increasingly prevalent
in recent application deployments. Existing systems simply plot the
raw data streams as they arrive, potentially obscuring large-scale
deviations due to local variance and noise. We propose an alternative:
to better prioritize attention in time series exploration and
monitoring visualizations, smooth the time series as much as possible
to remove noise while still retaining large-scale structure. We
develop a new technique for automatically smoothing streaming
time series that adaptively optimizes this trade-off between noise
reduction (i.e., variance) and outlier retention (i.e., kurtosis). We
introduce metrics to quantitatively assess the quality of the choice
of smoothing parameter and provide an efficient streaming analytics
operator, ASAP, that optimizes these metrics by combining techniques
from stream processing, user interface design, and signal
processing via a novel autocorrelation-based pruning strategy and
pixel-aware preaggregation. We demonstrate that ASAP is able to
improve users’ accuracy in identifying significant deviations in time
series by up to 38.4% while reducing response times by up to 44.3%.
Moreover, ASAP delivers these results several orders of magnitude
faster than alternative optimization strategies.'
dataviz  graphs  metrics  peter-bailis  asap  smoothing  aggregation  time-series  tsd 
6 weeks ago by jm
python - When to use association, aggregation, composition and inheritance? - Stack Overflow
class A(object):
def __init__(self, a, b, c):
self.a = a
self.b = b
self.c = c

def addNums():
self.b + self.c

class B(object):
def __init__(self, d, e, A):
self.d = d
self.e = e
self.A = A

def addAllNums(self):
x = self.d + self.e + self.A.b + self.A.c
return x

ting = A("yo", 2, 6)
ling = B(5, 9, ting)

print ling.addAllNums()
python  classes  association  aggregation 
8 weeks ago by MrToms

« earlier    

related tags

585  abstraction  activities  agent-based  aggregate  aggregated_cloud_search  aggregation  aggregator  ai  ai_bots  algorithms  alternatives  analytics  apache  api  appropriation  approximation  apps  architecture  argumentation  array  art  artificial-intelligence  asana  asap  association  automated  basel  benthompson  bi  bigdata  bizmodel  blogs  bonding  bookmarks_bar  bot  bots  briz  budgets  businessintelligence  cctv  cellular-automata  channel  chatbot  chatting  cheapish  chrome_apps  circonus  class  classes  cloud  code  collection  communities  complexology  composition  concierge_bots  consent  consider:looking-to-see  consider:performance-space-analysis  containers  content  copy  copy_as_broad  copycopy  copycopy_dev  copying  curation  custom  daemon  dashboard  data-structures  data  data_driven  database  dataviz  datawarehouse  dependency  design  desktop_apps  dev  development  diagram  digest  digests  disruption  distributed  docker  elasticsearch  erosion  estimation  etsy  eu  events  evolution  facebook  facets  facialrecognition  fakenews  fbm  feed  feeds  festivals  fintech  free*  free  fuego  gelf  github  glitch  go  golang  graphite  graphs  histogram  hive  ideas  ifttt  important  information  inheritance  innovation  instagram  instapaper  integrations  interesting  internet  java  javascript  jira  job  journalism  json  kafka  kubernetes  law  librato  linking  linux  lists  live  livestream  log  logger  logging  logstash  mac  management  marketing  marketplace  mathematics  media  mediabusiness  medianews  medienkonvergenz  memes_culture  messaging_as_a_service  metrics  mobile_apps  mobile_apps_2_major_oses  models  mongodb  monitoring  music  networking  news  newspapers  next  nick  nieman  node  nodejs  nosql  notations  nudge-targets  objects  oklog  online  oo  oop  openfuego  orbit  paid  pandas  parallec  parallel  people  percentile  percentiles  performance  personal_finance  personalcloud  peter-bailis  philosophy-of-engineering  pivot  pj:pictost  platform  pocket  popular  portertony  postgres  postgresql  price:$5  pricey  print  privacy  productivity  programming  project_management  prometheus  protein  python  quantile  quantiles  query  ranking  rather-interesting  ratio  realtime  recommendation  recommended  reference  related  relationship  reporting  reports  representation  risk-reporting  risk  rss  rxjava  rxphp  saas  savings  scale  scraping  search  search_engines  searchkick  security  service  similar  skype  slack  smoothing  social  social_media  socialmedia  socialnetworking  sorting  spark  spike  sql  sqlserver  stack-overflow  startups  statistics  stats  statsd  storage  stream-processing  stream  streaming  structure  subscriptions_tracker  surveillance  swag_bucks  symbols  syncing  sysadmin  t-digest  task_management  teaching  teaming  telegram  television  theater  time-series  timeseries  tips  to-do  to-write-about  tool  tools  topk  torch  transportation  travis_ci  trello  trial  trove  tsd  twitter  type  uk  uml  user_generated_content  userreviews  vertical  vesicle  warehousing  webdesign  webdev  whatsapp  where  widget  📰  🗑 

Copy this bookmark: