distributed-processing   41

« earlier    

Pool based evolutionary algorithm presented in EvoStar 2012 « GeNeura Team
"This is the first internationally published paper (it was previously published in a Spanish conference of a series that deals with a system, intended for volunteer computing, that uses a pool for implementing distributed evolutionary algorithms. The basic idea is that the population resides in a pool (implemented using CouchDB), with clients pulling individuals from the pool, doing stuff on them, and putting them back in the pool. The algorithm uses, as much as possible, CouchDB features (such as revisions and views) to achieve good performance. All the code (for this and, right now, for the next papers) is available as open-source code."
distributed-processing  evolutionary-algorithms  CouchDB  nudge 
5 weeks ago by Vaguery
Tribler Makes BitTorrent Impossible to Shut Down | TorrentFreak
"Today, however, Tribler is more relevant than ever before.

Developed by a team of researchers at Delft University of Technology, the main goal is to come up with a robust implementation of BitTorrent that doesn’t rely on central servers. Instead, Tribler is designed to keep BitTorrent alive, even when all torrent search engines, indexes and trackers are pulled offline.

“Our key scientific quest is facilitating unbounded information sharing,” Tribler leader Dr. Pouwelse tells TorrentFreak.

“We simply don’t like unreliable servers. With Tribler we have achieved zero-seconds downtime over the past six years, all because we don’t rely on shaky foundations such as DNS, web servers or search portals.”"
disintermediation-in-action  bittorrent  peer-to-peer-systems  distributed-processing  to-watch 
february 2012 by Vaguery
[1202.0077] An Interacting Particle Model for Clustering Euclidean Datasets
"In this paper we propose a method based on interacting particle physics, devised for clustering Euclidean datasets without initial constraints or conditions. We model any dataset as an interacting particle system, whose elements correspond to particles that interact through a simplified version of Lennard-Jones potentials. In so doing, mutual attractive interactions allow to identify groups of proximal particles. The main outcome of this modeling task is an adjacency matrix, taken as input by a community detection algorithm aimed to identify different partitions. The underlying conjecture is that, using a multiresolution analysis, the adopted model allows to find the right number of clusters for any given dataset. Experimental results, performed in comparison with a classical clustering algorithm, confirm this assumption."
clustering  data-analysis  algorithms  nudge-targets  distributed-processing 
february 2012 by Vaguery
[1110.1590] PSA: The Packet Scheduling Algorithm for Wireless Sensor Networks
"The main cause of wasted energy consumption in wireless sensor networks is packet collision. The packet scheduling algorithm is therefore introduced to solve this problem. Some packet scheduling algorithms can also influence and delay the data transmitting in the real-time wireless sensor networks. This paper presents the packet scheduling algorithm (PSA) in order to reduce the packet congestion in MAC layer leading to reduce the overall of packet collision in the system The PSA is compared with the simple CSMA/CA and other approaches using network topology benchmarks in mathematical method. The performances of our PSA are better than the standard (CSMA/CA). The PSA produces better throughput than other algorithms. On other hand, the average delay of PSA is higher than previous works. However, the PSA utilizes the channel better than all algorithms."
sensor-networks  distributed-processing  scheduling  routing  operations-research  algorithms  nudge-targets 
october 2011 by Vaguery
[1110.0725] A Survey of Distributed Data Aggregation Algorithms
"Distributed data aggregation has been an active field of research in the last decade, and a huge diverse amount of techniques can be found in the literature. For this reasons, this survey intends to be an important time saving instrument, for those that desire to get a quick and comprehensive overview of the state of the art on distributed data aggregation. Moreover, by carefully highlighting the strength and limitations of the more pertinent approaches, this study can provide a useful assistance to help readers choose which technique to apply in specific settings.

Currently, there is no ideal general solution to the distributed computation of an aggregation function, all existing techniques have its pitfalls (some more than others). Therefore, more research in this field will be expected in the next few years. In particular, due to the added value of computing complex aggregates, new algorithms might arise to estimate the statistical distribution of values, as the few existing approaches exhibit some limitations in terms of accuracy and resource consumption. Additional research efforts should be made to improve the support to churn, message loss, and continuous estimation of mutable input values."
statistics  reviews  distributed-processing  communication  coordination  nudge-targets 
october 2011 by Vaguery
[1105.6205] Cloud-based Evolutionary Algorithms: An algorithmic study
"After a proof of concept using Dropbox(tm), a free storage and synchronization service, showed that an evolutionary algorithm using several dissimilar computers connected via WiFi or Ethernet had a good scaling behavior in terms of evaluations per second, it remains to be proved whether that effect also translates to the algorithmic performance of the algorithm. In this paper we will check several different, and difficult, problems, and see what effects the automatic load-balancing and asynchrony have on the speed of resolution of problems."
dropbox  genetic-algorithm  distributed-processing  tips-and-tricks 
october 2011 by Vaguery
"Big Memory" Company Terracotta Snapped Up by Europe's Fourth Largest Software Company
"In-memory is a hot topic right now, thanks in part to SAP pushing its in-memory analytics platform HANA at Sapphire last week. HANA, however, is not a direct competitor to BigMemory. According to RedMonk co-founder James Governor, competitors include Oracle Coherence, IBM eXtreme Scale, Hazelcast and Gigaspaces.

"Indeed distributed cache is well known enough to be seen as a 'competitor' to NoSQL approaches," Governor wrote. "Both take load off the database - less database work generally means greater scalability""
software-architecture  distributed-processing  data-analysis  database  open-source 
may 2011 by Vaguery
Faye: Simple pub/sub messaging for the web
Faye is an easy-to-use publish-subscribe messaging system based on the Bayeux protocol. It provides message servers for Node.js and Rack, and clients for use in Node and Ruby programs and in the browser.
distributed-processing  publish-and-subscribe  architecture  software-development  Ruby  javascript 
may 2011 by Vaguery
[1007.5088] Simplified Distributed Programming with Micro Objects
"Developing large-scale distributed applications can be a daunting task. object-based environments have attempted to alleviate problems by providing distributed objects that look like local objects. We advocate that this approach has actually only made matters worse, as the developer needs to be aware of many intricate internal details in order to adequately handle partial failures. The result is an increase of application complexity. We present an alternative in which distribution transparency is lessened in favor of clearer semantics. In particular, we argue that a developer should always be offered the unambiguous semantics of local objects, and that distribution comes from copying those objects to where they are needed. We claim that it is often sufficient to provide only small, immutable objects, along with facilities to group objects into clusters."
emergent-design  complex-systems  computer-science  distributed-processing  nudge-targets  semantics 
august 2010 by Vaguery
[1007.2401] Double Circulant Minimum Storage Regenerating Codes
"Storage optimization in distributed environments is a major concern when talking about reliability in this kind of schemes. Although replication is the most used option, erasure coding is a more optimized one.
However, erasure coding uses a lot of bandwidth to replace one node. In a dynamic scheme, where nodes enter and leave the system frequently, bandwidth use could be an important drawback.
Regenerating Codes introduced by Dimakis et al. minimize the code repair problem by applying Network Coding to the distributed storage scheme. However finding the coefficients for the linear combinations used to replace a node is not easy, specially for the systematic case, and must be calculated for each new node fail.…"
nudge-targets  distributed-processing  database-administration  grid-computing  algorithms  reliability 
july 2010 by Vaguery
[0902.3631] Distributed Agreement in Tile Self-Assembly
"Laboratory investigations have shown that a formal theory of fault-tolerance will be essential to harness nanoscale self-assembly as a medium of computation. Several researchers have voiced an intuition that self-assembly phenomena are related to the field of distributed computing. This paper formalizes some of that intuition. We construct tile assembly systems that are able to simulate the solution of the wait-free consensus problem in some distributed systems. (For potential future work, this may allow binding errors in tile assembly to be analyzed, and managed, with positive results in distributed computing, as a "blockage" in our tile assembly model is analogous to a crash failure in a distributed computing model.) …We show that solution of this strengthened consensus problem can be simulated by a two-dimensional tile assembly model only for two processes, whereas a three-dimensional tile assembly model can simulate its solution in a distributed system with any number of processes
nanotechnology  self-assembly  molecular-design  distributed-processing  complexology  emergent-design  nudge-targets 
july 2010 by Vaguery
[0912.1961] Networked buffering: a basic mechanism for distributed robustness in complex adaptive systems
"Here we propose a generic mechanism - networked buffering - for generating robust traits in complex systems that requires two basic conditions to be satisfied: 1) agents are versatile enough to perform more than one single functional role within a system and 2) agents are degenerate, i.e. there exists partial overlap in the functional capabilities of agents. Given these prerequisites, degenerate systems can readily produce a distributed systemic response to local perturbations. Reciprocally, excess resources related to a single function can indirectly support multiple unrelated functions within a degenerate system.…"
network-theory  complexology  distributed-processing  robustness 
june 2010 by Vaguery
Heroku | Experimental Node.js Support
"Node.js is evented I/O for JavaScript, built on top of the blazingly fast V8 engine. It makes handling event-driven I/O incredibly simple, and aligns perfectly with our maniacal focus on simplicity and developer productivity. The Ruby community has quickly adopted node, and with great reason. Complimenting existing apps with node.js for components that require real-time event handling or massive concurrency is both easy and elegant – in part thanks to the availability of frameworks such as express."
Ruby  Javascript  heroku  cloud-computing  distributed-processing  framework  software-development  hosting 
april 2010 by Vaguery
[1004.4541] On the Impact of the Migration Topology on the Island Model
"Parallel Global Optimization Algorithms (PGOA) provide an efficient way of dealing with hard optimization problems. One method of parallelization of GOAs that is frequently applied and commonly found in the contemporary literature is the so-called Island Model (IM). In this paper we analyze the impact of the migration topology on the performance of a PGOA which uses the Island Model. In particular we consider parallel Differential Evolution and Simulated Annealing with Adaptive Neighborhood and draw first conclusions that emerge from the conducted experiments."
trivial-geography  distributed-processing  metaheuristics  algorithms  evolutionary-algorithms  design-patterns 
april 2010 by Vaguery
Redis: Data Cheeseburgers - GIANT ROBOTS SMASHING INTO OTHER GIANT ROBOTS
"Explaining Redis is tough, it’s easy to say “a data structures server” or “memcached on steroids” or something more jargon filled. It’s not exactly a key value store, it’s definitely not a relational or document-oriented database. The biggest selling point of Redis is that usually as programmers we have to bend our data into a table or document to save it, but with Redis we can persist data as we conceptually visualize it. Tasty!"
data  database  NoSQL  distributed-processing  virtual-memory  library  Ruby  architecture 
march 2010 by Vaguery
cloudkick | blog: 4 Months with Cassandra, a love story
"Write performance in Cassandra is excellent. The internals are specifically geared towards a heavy-write system. It writes to a memory table and a serial commit log, and every so often the memory table is flushed to disk in what the Big Table paper describes as a sorted strings table, often called an SSTable — an immutable data structure. There is a lot more happening behind the scenes, but the performance characteristics are clear: there is nothing slow in the write path. The Cassandra wiki page on Architecture Internals provides more details."
infrastructure  distributed-processing  cloud-computing  databases  architecture  administration  opensource  scalability  storage 
march 2010 by Vaguery
Apache Thrift
"Thrift does the heavy lifting. Instead of writing a load of boilerplate code to serialize and transport your objects and invoke remote methods, you can get right down to business. Here is some sample Python client code:"
distributed-processing  web-services  API  protocol  software-development  interoperability  language-agnostic  meh  Apache 
march 2010 by Vaguery
Genetic Programming and Evolvable Machines: GPEM 10(4) now available online
"The fourth issue of volume 10 of Genetic Programming and Evolvable Machines is now available online. This is the first part of the two-part Special Issue on Parallel and Distributed Evolutionary Algorithms, and it contains the following articles:..." [which I unfortunately cannot read; dammit, Springer]
genetic-programming  academia  papers  journal  distributed-processing  somebody-toss-me-a-bone-please 
november 2009 by Vaguery

« earlier    

Copy this bookmark:



description:


tags: