mkuthan.github.io
Long-running Spark Streaming Jobs on YARN Cluster - Passionate Developer
http://mkuthan.github.io/blog/2016/09/30/spark-streaming-on-yarn
Memory is unreliable like a software, so make my thoughts more eternal and my software more reliable. Long-running Spark Streaming Jobs on YARN Cluster. A long-running Spark Streaming job, once submitted to the YARN cluster should run forever until it is intentionally stopped. Any interruption introduces substantial processing delays and could lead to data loss or duplicates. Neither YARN nor Apache Spark have been designed for executing long-running services. But they have been successfully ...If the ap...
mempko.wordpress.com
mempko | Mempko's Blog
https://mempko.wordpress.com/author/mempko
Using CoffeeBrain = Brain. The Fox in the Henhouse. I’m writing a new time series DB in C called Henhouse and this is a story about a bug and my heroic battle with it. Actually, it’s not really a story about a bug, but more of a way of finding bugs and preventing them. I hope to convince you that there are better ways of writing code that don’t involve slogging with unit tests. Expr: ( metadata- size = 170) [ metadata- size = 171, max items = 170]! That is a bug right there! This is a member function whi...
bytes.schibsted.com
Getting down to business with Prometheus in Finn.no
http://bytes.schibsted.com/business-with-prometheus
Getting into business with Prometheus. FINN Småjobber, Oslo. Written on 20 October 2016. FINN has moved towards an architecture of microservices and uses a number of technologies – Prometheus included – to identify and fix service outages. With each piece of functionality being comprised of a growing number of individual services, specialized tools are required for detection, analysis and mitigation of errors, and we are already using our fair share, including. Recently, however, we opted to switch to.
blog.cloudcultivator.com
Cloud Cultivator:DevOps
http://blog.cloudcultivator.com/devops.php
We offer full service implementation and management of a full dinner menu of toolchains, buildtools, and monitoring systems. Here is a sampling of the tools we have worked with:. Cloud Cultivator, 2017.
tinajalabs.wordpress.com
Blog | Tinaja Labs | Technology, Science, Home Automation, Energy Conservation, Sensor networks, fun…
https://tinajalabs.wordpress.com/blog
Technology, Science, Home Automation, Energy Conservation, Sensor networks, fun…. From Pachube to Cosm to Xively – the death of DIY? Xively, formerly Cosm, and in the beginning, named Pachube, has gone a little wacky. They have a new article on their site , The Dangers of DIY. Declaring “ the era of DIY has passed. 8220; To be fair their angle is about helping organizations productize and monetize their IoT products but please, let’s not be so cynical. DIY is here to stay. To manually control lights and ...
ordina-jworks.github.io
Ordina JWorks Tech Blog
https://ordina-jworks.github.io/monitoring/2016/09/23/Monitoring-with-Prometheus.html
Posted Sep 23, 2016 in Monitoring. It is needless to say the world is shifting towards DevOps and microservices. This holy grail we aim for adds a great deal of complexity. Monitoring included. Rather than having to monitor one system, we are suddenly faced with the challenge to oversee our manifold services. There are numerous monitoring systems available, but not all of them are fit for monitoring large, distributed systems. Black box monitoring systems like Nagios. Are they handled correctly? Social p...
rhonabwy.com
heckj | Rhonabwy
https://rhonabwy.com/author/josephheck
Software development and daily life in Seattle. Distributed service platforms largest challenge: network interoperability. Or bridging, possibly with OpenVSwitch. Are all pushing for attention and adoption, with the goal of becoming a defacto standard. Individually these are all good solutions – each has their bonuses and draw backs – but the boundary to something else, the interface, is ultimately the problem. The most common patterns I’ve seen to date try and make a router or layer-3 switch the d...
