hipsterdevblog.com

Analysing DynamoDB Index Usage in Hive Queries - :HIPSTER_DEV_BLOG

http://hipsterdevblog.com/blog/2015/05/30/analysing-dynamodb-index-usage-in-hive-queries

Another Octopress blog about programming and infrastructure. Analysing DynamoDB Index Usage in Hive Queries. Elastic Map Reduce allows you to conveniently run SQL-like queries against DynamoDB using Hive. This overcomes many of the limitations of the built-in DynamoDB query functionality and makes it significantly more useful for storing raw analytical data. The documentation provides some guidance. These queries were run against the following example table:. Product sequence number host time. Sequence n...

Building ZeroC Ice 3.5 Projects With Gradle and IntelliJ - :HIPSTER_DEV_BLOG

http://hipsterdevblog.com/blog/2015/04/21/building-zeroc-ice-projects-with-gradle-and-intellij

Another Octopress blog about programming and infrastructure. Building ZeroC Ice 3.5 Projects With Gradle and IntelliJ. Is a distributed computing platform supporting many languages including Java. Building an Ice project requires compiling “slice” data structure definitions into a compatible Java interface. Most often it is recommended to use the Eclipse plugin. However I prefer to use IntelliJ and a build tool which is IDE agnostic. Official Gradle support is coming. Put your Java sources in the. To gen...

Deploying From CodePipeline to OpsWorks Using a Custom Action and Lambda - :HIPSTER_DEV_BLOG

http://hipsterdevblog.com/blog/2015/07/28/deploying-from-codepipeline-to-opsworks-using-a-custom-action-and-lambda

Another Octopress blog about programming and infrastructure. Deploying From CodePipeline to OpsWorks Using a Custom Action and Lambda. Update: CodePipeline now has built-in support for both Lambda. I’d now recommend using the built-in functionality rather than the method described in this post. AWS recently released CodePipeline. After announcing it last year. After doing the setup walkthrough. I was surprised to see only the following deployment options! If you were hoping to see this:. Once created, ed...

Part 1: Exporting and Analysing CloudWatch Logs With Data Pipeline and EMR - :HIPSTER_DEV_BLOG

http://hipsterdevblog.com/blog/2015/02/24/part-1-exporting-and-analysing-cloudwatch-logs-with-data-pipeline-and-emr

Another Octopress blog about programming and infrastructure. Part 1: Exporting and Analysing CloudWatch Logs With Data Pipeline and EMR. You’ve just discovered one of your instances has been. Fortunately you found this blog post! Elastic Map Reduce (EMR). The only question is how to get your logs out of CloudWatch and into S3 for EMR to process, so I recently wrote a small tool called cwlogs-s3. The first step is to create an AWS Data Pipeline to run cwlogs-s3. The other benefit of Data Pipeline is that ...

Retrieving Files From S3 Using Chef on OpsWorks - :HIPSTER_DEV_BLOG

http://hipsterdevblog.com/blog/2014/06/22/retrieving-files-from-s3-using-chef-on-opsworks

Another Octopress blog about programming and infrastructure. Retrieving Files From S3 Using Chef on OpsWorks. You may also be interested in my new post Revisited: Retrieving Files From S3 Using Chef on OpsWorks. Which includes support for IAM instance roles. Adding AWS cookbook via Berkshelf. The first thing you’ll need to do is add the OpsCode AWS cookbook. To your Berkfile. Note that Berkshelf is only supported on Chef 11.10 or higher on OpsWorks, so if your OpsWorks stack has an older version ...You c...