Latest Story

Deleting profiles and all associated orders

Monday, May 20, 2013
By Steve

Nothing fancy, just a simple component to delete all profiles with no activity in the last 180 days. We needed this in our development and QA environments to reclaim disk space. 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23... »

HDFS – Where are my file blocks?

Friday, May 17, 2013
By Steve

At times I would like to know how a file is stored in HDFS. What is below will show which blocks exist for a given file, as well as on which nodes they are stored. 1 2 3 4 5 6 7 8 9... »

Simple example of tracking memory using getrusage

Monday, May 13, 2013
By Steve

There is no real purpose to this post, as I rarely if ever write C code for any useful purpose anymore. However, what I do use it for is better understanding Linux system calls and other various operations in the kernel. In this case,... »


Formatting garbage collection output with timestamps

Thursday, May 9, 2013
By Steve

If you are running a version of java where -XX:+PrintGCDateStamps is not honored, you can run what is below. For those that are unaware, by default garbage collection will... »

Does hadoop/HDFS distribute writes to all data nodes on ingest?

Wednesday, May 8, 2013
By Steve

I like simple, command line test cases. Lather, rinse, repeat (do any shampoo bottles actually have that anymore ?) I wanted to ensure I could prove that ingests to... »

One way to tell if a thread pool is hung

Monday, May 6, 2013
By Steve

A hung ThreadPoolExecutor in java can be manifested in various ways. At least one, that I wanted to post for my own notes, is below. A thread dump may... »