Category: Hadoop

CRC check on gzip files in HDFS

I am sure there is a more elegant way to do this, but I wanted it done quickly. We had a few files that threw exceptions about the end of the file being reached (CRC failure) for external files underlying…

Deleting a service in ambari

Just a simple method to delete a service in Ambari using the REST API… [root@ambari2012 ~]# curl -u admin:admin -H “X-Requested-By: ambari” -X DELETE http://192.168.56.121:8080/api/v1/clusters/ambari2012/services/RANGER [root@ambari2012 ~]# curl -u admin:admin -H “X-Requested-By: ambari” -X DELETE http://192.168.56.121:8080/api/v1/clusters/ambari2012/services/RANGER {   “status” :…

zookeeper and reverse lookups

Suffice it to say, on zookeeper 3.4.6 (at least) you will have all kinds of grief in a kerberos secured cluster if the zookeeper nodes can’t be looked up by passing the IP to get the hostname. Specifically, in the…