Author Archives: suniluiit

About suniluiit

Technical Architect working in Big data and Cloud technologies for the last 5 years with overall software industry experience of around 9 years. Architected and Working on Impetus Workload Migration Product which allows organizations to saves 50%-80% manual offloading time and cost. It provides faster parallel & scalable data migration to Hadoop along with incremental data options. It also maximize the existing investments in code and reuse of SQL scripts. Architected and Developed cloud agnostic application for deployment and configuration management of the enterprise application including technologies stacks like CQ5, Cassandra, Solr, Application Server, Web server, Haproxy, F5 and messaging server. Experienced in working and leading R&D teams for building new expertise in fields such as Big data, ETL offloading to Big Data and Cloud computing. Worked on some of the impetus open source product around Big Data and Social Media http://code.google.com/p/hadoop-toolkit/ http://code.google.com/p/zing https://github.com/impetus-opensource Specialties: Big data, Hadoop, HIve, Sqoop, Spark, J2EE/ SOA, NoSQL, Cassandra, HBase, Cloud Computing (Private/Hybrid/Public- AWS, Google, Azure, Rackspace, Openstack, VMWare, Terremark, RabbitMQ, Kafka, Memcached, Puppet, HypericHQ, Splunk etc.

Steps and Sample to connect Kerberosed Hive form Local Windows desktop/laptop

Follow following steps to connect Kerberosed Hive form Local Windows desktop/laptop: Install MIT Kerberos Distribution software from “http://web.mit.edu/kerberos/dist/” Configure  winutils.exe for Hadoop connection from “https://github.com/steveloughran/winutils/tree/master/hadoop-2.7.1/bin” Set up the Kerberos configuration file in the default location. Obtain a krb5.conf configuration file … Continue reading

Posted in Uncategorized | Tagged , | Leave a comment

Configuring Transparent Proxy Server on AWS VPC NAT instance for Controlled Access to the S3 bucket / Specific URL

Goal:We use S3 bucket for storing sensitive data in and process it on EC2 instances, located in the private subnet of the private/public VPC. To control access on account/user s3 bucket we set up S3 buckets policy by IP and … Continue reading

Posted in AWS Cloud, Cloud Computing, J2EE technoloy, Monitoring, S3 Bucket, VPC and S3 bucket | Tagged , , , , , | 3 Comments

Monitoring and Log analysis strategies for the Dynamic world of Cloud….

Monitoring and Log analysis strategies for the Dynamic world of Cloud…. Organizations are becoming increasingly interested in leveraging cloud computing services to improve flexibility and scalability of the IT services delivered to end-users. However, organizations using cloud computing services face … Continue reading

Posted in J2EE technoloy, Monitoring | Leave a comment

Monitoring and Log analysis strategies for the Dynamic world of Cloud….

Monitoring and Log analysis strategies for the Dynamic world of Cloud…. Organizations are becoming increasingly interested in leveraging cloud computing services to improve flexibility and scalability of the IT services delivered to end-users. However, organizations using cloud computing services face … Continue reading

Posted in Cloud Computing | Tagged , , , , , | Leave a comment

Apache Cassandra monitoring through Hyperic HQ

For monitoring Cassandra through Hyperic HQ server you need to write hyperic JMX plugin as well as you need to change java opts in the Cassandra server. Follow following steps to monitor Cassandra through hyperic HQ: 1. Modify Cassandra  server … Continue reading

Posted in Uncategorized | 12 Comments

GlassFishV3 Application server Monitoring with Hyperic HQ

Let me first give you brief about Open source Hyperic HQ designed to provide all fundamental management and monitoring capabilities for web applications and IT infrastructures. Key Facts about the HQ Architecture This diagram is a simple illustration of the … Continue reading

Posted in Uncategorized | 2 Comments

Configuring Cassandra Cluster on cloud with Load Balancer

Cloud Used: Rackspace Load Balancer used: HAProxy OS: Centos 5.5 Cassandra version used: apache-cassandra-0.6.5 Find below steps to cluster Cassandra through HAProxy on Rackspace Cloud:- 1.     Install HAProxy on the any node currently I am using centos 5.5 2.     Install … Continue reading

Posted in Uncategorized | 1 Comment

Configuring RabbitMQ Cluster on Cloud

Follow following steps to configure RabbitMQ server Cluster on Rackspace Cetos5.5– 1. Install gcc on the centos by running following commands on the command prompt [root@RabbitMQ1 /root/] yum -y install make gcc gcc-c++ kernel-devel m4 ncurses-devel openssl-devel 2. Download Erlang … Continue reading

Posted in Uncategorized | 7 Comments