Hi,
I am a big data architect with 13+ years of experience in data engineering, analytics, and enterprise application development.
I am also a Databricks certified spark developer. I have experience in deploying hadoop, spark and other big data capable stores like elasticsearch on cloud.
I have extensive experience in processing big data using Apache Spark and connecting to various datastores including Files on HDFS, HBase, Oracle, MySQL, Cassandra, and ElasticSearch. I have extensive experience in hadoop ecosystem compoenents including storm, spark, hive, hbase, hdfs, oozie, flume, sqoop etc. I have built batch and realtime data processing systems on top of hadoop.
In my past projects, I have developed a data warehouse offloading solution into Hadoop. This involved fetching data from multiple sources like Oracle, MySQL and storing into Hadoop based datalake. This was deployed on Amazon EC2.
On the application development front, I also do full stack development using ReactJS, AngularJS, HTML, CSS and the spring framework stack (Spring Boot, Spring MVC, Spring Data and other spring projects). I am well versed with OOPS, Design Principles and Patterns. I also have good experience in designing APIs for micro-services style architecture.
On the DevOps front, I have used tools like Jenkins, Bamboo, Git, Sonar, Docker, Vagrant etc. to automate and reduce the release cycles.
I am interested in the project mentioned. Looking forward to talk to you!
Regards,
Pranav Shukla