![]() Used ticketing systems like JIRA, Bugzilla, and other proprietary tools. Experience with Test Driven Development (TDD), Agile, Scrum and Waterfall methodologies.Worked in agile and waterfall methodologies with high quality deliverables delivered on-time.Good knowledge in Software Development Life Cycle (SDLC) and Software Testing Life Cycle (STLC).Experienced in WAMP (Windows, Apache, MYSQL, and Python) and LAMP (Linux, Apache, MySQL, and Python) Architecture and Wrote Automation test cases using Selenium Web Driver, JUnit, Maven, and spring.Hands on experience in MVC architecture and Java EE frameworks like Struts2, Spring MVC, and Hibernate.Good experience with Talend open studio for designing ETL Jobs for Processing of data. Knowledge on Scala Programming Language.Knowledge on Spark framework for batch and real-time data processing.Experienced in developing Web Services with Python programming language and Good working experience in processing large datasets with Spark using Scala and Pyspark.Having a Complete Understanding on Lambda architectures.Extensive experience in deploying, configuring, and administering Splunk clusters.Good Knowledge in Amazon AWS concepts like EMR and EC2 web services which provides fast and efficient processing of Big Data.Expertise in Working on Data Encryption (Client-Side and Server-Side) and securing data at rest and in transit for data in S3, EBS, RDS, EMR, Red Shift using Key Management Service (KMS).Worked extensively in design and development of business process using SQOOP, PIG, HIVE, HBASE.Extensive knowledge of creating manages tables and external tables in Hive Eco system.Experience in optimizing volumes, EC2 instances and created multiple VPC instances and created alarms and notifications for EC2 instances using Cloud Watch.Good Experience in the core concepts of MapReduce Framework and Hadoop ecosystem. ![]() Skilled on migrating the data from different databases to Hadoop HDFS and Hive using SQOOP.Experience in running Spark streaming applications in cluster mode and Spark log debugging.Expertise in software development environments with machine learning algorithms and deep learning frameworks such as TensorFlow, PyTorch, Computational and Recurring Neural Network.Good Knowledge in Apache Spark and SparkSQL.Knowledge on integrating different eco-systems like Kafka - Spark - HDFS.Familiar with JSON based REST Web services and Amazon Web services.Good experience in working with Amazon Web Services like EC2, Virtual private clouds (VPCs), Storage models (EBS, S3, instance storage), Elastic Load Balancers (ELBs).Have experience on Kubernetes and Docker for runtime environment of system to build, test & deploy.Experienced in MVW frameworks like Django, Angular.js, Java Script, backbone.js, jQuery and Node.js.Experienced in WAMP (Windows, Apache, MYSQL, and PHP) and LAMP (Linux, Apache, MySQL, and PHP) Architecture.Experience in building isomorphic applications using React.js and Redux with GraphQL on server side.Experience object-oriented programming (OOP) concepts using Python, Django, and Linux. Experienced in using MVC architecture using RESTful, Soap Web services and SoapUI and high-level Python Web frameworks like Django and Flask.Experience with Web Development, Amazon Web Services, Python, and the Django framework.Proficient in designing and querying the NoSQL databases like Hbase, Cassandra, MongoDB, Impala.Hands on experience in configuring and working with Flume to load the data from multiple sources.Expertise in developing data driven applications using Python 2.7, Python 3.0 on P圜harm and Anaconda Spyder IDE's.Implemented workflow actions to drive troubleshooting across multiple event types in Splunk.Extensive work in ETL process consisting of data transformation, data sourcing, mapping, conversion, and loading using Informatica.Expertise with different tools in Hadoop Environment including Pig, Hive, HDFS, MapReduce, Sqoop, Spark, Kafka, Yarn, Oozie, and Zookeeper.Experience in real time data from various data sources through Kafka data pipelines and applied various transformations to normalize the data stored in HDFS Data Lake.Have a hand - on experience on fetching the live stream data from DB2 to HDFS using Spark Streaming and Apache Kafka.Around 8 years of experience spread across Python, Big Data, Apache Spark, Scala, Java, SQL technologies.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |