Raghavendra V

Led a team of 5 engineers in designing and developing the project from scratch to go-live. Architected the framework, defined data flows, and integrated real-time inventory tracking using GCP Cloud and PYSPARK. Optimized workflows, managed testing and deployment, and ensured smooth production transitions. Coordinated with cross-functional teams and established post-go-live monitoring and documentation.

Customer Data Platform: Played a major role in the design and development of a customer data platform using Spark and Scala. Data Pipelines: Built multiple data pipelines leveraging AWS cloud services and Spark technologies, utilizing Spark, Scala, and Python. Delta Lake Integration: Migrated traditional data flows to Delta Lake to ensure historical tracking of daily uploads using Spark, Scala, SQL, and Python.

Currently working on a migration project where we are pulling Informatica data into HDFS and processing it using PYSPARK by converting the SQL queries to SPARK SCALA DATAFRAMES and pushing the data back to HDFS. Built a data pipeline using Storm, JAVA,, Scala, Kafka, HBase, Elasticsearch, AWS S3 to create a Product Matching Platform that provides competitors product recommendations for a retailer's product. Built a data pipeline using Storm, Scala-Spark, Kafka, HBase, Elasticsearch, AWS S3, Angular 6 to stream, process, store, and provide various reports to clients that help solve business problems.

Developed Action class and form beans based on requirements. Wrote business logic using design patterns. Introduced a Data Access Service layer for data operations. Utilized Java, Spark Core, and Spark DataFrames for data processing and transformations. Implemented data aggregation, querying, and integration with Hive and Oracle databases.