profile-pic

Aman Mishra

Highly competent professional with 6 years of experience and proven track record in Python Development and Data Engineering. Energetic, ambitious person having a mature & responsible approach to any task that I undertake or situation I am presented with.
  • Role

    Sr. Python Developer

  • Years of Experience

    7.4 years

  • Professional Portfolio

    View here

Skillsets

  • ETL pipelines
  • Jenkins - 2 Years
  • Bamboo - 1 Years
  • CircleCI - 1 Years
  • GitHub Actions - 3 Years
  • REST API - 4 Years
  • Backend Development
  • Data Engineering
  • Data Warehousing
  • GitLab - 3 Years
  • SQL - 6 Years
  • ETL - 5 Years
  • Restful APIs - 6 Years
  • Python
  • SQL
  • Web Scraping
  • NoSQL
  • Mongo DB - 2 Years
  • Django - 2 Years
  • REST API - 4 Years
  • Cherrypy - 1 Years
  • Snowflake - 4 Years
  • Docker - 3 Years
  • Airflow - 4 Years
  • dbt - 2 Years
  • BigQuery - 3 Years
  • Python - 6 Years
  • Postgre SQL - 3 Years
  • Redshift - 2 Years
  • FastAPI - 3 Years
  • AWS - 6 Years
  • GCP - 4 Years
  • Github - 6 Years
  • Bitbucket - 3 Years

Professional Summary

7.4Years
  • Sep, 2024 - Present1 yr 1 month

    Technical Lead

    LivePerson
  • Feb, 2024 - Sep, 2024 7 months

    Technical Lead

    Relso
  • Oct, 2022 - Feb, 20241 yr 4 months

    Technical Lead

    Tredence Analytics
  • Feb, 2020 - Nov, 2020 9 months

    Python Developer

    Miko.ai
  • Nov, 2020 - Feb, 2021 3 months

    SSE

    Velotio Technologies
  • Feb, 2021 - Oct, 20221 yr 8 months

    Technical Lead

    Ness Digital
  • Jun, 2018 - Feb, 20201 yr 8 months

    Senior Testing Executive

    Infosys Limited

Applications & Tools Known

  • icon-tool

    Docker

  • icon-tool

    KAFKA

  • icon-tool

    Databricks

  • icon-tool

    BigQuery

  • icon-tool

    MongoDB

  • icon-tool

    PostgreSQL

  • icon-tool

    Redshift

  • icon-tool

    RDS

  • icon-tool

    MySQL

  • icon-tool

    OrientDB

  • icon-tool

    Jenkins

  • icon-tool

    Bamboo

  • icon-tool

    CircleCI

  • icon-tool

    Github Actions

  • icon-tool

    GitLab

  • icon-tool

    GitHub

  • icon-tool

    Bitbucket

  • icon-tool

    SVN

  • icon-tool

    AWS

  • icon-tool

    Heroku

  • icon-tool

    GCP

Work History

7.4Years

Technical Lead

LivePerson
Sep, 2024 - Present1 yr 1 month
    Designed and developed scalable data ingestion pipelines, implemented real-time data streaming, built end-to-end data pipelines, and led a team of 5 members.

Technical Lead

Relso
Feb, 2024 - Sep, 2024 7 months
    Engineered an Image Generation tool, architected an analytics platform, automated application deployment, and developed a YAML-based scraping framework.

Technical Lead

Tredence Analytics
Oct, 2022 - Feb, 20241 yr 4 months
    Led a 9-member team, designed an efficient data model, developed DBT models, and implemented Airflow DAGs.

Technical Lead

Ness Digital
Feb, 2021 - Oct, 20221 yr 8 months
    Developed ETL data connectors, improved analytics efficiency, and implemented a notification platform.

SSE

Velotio Technologies
Nov, 2020 - Feb, 2021 3 months
    Created a Jenkins Bot, developed large scale data conversion pipelines, and migrated data pipelines.

Python Developer

Miko.ai
Feb, 2020 - Nov, 2020 9 months
    Developed recommendation systems, created data scraping scripts, solved context management on Chatbots.

Senior Testing Executive

Infosys Limited
Jun, 2018 - Feb, 20201 yr 8 months
    Oversaw database migration, created tools to automate configuration changes, developed automation scripts.

Achievements

  • Completed an 18-month project in just 4 months at SurveyMonkey
  • Developed recommendation systems for IPL 2020
  • Achieved 10X better performance and 5X cost savings with the new data pipeline at Womply
  • Successfully migrated the data platform from on-prem Oracle databases to GCP BigQuery with no downtime at Activision
  • Contributed to the creation of Jenkins Bot for deployment of code directly to different environments via Jenkins with Tredence Analytics

Major Projects

3Projects

SurveyMonkey Data Platform

    Created a data platform for BI and executives to generate reports and dashboards for KPIs and metrics. Led a 9-member team, completing an 18-month project in just 4 months. Analyzed source data, created an efficient data model for key business KPIs and metrics. Developed and deployed DBT models for smooth data flow across zones. Implemented airflow DAGs to orchestrate data ingestion from S3, APIs, DBs. Established Fivetran connectors for data extraction from vendors like GA4, GSC, Trade Desk.

Activision Data Platform Migration

    Developed a scalable, platform-independent ingestion framework using Python and Airflow, driven by configurations. Successfully migrated the data platform from on-prem Oracle databases to GCP BigQuery with no downtime. Orchestrated over 100 Airflow pipelines for efficient data processing. Devised an intelligent framework capable of loading data in dynamic batch sizes, preventing failures due to data volume. Engineered a user-friendly tool enabling non-technical users to directly pull data from various sources into BigQuery.

Womply Data Pipelines

    Developed large scale data conversion pipelines from JSON to Parquet jobs using PySpark and scheduled them with Apache Airflow. Achieved 10X better performance and 5X cost savings with the new data pipeline. Developed more efficient Data Pipeline to migrate the data from source (RDS) to destination (Snowflake). Migrated 15+ different old data pipeline infrastructure components like AWS Glue, RDS instances, S3 etc. efficiently to new infrastructure using tools like Terraform.

Education

  • Bachelor in Computer Science

    Mumbai University (2018)

  • H.S.C

    Mumbai University (2015)

Interests

  • Trekking
  • Painting
  • Dance
  • Gyming
  • Technology Research