Skip to main content
Data Engineer at work

Welcome to My Portfolio

Data Engineer | Cloud Architect | AI/ML Specialist

I am a passionate and results-driven professional with expertise in designing petabyte-scale data platforms, optimizing cloud infrastructure, and implementing AI/ML solutions. With 4+ years of experience, I specialize in building real-time data pipelines, reducing cloud costs, and creating scalable machine learning systems.

Kalyan Kasinadhuni, Data Engineer and AI Specialist

About Me

I started my journey in data engineering with a Bachelor's degree in Computer Science and have since pursued a Master's in Computer Science. My career spans roles in analytics engineering, cloud architecture, and AI implementation for Fortune 500 companies.

I excel at combining technical expertise with strategic thinking to deliver impactful solutions. My passion lies in exploring the intersection of cloud computing, real-time data processing, and artificial intelligence to create value for organizations.

4+ Years of Experience
Master's in Computer Science
Bachelor's in Computer Science
Multiple Industry Certifications

Technical Skills

A comprehensive toolkit built over 4+ years of professional experience across data engineering, cloud architecture, and AI/ML.

Data engineering concepts

Cloud Platforms

  • AWS (Kinesis, Glue, Redshift, Lambda, EMR)
  • Azure (Databricks, Synapse, Purview)
  • GCP (BigQuery, Dataflow)

Big Data Stack

  • Spark (PySpark/Scala)
  • Kafka, Flink, Airflow
  • dbt, Snowflake, Iceberg
  • Delta Lake, Hudi

Data Architecture

  • Data Mesh
  • Medallion Architecture
  • CDC (Debezium)
  • DWH Modeling (Data Vault 2.0)

ML/GenAI

  • LLM Orchestration (LangChain, LlamaIndex)
  • Vector DBs (Pinecone)
  • Feature Stores (Feast)

DevOps

  • Terraform, Kubernetes
  • CI/CD (GitHub Actions, Jenkins)
  • Docker, ArgoCD

Programming

Python SQL Scala Java Bash

Featured Projects

A selection of my best work showcasing diverse skills in cloud architecture, real-time data processing, and AI implementation.

Financial data visualization representing real-time surveillance system

Real-Time Financial Surveillance

Kafka/Flink

Designed and deployed a distributed event processing system using Kafka Streams with Flink Stateful Functions, handling 500K transactions/sec across 3 global regions with exactly-once processing semantics.

Technologies Used:

Kafka Flink AWS Java

Key Achievements:

  • Reduced fraudulent transaction slippage by 37% ($4.2M annual savings)
  • Achieved sub-100ms latency for transaction processing
  • Implemented exactly-once processing semantics
AI and documents representing generative AI processing

Generative AI Document Processing

LLM

Engineered an LLM-powered document processing system using Llama2-70B, LangChain, and Pinecone, automating extraction of key terms from 10K+ monthly contracts.

Technologies Used:

Llama2 LangChain Pinecone Python

Key Achievements:

  • Reduced legal review time by 62%
  • Maintained 98% accuracy via human-in-the-loop validation
  • Processed 10K+ documents monthly
Cloud computing representing cost optimization

Cloud Cost Optimization

FinOps

Spearheaded AWS FinOps initiative implementing Redshift RA3 instances with automatic workload management, S3 Intelligent Tiering with lifecycle policies, and Glue Flex jobs with spot instances.

Technologies Used:

AWS Redshift S3 Glue

Key Achievements:

  • Achieved 48% cost reduction ($320K annual savings)
  • Maintained 99.95% SLA during optimization
  • Won 2023 "Cloud Innovator" award
Healthcare data representing clinical data modernization

Clinical Data Modernization

Healthcare

Led migration of 22 legacy SAS pipelines to Delta Lake on Databricks, implementing incremental MERGE patterns for 12TB/day of patient telemetry data.

Technologies Used:

Databricks Delta Lake Azure PySpark

Key Achievements:

  • Reduced FDA submission preparation time from 14 days to 72 hours
  • Processed 12TB/day of patient telemetry data
  • Implemented incremental MERGE patterns

Certifications

Industry-recognized credentials validating my expertise in cloud computing and data technologies.

Cloud certification badge

Professional Credentials

Continuously expanding my knowledge and skills

In Progress

AWS Certified Solutions Architect

Professional Level

Cloud Architecture Design
AWS Well-Architected Framework
Security & Compliance
In Progress

Azure Data Engineer

DP-203 Certified

Data Storage Solutions
Data Processing
Data Security & Compliance
In Progress

Databricks Certified Data Engineer

Professional Certification

Spark Optimization
Delta Lake
Data Pipelines

Continuously pursuing additional certifications to stay at the forefront of cloud and data technologies.

Get in Touch

Let's discuss how my expertise in cloud architecture, data engineering, and AI can bring value to your organization.

Send Me a Message

Let's Build Something Amazing Together

I'm always open to discussing new projects, creative ideas, or opportunities to be part of your vision.

Get Started