top of page
Data Engineer

    (June 2022 - Sept 2024) | Toronto, ON, CA

  • Designed and implemented various API endpoints for an in-house real-time data warehouse tool, capable of ingesting batch and stream data via Confluent Connectors, Kafka topics, processed by Apache Spark and stored as metadata on Apache Hudi which in return was queryable as AWS Redshift External Tables to help deliver daily regulatory reports to different stakeholders

  • Created batch process pipelines for Ads, Amazon, Google, other services - with data retrieved from SFTP location, processed via Apache Spark and landed in AWS S3, orchestrated via Argo Workflows

  • Implemented Application monitoring on DataDog monitors and alerting via Slack and Pagerduty of various components of the project to ensure healthy, stable production environment

  • Designed, and conducted POC between Redshift and AlloyDB to determine the more promising database to store reporting data

  • Created a scheduled Airflow task to "normalize" and transform poorly constructed data on AWS Redshift using DynamoDB, and AWS S3 cloud storage

Data Engineer

     (March 2020 - June 2022) | Toronto, ON, CA

  • Created Apache Hive External tables using shared meta-store with dynamic partitioning for faster query

  • Worked on automated deployment via Kubernetes and Helm on a dockerized application; process is automated via Ansible 

  • Designed and developed automated framework to test a PySpark model which generates profit and loss on trading data stored on Hadoop Cluster, focusing on deterministic and integration testing via Apache Airflow

    • Converted pipeline to complete automated process from manual within 2 months ​

    • Completed deployment process from DEV -> QA -> UAT within a few hours (which took days to do before)

    • Demo'd in front of Manager, Director, and Head Architect of the Program 

    • Demo'd to different teams in the department as they were interested in the approach and wanted to replicate it in their project 

  • Created fully automated CI / CD Jenkins pipeline for Maven based projects; pipeline included unit testing, deployment to int_dev environment using BMC Software and integration testing

  • Responsible to coordinate release process with PROD team, while making sure release notes, QA signoffs and other documentation are written and verified 

Programming Instructor

     (Jan 2020 - Present) | Toronto, ON, CA

  • Energetically teaching children of various age groups broad range of technological skills, creating a positive, interactive and a fun-learning atmosphere while making connections that go beyond the classroom​

    • Technologies Used: Python, Arduino, Scratch

Neural Net Research Assistant

     (Sept 2019 - Dec 2019) | Toronto, ON, CA

  • Extensively researching & analyzing structural and applications of Deep Neural Networks while working hands on with TensorFlow – an open source library for dataflow and differentiable programming

  • Creating a Machine Learning model to VizWiz dataset which is able to recognize and detect presence of private visual information in images taken by blind users with 91% accuracy 

    • Technologies Used: Tensorflow, Keras API, ​Python, Anaconda

Research Paper: http://openaccess.thecvf.com/content_CVPR_2019/papers/Gurari_VizWiz-Priv_A_Dataset_for_Recognizing_the_Presence_and_Purpose_of_CVPR_2019_paper.pdf

Medium Portfolio: https://medium.com/@tirthsh0

Git Repo:  https://github.com/tirthsh/NeuralNet_Research

Software Developer

(May 2019 - Aug 2019) | Toronto, ON, CA

  • Thoroughly worked on re-designing myOps UI (a web application which is responsible to store and retrieve network topology and user data of employees via Elasticsearch ) and added additional features while effectively co-working with the UX team

    • Technologies Used: Angular 6, Elasticsearch, Typescript, NodeJS​

  • Deployed project on DEV version, which was complimented by many due to the major changes in UI, specifically Senior Director of Data Center Infrastructure & Strategy 

  • Developed Python based RESTful API to efficiently gather & analyze data from multiple endpoints generated from Nylte; world’s leading software company focused on managing and optimizing data centers

    • Technologies Used: Python Flask, Nlyte ​

  • Fun Fact: Ended up being really good at playing Foosball by the end of the 4 months!! 

Full Stack Developer & Project Coordinator

(Sept 2018 - Dec 2018) | Toronto, ON, CA

  • Assisted in developing reference implementation applications - in return helped improve efficiency & performance in Engineering team

    • Technologies Used: React, Java Spring Boot, PCF, Concourse, CI/CD Pipeline​ 

  • Initiated development of similar pricing calculator app to Microsoft Azure’s to help PMs estimate project cost for various services & infrastructure used 

    • Technologies Used: React, Javascript, ExpressJS, SQL​

  • Extensively worked with PCF, tracked projects via CI/CD concourse pipelines and deployed applications to Cloud using Java Spring Boot

  • Lead team meetings, prepared allocation reports and assisted in the hiring process of current openings; from resume scanning, to interviews, to the final step

  • One of 5 Coops' in Union committee members to plan, arrange and execute regular, monthly events for the 70+ coops at Manulife

  • Chosen as the lead Coop student across Toronto, Boston, Kitchener, Montreal offices to manage, communicate and help plan the end of the term coop fair for all coop students within the Investments Division 

DevOps Engineer 

(Sept 2017 - Dec 2017) | Markham, ON, CA

  • Developed UI for interactive functionality for the leading application performance monitoring management tool – Dynatrace AppMon; creates, updates, fetches, queries required information located on Dynatrace Server and stores it on local TD database for easy access

 

  • Managed project tracked issues and organized tasks using JIRA with the help of various technologies including Java, Java Swing, JDBC, Oracle SQL Developer and RESTful APIs

 

  • Assisted in creating Hive queries; helped Business Analysts find emerging trends by comparing new data with the EDPP database – a Hadoop base platform

  • Fun Fact: Ended up being really good at playing Billiards Pool by the end of the 4 months!! 

Web Developer [Contract]

(June 2017 - Aug 2017) | Toronto, ON, CA

Law Office of Dhananjay 
  • Designed, developed complete user-friendly website, incorporating front-end using Bootstrap framework and JS for user-interactions with challenging back-end server code using PHP & Google App Script

  • Scheduled, organized by-weekly meetings to discuss options with clients to gather requirements and analyze workable solutions

QA Developer 

(Sept 2015 - Dec 2015) | Toronto, ON, CA

  • Developed, executed complex testing tasks; required planning, scheduling, extensive troubleshooting; provided in-depth defect characterization

  • Created and ran tests for new features and regression, in accordance with test plans, and reviewed actual results against expected results to resolve bugs

  • Extensively worked with developers to help move project forward during all stages of the project life cycle

Computer Science
Teaching Instructor

(February 2018 - Aug 2018) | Toronto, ON, CA

  • Teach various computer science concepts including OO programming, memory stack, polymorphism, inheritance, etc. to university students in both Java and C

  • Regularly evaluate students to understand their strength and weakness 

Student Recruitment Assistant 

(May 2016 - May 2017) | Toronto, ON, CA

  • Provide exceptional customer service to 1000+ diverse prospective students and their families during UTSC recruitment events by responding to challenges with creative solutions

  • Confidently welcomed, greeted visitors and answered questions regarding student life at the University of Toronto, university registration process and specifics about the Computer Science program

  • Lead groups of 30+ students around the campus, answering questions while maintaining authority through the end of the tour

Lead Project Manager

(Sept 2016 - Present) | Toronto, ON, CA

  • Delivered lectures, lead discussions related to Hinduism, on current issues around the world and the different challenges and obstacles faced by Hindus in the Western society

  • Confidently lead, monitored and taught various physical activities to over 50 youth over the span of one week, including martial arts and self defense resulting in a successful and an eventful week

Sales Associate 

(May 2014 - Aug 2015) | Toronto, ON, CA

Toronto Star
  • Answered customers questions and gave information regarding procedures and promotions in a friendly manner resulting in customer satisfaction

  • Collaborated and Interacted with the manager, fellow salesmen and convinced customers to purchase the product ensuring raise in the number of sales for the company

  • Demonstrated responsibility by assisting the manager, fulfilling any tasks and being prepared and punctual on a daily basis

///////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////

© 2024 Tirth Shah

bottom of page