Abhijeet Shinde
Arvada
Summary
Offering more than 15 years of in-depth Information Technology (IT) experience, with 12 years proficiency in Extract Transform Load (ETL) data development, data warehousing and reporting. Expert in Python paired with Airflow, Snowflake, MS SQL, PL SQL, Tableau, Apache Druid, Apache SuperSet and AWS services. Exposed to data modeling methodologies while working on major data warehouse projects. Remain up-to-date on Information Technology (IT).
Overview
21
21
years of professional experience
Work History
Data Engineer
Insticator
07.2021 - Current
- Implemented Apache Druid data warehouse on AWS and worked on to create pipelines to ingest hourly rollup log level (over 500 millions of rows for 1 hour) data into Apache Druid using Apache Airflow to make analysis faster
- Also worked on Apache SuperSet to connect with Apache Druid and create Charts and Dashboards
- Build a data warehouse in snowflake and data pipelines in airflow from scratch
- Build pipelines to collect data from Elastic search, mysql RDS, MongoDB, and different APIs like Google ad manager, Google analytics etc
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability
- Build data models
- Documented and communicated database schemas using accepted notations.
- Worked with the engineering team to expose data points to outside users (publishers) in web portal
- Build dashboards in Snowsight for internal users
- Used third party ML tools (IBM Watson Natural Language Understanding and Hive.ai) to extract meaning and metadata from url and text to get underneath data using text analytics to extract categories, classification, entities, keywords, sentiment, emotion, relations, and syntax
- Implemented best practices in the data team
- Lead team of junior data engineer and data analyst
- Developed database architectural strategies at modeling, design, and implementation stages to address business or industry requirements.
- Reviewed project requests describing database user needs to estimate time and cost required to accomplish projects.
Data Engineer
RE/MAX LLC
01.2013 - 07.2021
- Crafted distributed reporting processes using Python, airflow, AWS Services, snowflake, SQL, and tableau
- Led MSSQL to Snowflake data warehouse migration in 1/3rd of estimated time
- Reviewed project requests describing database user needs to estimate time and cost required to accomplish projects.
- Automated 40+ ETL solutions including Bulk Load and Type 1/Type 2 update, making it easier to wrangle data and reducing time by as much as 40%
- Involved in setting strategy and standards through data warehouse migration leveraging open source technologies and AWS services
- Researched and evaluated open source alternatives to commercial software
- Provided subject matter expertise in the analysis, preparation of specifications and plans for the development of data pipelines
- Developed and maintained more than 50 WEBi reports and MicroStrategy
- Created and updated multiple SAP BusinessObjects Universe
- Maintained all ETL requirement and specification documentation used in data transformation procedures
- Accelerated process automation by applying agile software development methods
Sr Software Developer
RE/MAX of Texas
01.2008 - 01.2013
- Developed a web application to analyze Texas Real estate market
- Designed and implemented a web application to analyze Texas real estate market collecting data from 40+ MLS was accessible in real-time to franchise owners
- Worked stakeholders to establish design of experiment and the measurement system for effectiveness of product improvements
- Created merged datasets and combined information across systems for stakeholder requested deliverables
- Developed and maintained online payment system in ASP.NET using PayPal SDK
- Developed, tested, and maintained 20+ SSIS ETL processes loading to and from regional data warehouse
- Developed process to download Agent, Office and Transactions data daily from 42 different MLS using MSSQL, Teradata and flat files as data source
Software Developer
Extenprise eSolutions Pvt. Ltd.
01.2006 - 01.2007
- Coded, tested, and supported 50 enhancements and bug fixes to Health Management System
- Worked in partnership with all levels of business stakeholders to design, implement, and deliver enterprise solutions
Software Developer
FDS Infotech Pvt. Ltd.
01.2004 - 01.2006
- Designed, coded, tested, and supported 70 enhancements to enterprise application to handle business transactions related to services, contracts and billing
- Selected to go onsite and give training to a client in Cologne, Germany
Education
Master of Science - Management Information System
University of Houston Clear Lake
Houston, TX05-2009
Bachelor of Engineering - Computer Science
Pune University
Pune, India05-2005
Skills
- Data Transformation
- Data Modeling
- Data Visualization Services
- NoSQL databases
- ETL/ELT development
- Data integration
- Data modeling
- Data pipeline control
- Data migration
- Data warehousing
- Business intelligence
- Relational databases
Timeline
Data Engineer
Insticator
07.2021 - Current
Data Engineer
RE/MAX LLC
01.2013 - 07.2021
Sr Software Developer
RE/MAX of Texas
01.2008 - 01.2013
Software Developer
Extenprise eSolutions Pvt. Ltd.
01.2006 - 01.2007
Software Developer
FDS Infotech Pvt. Ltd.
01.2004 - 01.2006
Master of Science - Management Information System
University of Houston Clear Lake
Bachelor of Engineering - Computer Science
Pune University
Similar Profiles
Anurag TiwariAnurag Tiwari
Publisher Sales Lead (contract) at InsticatorPublisher Sales Lead (contract) at Insticator
Diego AnayaDiego Anaya
Barista at StarbucksBarista at Starbucks
XUE LIU-DUNLOPXUE LIU-DUNLOP
HR Manager at Emerson ElectricHR Manager at Emerson Electric