Shahzeb-DataEngineer

Hi, I’m Shahzeb Ali 👋

**Data Engineer

Data Pipelines & Lakehouse

Open-Source Contributor**

I design and build reliable data pipelines — from ingestion to analytics-ready datasets. My day-to-day work is ETL/ELT in Python and SQL, large-scale processing on Apache Spark and Databricks, and dimensional modeling, with a focus on getting incremental ingestion right: CDC, Delta Lake MERGE, and clean dbt transformations.

💻 Technical Skills

• Languages: Python, SQL, Rust
• Data Processing: Apache Spark, Databricks, Delta Lake, dbt, Apache Airflow
• Databases: PostgreSQL, MS SQL Server, SSIS, SSAS
• Data Manipulation: Pandas, NumPy
• Architecture: Medallion Architecture, CDC, Delta MERGE, Dimensional Modeling
• Testing & Quality: pytest, Rust tests, SQL validation

🚀 Current Work & Interests

• 🔵 Contributing to Apache, Delta Lake, dbt Labs, and other data-engineering open-source projects
• 🔵 Building reliable ETL/ELT pipelines and lakehouse architectures
• 🔵 Working with Delta Lake, Apache Spark, and Databricks at scale
• 🔵 Exploring query optimization, data quality monitoring, and incremental ingestion patterns

🌱 Open-Source Contributions

I contribute to bug fixes, documentation, tests, and performance improvements across data-engineering projects.

Organization	Project	Status	Pull Requests	Contributions
Delta Lake	delta-rs	3 merged, 1 open	#4832, #4833, #4866, #4890	Schema merging nullable fix (Rust), deletedFileRetentionDuration docs, TIMESTAMP UTC offset fix, multiple conditional clauses merge examples
Kedro	kedro	2 merged	#5809, #5808	CachedDataset docs example, templating concept page rewrite
SQLFluff	sqlfluff	1 merged	#8715	Removed outdated Snowflake USING note from Rule ST07
Airbyte	airbyte	1 merged	#88468	Fixed dead low-code CDK sample connector links
ClickHouse	ClickHouse	1 merged	#125739	Version note for Replicated engine default_replica_path settings
Apache	Iceberg	1 open	#18468	Spark branch write precedence docs
Apache	DataFusion	1 open	#26198	Validate pruning-ratio config at SET time
Apache	Airflow	1 open	#74424	Missing tests for cncf.kubernetes utilities
dbt Labs	dbt	1 open	#16690	Log effective thread count at startup
OpenMetadata	docs-om	1 open	#599	OpenSearch FGAC permissions guide
Canonical	craft-cli	1 open	#504	TypeError for non-string items in humanize_list
Canonical	craft-providers	1 open	#1026	Typed error for unsupported Ubuntu version in base checks

🛠️ Technologies Used

• Languages: Python, SQL, Rust
• Data Processing: Apache Spark, Databricks, Delta Lake, dbt, Apache Airflow
• Databases & Warehousing: PostgreSQL, MS SQL Server, SSIS, SSAS
• Data Manipulation: Pandas, NumPy
• Architecture: Medallion Architecture, CDC, Delta MERGE, Dimensional Modeling
• Testing & Quality: pytest, Rust tests, SQL validation

📊 GitHub Activity

• 8 merged PRs across Delta Lake, Kedro, SQLFluff, Airbyte, and ClickHouse
• 8 open PRs across Delta Lake, Apache, dbt Labs, OpenMetadata, and Canonical
• Contributing to docs, tests, bug fixes, and performance improvements

💼 Experience & Education

• Data Engineer — Alphabridge Consulting Ltd, Lahore (Aug 2026)
• Teaching Assistant, DBMS & Data Warehousing / BI — PUCIT, Lahore (Jan 2025 – Jan 2026)
• BS Data Science — University of the Punjab, PUCIT (2022 – 2026)

📫 Connect With Me

• Email: shahzebali1218@gmail.com
• GitHub: Shahzeb-DataEngineer

---

Building reliable data pipelines, one PR at a time. 🚀