Data Science Lifecycle (Data Collection → Wrangling → Analysis → Modeling → Communication)
Roles: Data Scientist, Data Analyst, Data Engineer
Applications: Finance, Healthcare, Marketing, E-commerce, Social Media
A. Linear Algebra
Vectors, Matrices, Tensors
Matrix Operations
Eigenvalues & Eigenvectors
Applications in ML (e.g., PCA)
B. Calculus
Derivatives and Gradients
Partial Derivatives
Chain Rule
Applications in Optimization (e.g., Gradient Descent)
C. Probability and Statistics
Descriptive Statistics: Mean, Median, Mode, Variance, Skewness
Probability Theory: Bayes Theorem, Conditional Probability
Distributions: Normal, Binomial, Poisson, Uniform
Hypothesis Testing: p-value, t-test, ANOVA, Chi-Square
Confidence Intervals and Z-scores
Central Limit Theorem
Python or R (Primary Language)
Variables, Loops, Functions
List Comprehensions, Lambda Functions
Error Handling, File I/O
Object-Oriented Programming (OOP)
Python Libraries:
NumPy (Arrays and Linear Algebra)
Pandas (DataFrames, Data Cleaning, Merging)
Matplotlib & Seaborn (Data Visualization)
Scikit-learn (ML Models)
Statsmodels (Statistical Analysis)
Data Collection Techniques: APIs, Web Scraping, SQL
Handling Missing Values
Data Cleaning: Duplicates, Typos, Outliers
Data Transformation: Normalization, Standardization
Feature Engineering
Encoding Categorical Variables (One-Hot, Label Encoding)
Date/Time Handling
Univariate Analysis
Bivariate & Multivariate Analysis
Correlation Analysis
Boxplots, Histograms, Heatmaps
Detecting Outliers
Business Understanding from Data Patterns
Supervised Learning:
Linear Regression
Logistic Regression
Decision Trees and Random Forests
K-Nearest Neighbors (KNN)
Support Vector Machines (SVM)
Naive Bayes Classifier
Unsupervised Learning:
Clustering: K-means, Hierarchical, DBSCAN
Dimensionality Reduction: PCA, t-SNE
Model Evaluation:
Train-Test Split, Cross-Validation
Metrics: Accuracy, Precision, Recall, F1 Score, ROC-AUC
Confusion Matrix
Ensemble Methods: Bagging, Boosting (XGBoost, LightGBM)
Neural Networks (ANN)
CNNs (Computer Vision)
RNNs and LSTM (Time Series / NLP)
Deep Learning Frameworks: TensorFlow, Keras, PyTorch
Components: Trend, Seasonality, Noise
AR, MA, ARMA, ARIMA models
Forecasting Techniques
Exponential Smoothing
Prophet Model by Facebook
Text Preprocessing: Tokenization, Stop Words, Stemming, Lemmatization
Bag of Words, TF-IDF
Word Embeddings: Word2Vec, GloVe
Sentiment Analysis
Topic Modeling: LDA
Transformer Models (BERT, GPT - intro)