Workflow Element Store

  1. Handling Imbalanced Classes
  2. Handling Time-Series Data
  3. Annotation
  4. Textual Feature Extraction
  5. Feature Selection
  6. Binning / Discretization
  7. Dealing with Outliers
  8. Interaction Features
  9. Data Partitioning - Train, Validation, & Test
  10. Dimensionality Reduction
  11. Polynomial Features
  12. Handling Missing Data
  13. Feature Extraction from Images
  14. Handling Noisy Data
  15. Data Scaling and Normalization
  16. Augmentation
  17. Auto-Preprocessing libraries
  18. AutoEDA libraries
  19. Data Transformations
  20. Time-Based Features
  21. Handling Categorical Data
  22. Domain-Specific Feature Engineering
  1. Performance Visualization
  2. Learning Rate Scheduling
  3. Recommendation Engine
  4. Forecasting Techniques
  5. Model Interpretability
  6. Batch Size Selection
  7. Clustering
  8. Weight Initialization
  9. Early Stopping
  10. Ensemble Techniques
  11. Evaluation Metrics
  12. Transfer Learning
  13. Cross-Validation
  14. Word Embeddings
  15. Regularization
  16. AutoML
  17. Blackbox - Neural Network Models
  18. Hyperparameter Tuning
  19. Cross-Validation
  20. Regularization Techniques
  21. Natural Language Processing
  22. Network Analytics/ GeoSpatial Analytics
  23. External Validation
  24. Multiclass Classification Techniques
  25. GridSearchCV, RandomisedSearchCV, BayesianSearchCV
  26. Binary Classification Techniques
  27. Batch Normalization
  28. Model Comparison
  29. Data Augmentation
  30. Reinforcement Learning
  31. Regression Analysis
  32. Association Rules
  33. Regular Monitoring and Logging
  34. Transfer Learning
  1. Apache Airflow
  2. Evidently.ai
  3. Datawarehouse
  4. Github Actions
  5. Data Preprocessing pipeline models
  6. code repository
  7. model registry
  8. Github
  9. Kafka Brokers
  10. Databases
ML Workflow - Architecture
  • Element belongs to model
  • Element not belongs to model
Validate Export

Data Sources

Streaming Data

Batch Data

Cloud Storage

Labeled Data

Feature Engineering Pipeline

Experimentation

ML Model

Repository

CI/CD component

Continuous integration/Continuous delivery

Continuous deployment

Artifact Store

Feature Store System

Orchestration Component

Artifact Store

CI/CD Component

Scheduler

Workflow orchestration component

Automation ML Workflow Pipeline

Monitoring Component

Model serving component

(Prediction on new batch or streaming data)