Workflow Element Store

  1. Feature Extraction from Images
  2. Time-Based Features
  3. Annotation
  4. Binning / Discretization
  5. Handling Noisy Data
  6. Interaction Features
  7. Data Scaling and Normalization
  8. Dimensionality Reduction
  9. Auto-Preprocessing libraries
  10. Handling Categorical Data
  11. Feature Selection
  12. Augmentation
  13. Handling Imbalanced Classes
  14. Domain-Specific Feature Engineering
  15. Dealing with Outliers
  16. Data Partitioning - Train, Validation, & Test
  17. Handling Missing Data
  18. Polynomial Features
  19. AutoEDA libraries
  20. Data Transformations
  21. Handling Time-Series Data
  22. Textual Feature Extraction
  1. Transfer Learning
  2. Binary Classification Techniques
  3. Regression Analysis
  4. Clustering
  5. External Validation
  6. GridSearchCV, RandomisedSearchCV, BayesianSearchCV
  7. Transfer Learning
  8. Early Stopping
  9. Natural Language Processing
  10. Performance Visualization
  11. Cross-Validation
  12. Regular Monitoring and Logging
  13. Hyperparameter Tuning
  14. Batch Normalization
  15. Reinforcement Learning
  16. Blackbox - Neural Network Models
  17. Weight Initialization
  18. Cross-Validation
  19. Batch Size Selection
  20. Regularization
  21. Learning Rate Scheduling
  22. Regularization Techniques
  23. Association Rules
  24. Network Analytics/ GeoSpatial Analytics
  25. AutoML
  26. Model Interpretability
  27. Word Embeddings
  28. Ensemble Techniques
  29. Model Comparison
  30. Recommendation Engine
  31. Forecasting Techniques
  32. Evaluation Metrics
  33. Data Augmentation
  34. Multiclass Classification Techniques
  1. code repository
  2. Databases
  3. Kafka Brokers
  4. model registry
  5. Github
  6. Github Actions
  7. Evidently.ai
  8. Datawarehouse
  9. Data Preprocessing pipeline models
  10. Apache Airflow
ML Workflow - Architecture
  • Element belongs to model
  • Element not belongs to model
Validate Export

Data Sources

Streaming Data

Batch Data

Cloud Storage

Labeled Data

Feature Engineering Pipeline

Experimentation

ML Model

Repository

CI/CD component

Continuous integration/Continuous delivery

Continuous deployment

Artifact Store

Feature Store System

Orchestration Component

Artifact Store

CI/CD Component

Scheduler

Workflow orchestration component

Automation ML Workflow Pipeline

Monitoring Component

Model serving component

(Prediction on new batch or streaming data)