AI firewall

An AI firewall would inspect and block user prompts when it detects it may lead to data leakage, making the system unstable, or exahusting resources (number of tokens).

Further reading

  • ri-7 Availability of foundational model
  • ri-10 Prompt injection
  • ri-15 Data leakage
  • CT-8 QoS/DDoS prevention
  • CT-9 Alerting / DoW spend alert
  • CT-12 Role-based data access