AI-powered features carry real per-request cost and can be abused to extract data or run up bills through automated requests. Rate-limiting and monitoring AI endpoints protects both your budget and your model from the abuse that unthrottled access invites.
“An unthrottled AI endpoint is an open tab attackers will run up.”