My GAE app has billing enabled & it is set to unlimited. Last night, it hit a quota limit on DB reads & stopped working. I'm not the billing admin, but I can see that they charged $.97 & then credited the $.97 for over quota on DB reads. I'm guessing we hit a "safety limit"? Is there a way to verify this? Is there something else that needs to be set up in the limits? Quota was reset today & app is working fine. Need to avoid hitting this again.
Thanks.
Check the Quota page in the Cloud console. There is a link on that page to request additional quota if that is appropriate for your app.
Related
Our application makes use of a service account that has been authorized for the entire domain by the admin. With this service account our application accesses the domain user's emails with Gmail APIs like GetMessage.
All of a sudden, starting this week, we have started receiving the errors intermittently
Quota exceeded for quota metric 'Queries' and limit 'Queries per minute per user' of service 'gmail.googleapis.com' for consumer 'project_number:XYZ
There is no change in our application or frequency at which we access emails. We are using batch size of 10 while using the API.
The 'Quota exceeded errors count (10 sec) - Queries per minute' graph in the GCP dashboard is empty. So we are really not sure what is going on and why we are suddenly hitting the quota limits.
Also, I am not sure how the 'per-user' limit is applied when my app accesses the user mailboxes with the service account. The documentation around this is vague, at least to me.
These errors are really impacting our ability to serve our customers. Moreover not knowing why we are getting these errors is shaking our confidence in the Gmail APIs.
Any help in this regard is highly appreciated.
Thanks
UPDATE:
Today we are seeing lots of
"User-rate limit exceeded. Retry after <timestamp>"
errors. Seems like this time around we are hitting some quota limit other than 'queries per minute'. While I look in my client implementation and figure out why this is happening, feel free to share any recommendations you may have.
Thanks.
Google analytics has limits and quotas on API requests. You can increase it. If you don't want to do it, daily quotas are refreshed at midnight Pacific Standard Time.
I sometimes get the following error when creating a subscription:
Insufficient tokens for quota 'administrator' and limit 'CLIENT_PROJECT-100s' of service 'pubsub.googleapis.com' for consumer 'project_number:'
Waiting it out does the trick, but I'd like to increase the quota. In the IAM & Admin section of the Google Cloud Console, I can filter on the Pub/Sub API, but can't find the limit...
You are running up against the quota for administrative operations. In the Quotas page, under "Quota type," select "All quotas," then under "Service" select "Google Cloud Pub/Sub API." The quota you want to increase is "Administrator operations per 100 seconds," which you can update up to the maximum allowed limit of 10,000 per 100 seconds, as detailed on the Pub/Sub quota page. Here is a screenshot of the entity you need to update:
I was hitting a similar error.
I checked the quota section — as per Kamal Aboul-Hosn's suggestion — however it was already maxed out.
A work around was to put a sleep function in the code so the API wouldn't get hammered over a hundred second period. I hope that helps.
According to AboulHosen on the GCP Slack:
"It does look like quota is pooled across users of the default application credentials and that the quota is significantly lower for users authenticated in this way. I believe when going to app engine, a service account is created (https://cloud.google.com/appengine/docs/flexible/python/access-control#using_service_accounts), so I would not anticipate this error happening when running on app engine."
So the reason this is happening is because the quota for your admin credentials is being consumed elsewhere, and as far as I know, there is no way to increase this!
If I have a credit balance in my Google AppEngine dashboard for a particular Open Data Kit Aggregate instance which is well within its quota limits, why am I getting this message??
"AppEngine Application Problem. A problem has occurred that prevents
your AppEngine application from responding. Your application may have
exceeded its per-minute or daily usage quotas. Please visit your
application dashboard at Google AppEngine. The Billing Status section
will indicate what daily or per-minute usage limits your application
has exceeded...If neither of those indicate any problems, then your application's Logs may; these are reachable from the dashboard via the Logs link on the left sidebar under the Main heading."
I have search the dashboard far and wide and don't see ANY red flags whatsoever relating to logs, or exceeding any quota limits. I added a new credit card and paid a $3 outstanding bill by making a payment for $20. Hence a $17 credit balance. About to give up.
One thing you should definitely do is go to SITE ADMIN -> PREFERENCES and tick "Disable faster background actions"
That is the only reason your quota should be finishing so fast.
Can you give us a screenshot of your logs, particularly datastore read operations, that is usually what spikes over the quota.
If you don't find any issues on your own, post a query on https://groups.google.com/d/forum/opendatakit. They are quite responsive, especially Mitch.
I have billing enabled on my project, and have even issued a $10 payment just to test out the process (it works). But I am unable to change my daily budget on the google app engine dashboard.
I go to "Billing Status" section.
I am entering the new daily budget and I hit the "submit" button.
I am getting the not very informative error: "There was an error processing the request".
So I'm stuck without being able to update my budget, and my quota has exceeded for instance hours. My users are receiving errors and I am losing money, without any option of reaching out to Official Google Support (tried to email support - it can take up to a couple of days for them to get back to you, and the phone number requires a PIN that only premium customers get. becoming a premium customer also takes a couple of days...).
Any suggestions?
I have already tried:
making sure I have only one Google account signed in while changing the budget
replacing payment method
adding another user as a billing admin and changing the budget with that user
Nothing seems to work.
UPDATE: After reaching out to a developer advocate from Google, I found out that they are aware of this issue. They claim to have solved it last night, and for me the bug is now solved.
According to the docs: https://developers.google.com/appengine/docs/quotas#Channel
The daily quota for billing enabled apps for sending data through the Channel API is capped at 2GB. Is this correct?
I think it's too small. If I had an app that sent data every 5 seconds (at 32KB per message) for an hour, I'd be over the quota in an hour with only 90 users. This 2GB volume cap for a cloud solution seems a bit too small.
Am I missing something?
I don't think it is correct. My billing enabled app shows this in the Quota Details:
Channel Data Sent 0% 0% 0.00 of 2,088.13 GBytes
You need to become a Premier customer by joining Silver, Gold, or Platinum support in order to ask for anything beyond the documented limits.
The quotas page says this:
Is your app exceeding the default limits? If you are a Premier customer, you can request additional quota bycontacting support.If you are not a Premier customer, you can apply for more Mail API quota orfile a feature requestfor any other quota increase.