I want to check history of datastore operation.
But, I cannot found it on logging/datastore console/stackdriver.
Is there "transaction log" about datastore?
Should I insert log manually to webapp?
Indeed, datastore transactions are not logged.
If you so desire you'd have to create such logs yourself. See Using Stackdriver logging in App Engine apps.
Related
I want to create a Firestore in Native mode in an existing project.
I don't have any data in Cloud Datastore, but it blocks me, saying
This project uses another database service
Your current project is set up to use Cloud Datastore or Cloud Firestore in Datastore mode. You can access data for this project from the Cloud Datastore console.
when going through https://console.cloud.google.com/firestore/
and
Cannot enable Firestore for this project
Currently Firestore cannot be enabled in projects already using Cloud Datastore or App Engine
when going through https://console.firebase.google.com/
I've tried it with writes to datastore enabled and disabled
I just want to completely purge the Cloud Datastore product from my project.
Unfortunately, there is no way to purge the previous existence of a Cloud Datastore database to try either Cloud Firestore in native or Datastore mode. You'll have to use a new project to try Cloud Firestore in either native or Datastore mode.
You can switch using the below command
$ gcloud alpha firestore databases update --type=firestore-native
This is the response I got from Google Cloud Support today (February 16th, 2021):
Generally, we do recommend to create a new project and enable Firestore therein. Nonetheless I may submit a request to delete your existing database which may allow you to change the database to the desired mode. However, please keep in mind that I’m unable to guarantee it’s approval.
I just tried it on my end. I deleted all my entities (test project) and disabled my Datastore API, same issue as you when I visit the console.firebase.google.com page.
This is likely an issue that needs to be reported either through support (if you have a support package for Google Cloud Platform), or through our issue tracker.
Still the same as of 10 June 2020.
If you have an empty Datastore database and you never executed a write to the database, you can upgrade to Firestore in Datastore mode or Native mode.
If you do not receive this option, then your database instance will be automatically upgraded at a future date.
If you upgrade from Datastore to Firestore in Datastore mode or from Datastore mode to Native mode, you cannot undo the operation.
See this page for additional details:
https://cloud.google.com/datastore/docs/upgrade-to-firestore
If you just want to lock down use the following security rule it will not delete but lock down your firestore so no one can write to it. Its not the answer you are looking for but in the same spirit.
// Deny read/write access to all users under any conditions
service cloud.firestore {
match /databases/{database}/documents {
match /{document=**} {
allow read, write: if false;
}
}
}
Just visit https://console.cloud.google.com/....... by clicking on the button, if you have not added any data it will show option to switch to native
We're getting this error periodically despite what I believe to be usage well under the 1000 batch daily updates per table.
My problem is that there's no way to inspect what Google believes the current usage is for a particular table. This makes it impossible to isolate the underlying process that is responsible for the majority of the quota usage.
How can we view/inspect the current usage levels for this quota?
I would start by enabling audit logs and inspecting the logs.
Audit logs are available via Google Cloud Logging, where they can be immediately filtered to provide insights on specific jobs or queries, or exported to Google Cloud Pub/Sub, Google Cloud Storage, or BigQuery.
To analyze your aggregated BigQuery usage using SQL, set up export of audit logs back to BigQuery. For more information about setting up exports from Cloud Logging, see Overview of Logs Export in the Cloud Logging documentation.
Analyzing Audit Logs Using BigQuery: https://cloud.google.com/bigquery/audit-logs
I have accidentally deleted the two versions ah-builtin-datastoreservice and ah-builtin-python-bundle in one of my GAE projects (written in Go). The implication is that my auto-backups (implemented as described in Scheduled Backups and Google BigQuery Analytics by Jordan Tigani, Siddartha Naidu) are not working anymore and the datastore admin is not available (response code 404).
It seems that the ah-builtin-python-bundle is created when "Enabling the datastore admin" in the Datastore Admin interface: https://stackoverflow.com/a/31038901/4763102.
Unfortunately, this button is not available anymore - only "Open Datastore Admin" and "Disable writes" buttons are available.
My question is pretty simple: How do I re-enable the deleted versions ah-builtin-datastoreservice and ah-builtin-python-bundle again?
Old question, but to handle getting your data into BigQuery and having a copy outside of Cloud Datastore, you are best to use the Managed Import/Export service.
In the Developers Console, in Cloud Datastore > Query, I am trying to delete all entities by clicking the button to select all and then clicking delete. All the entities disappear, but when the page is reloaded they are still there!
Has anyone experienced this at all, and has suggestions?
If you deleted data from your datastore viewer in the app engine console you have to flush the Memcache or wait for a while (minutes)
I read about the DataStore admin, but can't find it in the console. Also, the doc says the feature is experimental?
More clarification:
We have an enterprise application, and we need to be able to take backups of our data at a certain frequency. Since we are using Google App Engine, we need to be able to take a backup off the App Engine DataStore. When I go into the Admin console, I can see the option to view the entities, I see "Dashboard","Query" and "Index" but nothing to take a backup of the DataStore data, say to something like CloudStorage. Also, when I go to localhost:8000/datastore, I see the same.
Datastore Admin is only available to Python applications - or rather, applications with a Python version. If your app is Java, you can deploy an empty/trivial app to a non-default version.
There's a note on this in the docs, here.
At the time of your request it was only available in the old GAE console.
Since few weeks it has been integrated in the new console as well.
Go to Storage/Cloud Datastore/Settings, then the first time you'll have to "Enable Datastore Admin", then you'll have a new button "Open Datastore Admin"