I heard Sagemaker Studio automatically creates EFS on home directory.
What is the size of EFS home directory?
Is it possible to resize its size?
I'm a total beginner on AWS, so I'd happy if somebody answer to my question.
Home folders of all users under a specific SageMaker Studio Domain will share the EFS volume, though their home folders are isolated. One user cannot access the home folder of another user profile.
You don't need to manually resize EFS volume, like you similarly do with EBS. EFS volume size can automatically scale with the data stored.
Related
We are trying to move some customers data to cloud hosted services and trying to mimic the same way they currently use shared folders on the local network.
We would like to use Digital Oceans since we know their system, but not married to it.
We need the ability to click a folder using File Explorer and open it and see Word and Excel files and be able to click on the document and edit it.
No syscing required. Can be used but not required.
I have setup WinSCH as a client and connected to a Digital Ocean droplet and see and move files, but this does not allow me to edit online files. They must the copied to the local machine and edited and put back or use their folder sync application which sets up a copy of the shared folder on all user computer that need access.
All suggestion would be welcomed.
Thanks
Ok, this one is annoying me. The company network is restricted to the max, we can't run exe's only set programs via AD.
I cant use powerapps as the folders I need to access are internal. Can't use php/mysql or asp/sql as admins will not allow me space or even look at setting up a dev site.
I looked at Excel, but have a few GB's of images, that'll almost kill any excel file.
What options if any are out there that will allow me to create a db of all my images and make a searchable user interface that can be shared out to users?
Thnaks in advance
I am working on training my model in P2.xlarge instance. When I download a dataset, I get the following error: "Exception during downloading or extracting: [Errno 28] No space left on device"\
I checked that P2.xlarge has 61GiB storage, translating to 64GB. I hardly have 5GB worth of data in my instance. Could you please let me know how to proceed?
Thank you for using Amazon SageMaker.
The 61GiB on P2.xlarge is RAM storage which is different from persistent storage you get with any Notebook Instance. At this time, by default each Notebook Instance have 5 GB of storage regardless of instance type. Please note that only data stored in this 5 GB storage is persisted across Notebook Instance restarts, you can also use ~10* GB of non-peristent storage in /tmp but that data will not be persisted across Notebook Instance restarts.
On the side note, you can also use EFS file system with SageMaker to have more space with Notebook Instance. There is blog on how to add an EFS mount with Lifecycle actions, here Mount an EFS file system to an Amazon SageMaker notebook (with lifecycle configurations).
Let us know if there is any other way we can be of assistance.
Disclaimer : The available size for non-persistent storage in /tmp may change over time.
Note : This looks like duplicate of post on AWS forums, here https://forums.aws.amazon.com/thread.jspa?messageID=858201.
Thanks,
Neelam
by default, notebook instances have 5GB of storage, no matter what type they are. You can also use 20GB of non-persistent storage in /tmp.
https://docs.aws.amazon.com/sagemaker/latest/dg/howitworks-create-ws.html
Hope this helps.
Even when you add extra storage, docker on SageMaker Notebook instances uses / mounted on the default block storage. You can configure SageMaker to use another directory (inside your extra storage device) by following instructions here. Usually, your home directory (/home/ec2-user/SageMaker) is mounted on this extra storage
Create ~/.sagemaker/config.yaml
Set a new container root where you have more space
local:
container_root: /home/ec2-user/SageMaker/temp
I have to write files to a hidden location in WPF.
I do not want the user to be able to locate these files.
When I'm done writing I plan to upload these files to a separate location.
What is the best location to write to for this scenario.
Thanks
This is not possible.
More experienced users will always be able to locate files you modify, using tools like Process Monitor.
If you don't want users to see the contents of the files, then encrypt them.
The best location to store application-specific data is %AppData%\YourApp\ (this is a per-user folder). You'll have write privileges to this folder even if the user isn't administrator.
If you try to save files to location where they need administrator privileges, you'll get User Account Control Dialog Box, and they will recognize that your application tries to access unauthorized location.
So the problem is I'm not used to FTP clients and managing files with apps and directories. Webfaction has you connect to the domain and server (username.webfactional.com; listen to port 22) and once your in, you see the files already there (like bin, lib, webapp->django, etc). What I don't get is how do I get my source code files uploaded so that they appear on my domain (cooldomainname.com)?
I think the part you are missing here is how WebFaction lays out the structure for your account, applications, and web sites. You can see some of the ways they set things up here:
http://docs.webfaction.com/user-guide/examples.html
The answer to your question is:
You need to put the files, depending on the file type (if it is static or php and you have an Static/CGI/PHP application set up), in the /home/username/webapps/appname directory. You can view your apps by looking through the information in the WebFaction docs and following them through their control panel to the information you need.