Logging to Amazon S3

Has anyone built, or does anyone know how to build, a logging framework that deposits the log files on Amazon S3? We're building a SaaS app, and, naturally, we plan to have a zillion servers and...

Access files stored on Amazon S3 through web browser

Current Situation I have a project on GitHub that builds after every commit on Travis-CI. After each successful build Travis uploads the artifacts to an S3 bucket. Is there some way for me to...

How to specify AWS Access Key ID and Secret Access Key as part of a amazon s3n URL

I am passing input and output folders as parameters to mapreduce word count program from webpage. Getting below error: HTTP Status 500 - Request processing failed; nested exception...

How to delete empty S3 bucket which generated by Elastic Beanstalk?

In my console, I see an empty S3 bucket created by AWS Elastic Beanstalk. Its name is 'elasticbeanstalk-ap-northeast-1-xxxxxxx'. I already removed my Elastic Beanstalk project, however the S3...

Merge/Aggregate S3 Objects

I have log files being uploaded to S3 from different machines (m1_log.txt, m2_log.txt, m3_log.txt). They upload to a bucket, but I would like to be able to create log.txt that is the concat of all...

How to get response from S3 getObject in Node.js?

In a Node.js project I am attempting to get data back from S3. When I use getSignedURL, everything works: aws.getSignedUrl('getObject', params, function(err, url){ console.log(url); }); My...

nodejs amazon s3 upload file timeout

I'm using Amazon S3 as photo storage and I'm constantly getting this error: RequestTimeout: Your socket connection to the server was not read from or written to within the timeout period. Idle...

Ckfinder configuration using S3 with ckeditor

I have configured Ckfinder 3.x with AWS S3. We can accesss particular bucket in ckfinder. Configuration is like below. $config['backends'][] = array( 'name' => 'default', ...

Encryption and Decryption file in s3 using Nodejs with AWS KMS

I am using AWS KMS to encrypt file to s3 bucket. I'm currently doing this using the AWS console, but I'd like to do this using Nodejs. I just checked some of the things but I am not getting any...

How to remove multiple S3 buckets at once?

I have a dozen of buckets that I would like to remove in AWS S3, all having a similar name containing bucket-to-remove and with some objects in it. Using the UI is quite slow, is there a solution...

Redirect www to non-www with S3/CloudFront without seperate buckets

I'm hosting a static websites on S3 with CloudFront. Now, both www.example.com and example.com return the same, but I only want example.com to work, and www.example.com to redirect to...

Is s3 sync supported from sdk instead of cli?

Here is answer about how move files from one s3 bucket to another using sync command from command line (cli): aws s3 sync s3://from_my_bucket s3://to_my_other_bucket Can this be invoked from...

Getting 403 (Forbidden) when uploading to S3 with a signed URL

I'm trying to generate a pre-signed URL then upload a file to S3 through a browser. My server-side code looks like this, and it generates the URL: let s3 = new aws.S3({ // for dev purposes ...

(AWS) Athena: Query Results seem too short

My Athena queries appear to be too short in their results. Trying to figure out Why? Setup: Glue Catalogs (118.6 Gig in size). Data: Stored in S3 in both CSV and JSON format. Athena Query: When...

react router doesn't work in aws s3 bucket

I deployed my React website build/ folder into an AWS S3 bucket. If I go to www.mywebsite.com, it works and if I click on a tag to go to Project and About pages, it leads me to the right...

Maven fails to find aws s3 sdk

Trying to set up a new project with the Amazon AWS Java SDK via Maven, and apparently Maven can't find the s3 package. This is the error: [ERROR]...

How to loop through values in a CloudFormation template

I am trying to pass a list of comma separated parameters in an AWS CloudFormation template and create multiple Amazon S3 buckets based on those values. I have a requirement where I will be passing...

how to check if a particular directory exists in S3 bucket using python and boto3

How to check if a particular file is present inside a particular directory in my S3? I use Boto3 and tried this code (which doesn't work): import boto3 s3 = boto3.resource('s3') bucket =...

Is there a way to add delay to trigger a lambda from S3 upload?

I have a Lambda function which is triggered after put/post event of S3 bucket. This works fine if there is only one file uploaded to S3 bucket. However, at times there could be multiple files...

AWS sagemaker error - AttributeError: 'NoneType' object has no attribute 'startswith'

As per this - https://stackoverflow.com/questions/56255154/how-to-use-a-pretrained-model-from-s3-to-predict-some-data , I was trying to use an existing model to create an endpoint, but I was...

Serving static files from S3 bucket not working?

I have configured an S3 bucket to store and serve static and media files for a Django website, currently just trying to get the static files needed for the admin pages and all that. Here is all...

How to delete a file image on amazon s3 when

I have a program Model, and i the program has an image attribute which I use multers3 to upload when creating the Program. The challenge that I am facing now is that, when I delete the program,...

when calling the GetObjectTagging operation: Access Denied

I'm trying to add tags to objects added in S3 for a particular Prefix. { "Records": [ .......... JUNK METADATA .......... "s3": { "s3SchemaVersion": "1.0", ...

Is it better to upload a file to an s3 bucket on the front end or backend?

I am creating a web app where there is an option for authenticated users to upload pictures. I am confused as to whether its better to do it on the front end or backend. I have already implemented...

How to perform AWS S3 Multipart Copy with golang

I was looking at the AWS golang documentation for S3 Copy Object function, it contains the following details for handling large file uploads However, to copy an object greater >than 5 GB, you...

Terraform getting error when configuring S3 Backend

trying to store my state file in an s3 bucket , but getting this error when trying 'Terraform init' : made sure my aws credentials doesnt have " / # $ .. " error configuring S3 Backend: error...

GraphQLSchema Specified key does not exist on `amplify push`

I have upgraded amplify version from 4.45.0 to 5.2.0, Now when I do amplify push, I am getting the following error: Following resources failed Resource Name:...

R - H20 - ERROR: Unexpected HTTP Status code: 500 Server Error - java.lang.NullpointerException

I'm brand new in the use of h2o (trough R) and have now encountered a problem when using h2o.automl. The problem is very much similar to that of another thread...

attributeerror: 'AioClientCreator' object has no attribute '_register_lazy_block_unknown_fips_pseudo_regions'

Recently, I have started to occupy the AWS platform, but when trying to occupy Sagemaker, the following error and I don't know if it is because of Sagemaker or it has something to do with...