Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Kinesis Firehose allows to configure S3 as a destination and in the Parquet section allows selecting a Glue catalog table of format Iceberg. However I had little to no luck querying the data.
Does...
0
answers
0
votes
10
views
asked an hour agolg...
I am trying to connect AWS glue crawler with a postgres db on RDS. Both the crawler and DB are in the same region. steps followed:
1. created a connection with jdbc url username and...
1
answers
0
votes
19
views
asked 4 hours agolg...
Hi all,
I have shared a Glue table (S3) with another account where I can already query it via Athena.
Now I added LakeFormation permissions for the database and table to the role that I am using...
0
answers
0
votes
21
views
asked 6 hours agolg...
I want to use AWS Glue Data Catalog as a metastore. I'm running an EMR Serverless job that inserts and updates data in a Delta Table. I've successfully populated Delta tables on my localhost...
0
answers
0
votes
12
views
asked 7 hours agolg...
Hi, I'm implementing a case where either one column can be null, but not both in the same record. And implementing rule
(ColumnValues "col_1" = NULL) or (ColumnValues "col_2" = NULL)
I'm seeing below...
0
answers
0
votes
17
views
asked 16 hours agolg...
Glue Job - S3 to S3lg...
Hi Team,
I am working on Glue to job to copy/move file from one bucket to another bucket. Could you please help me with your thoughts
1. Using Python how to copy/move the unzipped file to target...
0
answers
0
votes
31
views
asked a day agolg...
Following this post: https://repost.aws/knowledge-center/glue-reduce-cloudwatch-logs
I have created the following glue job:
```
from awsglue.context import GlueContext
from pyspark.context import...
1
answers
0
votes
37
views
asked a day agolg...
Hi,
I am testing Amazon DataZone features and therefore set up a domain together with another associated account.
I enabled the DataLake blueprint in both accounts. I have 2 projects (producer,...
2
answers
0
votes
57
views
asked 2 days agolg...
Hi,
I am runing a Spark ETL glue job and want to see how the executor's log through Spark UI. However, I didn't see the executor logs like stderr and stdout. Can you please advise how to find the...
2
answers
0
votes
58
views
asked 2 days agolg...
I can't use my personal root account to create Glue job or Glue Crawler
got such as
Failed to update job
[gluestudio-service.ap-southeast-1.amazonaws.com] createJob: AccessDeniedException: Account...
2
answers
0
votes
93
views
asked 5 days agolg...
My company is pushing to have everything "As Code" and I was wondering which tool is better for us.
Since we are not allowed to use the Glue interface to create ETLs, to configure the settings, and...
1
answers
0
votes
56
views
asked 5 days agolg...
Hello!
I am new to AWS Glue and I starting to create data monitoring rules in AWS Glue. I have tried multiple options with CustomSQL but can not seem to find the solution.
My problem: I want to check...
1
answers
0
votes
57
views
asked 5 days agolg...