Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Getting output location from workgroup and fixing bug in GZIP DL Mode #18

Merged
merged 2 commits into from
Jul 6, 2021

Conversation

muroon
Copy link
Collaborator

@muroon muroon commented Jul 3, 2021

What

  • [ISSUE]Getting output_location from workgroup
  • [FIX]Fixing the error which occurs when the last character of output_location is '/' in GZIP DL Mode

Why

  • making workgroup available in DL / GZIP DL mode
  • bugfix

How

[ISSUE]Getting output_location from workgroup

Use get-work-group API to get the value of output_location from workgroup

[FIX]Fixing the error which occurs when the last character of output_location is '/' in GZIP DL Mode

Ref

@muroon muroon changed the title getting output location from workgroup and fixing bug in GZIP DL Mode Getting output location from workgroup and fixing bug in GZIP DL Mode Jul 3, 2021
README.md Outdated
@@ -72,6 +72,10 @@ The tests support a few environment variables:
- `ATHENA_DATABASE` can be used to override the default database "go_athena_tests"
- `S3_BUCKET` can be used to override the default S3 bucket of "go-athena-tests"
- `ATHENA_REGION` or `AWS_DEFAULT_REGION` can be used to override the default region of "us-east-1"
- `ATHENA_WORK_GROUP` can be used to override the default workgroup of "primary"
- `ATHENA_AUTO_OUTPUT_LOCATION` is a parameter for test of getting output_location value from workgroup
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ATHENA_AUTO_OUTPUT_LOCATION is a parameter for test

I might be wrong, but it seems like this parameter exists for tests from the explanation. Is it correct?

I guess the parameter is actually useful if we wanna get output_location from a specified workgroup regardless of whether it is a test.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for your feedback!

I might be wrong, but it seems like this parameter exists for tests from the explanation. Is it correct?

Exactly!

I guess the parameter is actually useful if we wanna get output_location from a specified workgroup regardless of whether it is a test.

Can you tell me why you think it's useful?
Is your suggestion that this environment variables should be specified outside of test?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry, I forgot these environment variables are for testing!
But as we discussed, it might be better to rename these variables to clarify these are for testing :)

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@danimal141
I deleted the parameter of ATHENA_AUTO_OUTPUT_LOCATION and changed test.

  • The test should cover all cases even if ATHENA_AUTO_OUTPUT_LOCATION does not exist
  • To maintain backward compatibility with applications that were written with the older go-athena

Copy link
Collaborator

@danimal141 danimal141 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for the PR, LGTM :)

@muroon muroon merged commit 419ddad into speee:master Jul 6, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants