When there are AWS credentials in the environment, the session is ignored. #1507

wmaiouiru · 2018-10-15T04:19:39Z

Expected behavior and actual behavior.

Expected: After setting boto3 credentials, rasterio environment should use the boto3 credentials.
Actual: Instead, when there are AWS credentials in the environment, the session credentials is ignored.

Steps to reproduce the problem.

Code in Rasterio: 1.0.3
with rasterio.Env(aws_access_key_id=access_key, aws_secret_access_key=secret_access_key):

Code in Rasterio: 1.0.8
from rasterio.session import AWSSession

boto3_session = boto3.Session(aws_access_key_id=access_key, aws_secret_access_key=secret_access_key)

with rasterio.Env(AWSSession(boto3_session)):

Local Dev Message when invoking rasterio.open:
Found credentials in shared credentials file: ~/.aws/credentials

Python AWS Lambda Message when invoking rasterio.open:
Found credentials in environment variables.

Checking rasterio.env.getenv(), the correct credentials are there, but when opening the image, I receive the following error:
[ERROR] - '/vsis3/<s3-bucket>/<path-name>' not recognized as a supported file format.

In Python AWS Lambda deployed using serverless.yml, the credentials are changed even after setting the enviroment variable in Makefile.
--env AWS_ACCESS_KEY_ID=<id>\ --env AWS_SECRET_ACCESS_KEY=<key>\

Setting the image to be publically accessible in s3 without using the session credentials, both Python AWS Lambda and local dev works.

Operating system

Dev: Ubuntu 16.04
Production: AWS Lambda Python 3.6

Rasterio version and provenance

rasterio[s3]==1.0.3
rasterio[s3]==1.0.8

The text was updated successfully, but these errors were encountered:

sgillies · 2018-10-15T14:09:18Z

@wmaiouiru I am not able to reproduce this locally on my laptop. If I pass an empty boto3 session to Env, the logs show that boto3 finds credentials in my shared credentials file (expected) and hands them to Rasterio.

>>> import rasterio
>>> from rasterio.session import AWSSession
>>> import logging
>>> import boto3
>>> logging.basicConfig(level=logging.DEBUG)
>>> with rasterio.Env(AWSSession(boto3.Session())) as env:
...     print(env.options)
...
DEBUG:botocore.hooks:Changing event name from creating-client-class.iot-data to creating-client-class.iot-data-plane
DEBUG:botocore.hooks:Changing event name from before-call.apigateway to before-call.api-gateway
DEBUG:botocore.hooks:Changing event name from request-created.machinelearning.Predict to request-created.machine-learning.Predict
DEBUG:botocore.hooks:Changing event name from before-parameter-build.autoscaling.CreateLaunchConfiguration to before-parameter-build.auto-scaling.CreateLaunchConfiguration
DEBUG:botocore.hooks:Changing event name from before-parameter-build.route53 to before-parameter-build.route-53
DEBUG:botocore.hooks:Changing event name from request-created.cloudsearchdomain.Search to request-created.cloudsearch-domain.Search
DEBUG:botocore.hooks:Changing event name from docs.*.autoscaling.CreateLaunchConfiguration.complete-section to docs.*.auto-scaling.CreateLaunchConfiguration.complete-section
DEBUG:botocore.hooks:Changing event name from before-parameter-build.logs.CreateExportTask to before-parameter-build.cloudwatch-logs.CreateExportTask
DEBUG:botocore.hooks:Changing event name from docs.*.logs.CreateExportTask.complete-section to docs.*.cloudwatch-logs.CreateExportTask.complete-section
DEBUG:botocore.hooks:Changing event name from before-parameter-build.cloudsearchdomain.Search to before-parameter-build.cloudsearch-domain.Search
DEBUG:botocore.hooks:Changing event name from docs.*.cloudsearchdomain.Search.complete-section to docs.*.cloudsearch-domain.Search.complete-section
DEBUG:botocore.session:Loading variable profile from defaults.
DEBUG:botocore.session:Loading variable config_file from defaults.
DEBUG:botocore.session:Loading variable credentials_file from defaults.
DEBUG:botocore.session:Loading variable data_path from defaults.
DEBUG:botocore.session:Loading variable profile from defaults.
DEBUG:botocore.session:Loading variable credentials_file from defaults.
DEBUG:botocore.session:Loading variable config_file from defaults.
DEBUG:botocore.session:Loading variable profile from defaults.
DEBUG:botocore.session:Loading variable metadata_service_timeout from defaults.
DEBUG:botocore.session:Loading variable profile from defaults.
DEBUG:botocore.session:Loading variable metadata_service_num_attempts from defaults.
DEBUG:botocore.session:Loading variable profile from defaults.
DEBUG:botocore.credentials:Looking for credentials via: env
DEBUG:botocore.credentials:Looking for credentials via: assume-role
DEBUG:botocore.credentials:Looking for credentials via: shared-credentials-file
INFO:botocore.credentials:Found credentials in shared credentials file: ~/.aws/credentials
DEBUG:rasterio.env:Entering env context: <rasterio.env.Env object at 0x1188c27f0>
DEBUG:rasterio.env:Starting outermost env
DEBUG:rasterio.env:No GDAL environment exists
DEBUG:rasterio.env:New GDAL environment <rasterio._env.GDALEnv object at 0x1188c2ba8> created
DEBUG:rasterio._env:Logging error handler pushed.
DEBUG:rasterio._env:All drivers registered.
DEBUG:rasterio._env:Started GDALEnv <rasterio._env.GDALEnv object at 0x1188c2ba8>.
DEBUG:botocore.session:Loading variable profile from defaults.
DEBUG:botocore.session:Loading variable profile from defaults.
DEBUG:botocore.session:Loading variable region from config file with value 'us-west-2'.
DEBUG:botocore.session:Loading variable profile from defaults.
DEBUG:botocore.session:Loading variable profile from defaults.
DEBUG:botocore.session:Loading variable region from config file with value 'us-west-2'.
DEBUG:rasterio.env:Entered env context: <rasterio.env.Env object at 0x1188c27f0>
{'AWS_ACCESS_KEY_ID': '***', 'AWS_SECRET_ACCESS_KEY': '***', 'AWS_REGION': 'us-west-2'}
DEBUG:rasterio.env:Exiting env context: <rasterio.env.Env object at 0x1188c27f0>
DEBUG:rasterio.env:Cleared existing <rasterio._env.GDALEnv object at 0x1188c2ba8> options
DEBUG:rasterio._env:Stopping GDALEnv <rasterio._env.GDALEnv object at 0x1188c2ba8>.
DEBUG:rasterio._env:Error handler popped.
DEBUG:rasterio._env:Stopped GDALEnv <rasterio._env.GDALEnv object at 0x1188c2ba8>.
DEBUG:rasterio.env:Exiting outermost env
DEBUG:rasterio.env:Exited env context: <rasterio.env.Env object at 0x1188c27f0>

If I pass an access key and a secret key to boto3.Session() then these values are passed along to Rasterio, which is also what we expect.

>>> with rasterio.Env(AWSSession(boto3.Session(aws_access_key_id='foo', aws_secret_access_key='bar'))) as env:
...     print(env.options)
...
DEBUG:botocore.hooks:Changing event name from creating-client-class.iot-data to creating-client-class.iot-data-plane
DEBUG:botocore.hooks:Changing event name from before-call.apigateway to before-call.api-gateway
DEBUG:botocore.hooks:Changing event name from request-created.machinelearning.Predict to request-created.machine-learning.Predict
DEBUG:botocore.hooks:Changing event name from before-parameter-build.autoscaling.CreateLaunchConfiguration to before-parameter-build.auto-scaling.CreateLaunchConfiguration
DEBUG:botocore.hooks:Changing event name from before-parameter-build.route53 to before-parameter-build.route-53
DEBUG:botocore.hooks:Changing event name from request-created.cloudsearchdomain.Search to request-created.cloudsearch-domain.Search
DEBUG:botocore.hooks:Changing event name from docs.*.autoscaling.CreateLaunchConfiguration.complete-section to docs.*.auto-scaling.CreateLaunchConfiguration.complete-section
DEBUG:botocore.hooks:Changing event name from before-parameter-build.logs.CreateExportTask to before-parameter-build.cloudwatch-logs.CreateExportTask
DEBUG:botocore.hooks:Changing event name from docs.*.logs.CreateExportTask.complete-section to docs.*.cloudwatch-logs.CreateExportTask.complete-section
DEBUG:botocore.hooks:Changing event name from before-parameter-build.cloudsearchdomain.Search to before-parameter-build.cloudsearch-domain.Search
DEBUG:botocore.hooks:Changing event name from docs.*.cloudsearchdomain.Search.complete-section to docs.*.cloudsearch-domain.Search.complete-section
DEBUG:botocore.session:Loading variable profile from defaults.
DEBUG:botocore.session:Loading variable config_file from defaults.
DEBUG:botocore.session:Loading variable credentials_file from defaults.
DEBUG:botocore.session:Loading variable data_path from defaults.
DEBUG:rasterio.env:Entering env context: <rasterio.env.Env object at 0x1188da518>
DEBUG:rasterio.env:Starting outermost env
DEBUG:rasterio.env:No GDAL environment exists
DEBUG:rasterio.env:New GDAL environment <rasterio._env.GDALEnv object at 0x1188da8d0> created
DEBUG:rasterio._env:Logging error handler pushed.
DEBUG:rasterio._env:All drivers registered.
DEBUG:rasterio._env:Started GDALEnv <rasterio._env.GDALEnv object at 0x1188da8d0>.
DEBUG:botocore.session:Loading variable profile from defaults.
DEBUG:botocore.session:Loading variable profile from defaults.
DEBUG:botocore.session:Loading variable region from config file with value 'us-west-2'.
DEBUG:botocore.session:Loading variable profile from defaults.
DEBUG:botocore.session:Loading variable profile from defaults.
DEBUG:botocore.session:Loading variable region from config file with value 'us-west-2'.
DEBUG:rasterio.env:Entered env context: <rasterio.env.Env object at 0x1188da518>
{'AWS_ACCESS_KEY_ID': 'foo', 'AWS_SECRET_ACCESS_KEY': 'bar', 'AWS_REGION': 'us-west-2'}
DEBUG:rasterio.env:Exiting env context: <rasterio.env.Env object at 0x1188da518>
DEBUG:rasterio.env:Cleared existing <rasterio._env.GDALEnv object at 0x1188da8d0> options
DEBUG:rasterio._env:Stopping GDALEnv <rasterio._env.GDALEnv object at 0x1188da8d0>.
DEBUG:rasterio._env:Error handler popped.
DEBUG:rasterio._env:Stopped GDALEnv <rasterio._env.GDALEnv object at 0x1188da8d0>.
DEBUG:rasterio.env:Exiting outermost env
DEBUG:rasterio.env:Exited env context: <rasterio.env.Env object at 0x1188da518>

I'm using boto3==1.9.6 and botocore==1.12.6.

wmaiouiru · 2018-10-15T17:08:25Z

@sgillies Thank you for the follow-up.
I am wondering if I am using the environment incorretly.

import boto3
import rasterio
from rasterio.session import AWSSession
with rasterio.Env(AWSSession(boto3.Session(aws_access_key_id=access_key, aws_secret_access_key=secret_access_key))) as env:
    print(env.options)
    src = rasterio.open(s3_url)

The following is my logs.
It looks like rasterio is exisiting the env context before opening the file.

[DEBUG]	2018-10-15T16:54:08.267Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	Entering env context: <rasterio.env.Env object at 0x7f13f7b8b0f0>
[DEBUG]	2018-10-15T16:54:08.267Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	Got a copy of environment <rasterio._env.GDALEnv object at 0x7f13fb022da0> options
[DEBUG]	2018-10-15T16:54:08.267Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	Entered env context: <rasterio.env.Env object at 0x7f13f7b8b0f0>
{'AWS_ACCESS_KEY_ID': '***', 'AWS_SECRET_ACCESS_KEY': '***', 'AWS_REGION': 'us-west-2'}
[DEBUG]	2018-10-15T16:54:08.455Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	Exiting env context: <rasterio.env.Env object at 0x7f13f7b8b0f0>
[DEBUG]	2018-10-15T16:54:08.455Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	Cleared existing <rasterio._env.GDALEnv object at 0x7f13fb022da0> options
[DEBUG]	2018-10-15T16:54:08.455Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	Stopping GDALEnv <rasterio._env.GDALEnv object at 0x7f13fb022da0>.
[DEBUG]	2018-10-15T16:54:08.455Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	Error handler popped.
[DEBUG]	2018-10-15T16:54:08.455Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	Stopped GDALEnv <rasterio._env.GDALEnv object at 0x7f13fb022da0>.
[DEBUG]	2018-10-15T16:54:08.455Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	No GDAL environment exists
[DEBUG]	2018-10-15T16:54:08.455Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	New GDAL environment <rasterio._env.GDALEnv object at 0x7f13fb022da0> created
[DEBUG]	2018-10-15T16:54:08.455Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	Logging error handler pushed.
[DEBUG]	2018-10-15T16:54:08.456Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	All drivers registered.
[DEBUG]	2018-10-15T16:54:08.456Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	Started GDALEnv <rasterio._env.GDALEnv object at 0x7f13fb022da0>.
[DEBUG]	2018-10-15T16:54:08.456Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	Exited env context: <rasterio.env.Env object at 0x7f13f7b8b0f0>
[DEBUG]	2018-10-15T16:54:08.456Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	Exiting env context: <rasterio.env.Env object at 0x7f13fb022d68>
[DEBUG]	2018-10-15T16:54:08.456Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	Cleared existing <rasterio._env.GDALEnv object at 0x7f13fb022da0> options
[DEBUG]	2018-10-15T16:54:08.456Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	Stopping GDALEnv <rasterio._env.GDALEnv object at 0x7f13fb022da0>.
[DEBUG]	2018-10-15T16:54:08.457Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	Error handler popped.
[DEBUG]	2018-10-15T16:54:08.457Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	Stopped GDALEnv <rasterio._env.GDALEnv object at 0x7f13fb022da0>.
[DEBUG]	2018-10-15T16:54:08.457Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	Exiting outermost env
[DEBUG]	2018-10-15T16:54:08.457Z	edd1c9f5-d09a-11e8-a2e1-514fa391bbb6	Exited env context: <rasterio.env.Env object at 0x7f13fb022d68>
[ERROR] - '/vsis3/<url>.tif' not recognized as a supported file format.

sgillies · 2018-10-15T17:18:25Z

@wmaiouiru thanks for reporting! This is looking like a bug to me. I'll follow up here with news about the fix.

fungjj92 · 2018-10-16T15:14:21Z

I'm seeing similar behavior, however instead of the specified AWS profile, rasterio picks up the [default] AWS profile credentials instead.

s = boto3.Session(profile_name='apple')
with rasterio.Env(s):
    rasterio.open('s3:https://apple-data/fall_for_18_3k.tif', mode='r')

RasterioIOError: '/vsis3/apple-data/fall_for_18_3k.tif' does not exist in the file system, and is not recognized as a supported dataset name.

I'm on MacOSX Sierra 10.12.6
rasterio[s3]==1.0.8
Python 2.7 and 3.7

Kirill888 · 2018-10-20T06:50:14Z

I think this is because rasterio.env.ensure_env_credentialled creates new AWSSession with default settings even when running inside already credentialed environment see issue #1513. Quick work around is to not call open but instead create DatasetReader directly:

src = rasterio.DatasetReader(rasterio.path.parse_path(url))

Resolves #1507

sgillies · 2018-10-23T22:43:41Z

@wmaiouiru @fungjj92 I've got the fix in d5f2cd6. Sorry about the bug!

ygesher-pw · 2022-12-15T13:48:42Z

I'm seeing this behavior again, in the current version (1.3.4), every time I call rasterio.open() I see a line in the logs like this - botocore.credentials | INFO | Found credentials in environment variables.

sgillies · 2022-12-16T03:10:28Z

@ygesher-pw no, that's just botocore logging that it found credentials in the environment. It's not a sign that rasterio is ignoring the session in favor of credentials in the environment.

vincentsarago · 2022-12-16T09:38:51Z

If I remember well this logging was removed in botocore

see: boto/botocore#2191

edit: 🤦 no this is totally unrelated but at least it shows one possible fix if you want to remove the logs 😅

import logging
logging.getLogger("botocore.credentials").disabled = True

ygesher-pw · 2022-12-19T07:38:27Z

Ok, then perhaps I need to open a separate issue. As far I understand, this log line means that every time I open a raster, rasterio starts a new boto session. That doesn't seem right for many reasons. And since this gets logged no matter how many times I open a raster in the same process, it feels like it's related to the issue originally reported in this thread.

vincentsarago · 2022-12-19T07:50:44Z

@ygesher-pw

every time I open a raster, rasterio starts a new boto session.

It's only if you try to open an S3 path and you can easily avoid this by creating a session and using it like

from boto3.session import Session as boto3_session

import rasterio
from rasterio.session import AWSSession


session = boto3_session()
aws_session = AWSSession(session=session)
with rasterio.Env(aws_session):
    with rasterio.open(...) as src:
        ....

Kirill888 · 2022-12-19T08:14:27Z

@ygesher-pw current behaviour is "as intended", original issue and it's duplicate were about doing this work even when operating within an already activated environment as listed in the code sample provided by Vincent (with rasterio.Env part).

One could argue that rasterio should cache default AWS session it constructs to make open "just work" without prior setup, but caching has it's own down-sides, and there is already a working mechanism one can use to avoid redoing all that credential management.

ygesher-pw · 2022-12-19T08:16:16Z

Ok in this case I'll open a new issue, since I see this when opening local files!

vincentsarago · 2022-12-19T08:32:32Z

Ok in this case I'll open a new issue, since I see this when opening local files!

import rasterio
import logging
logging.basicConfig(level=logging.DEBUG)

with rasterio.open("cog.tif") as src:
    print(src.meta)

DEBUG:rasterio.env:Entering env context: <rasterio.env.Env object at 0x102cb7bb0>
DEBUG:rasterio.env:Starting outermost env
DEBUG:rasterio.env:No GDAL environment exists
DEBUG:rasterio.env:New GDAL environment <rasterio._env.GDALEnv object at 0x102cb7700> created
DEBUG:rasterio._env:GDAL_DATA found in environment.
DEBUG:rasterio._env:PROJ_LIB found in environment.
DEBUG:rasterio._env:Started GDALEnv: self=<rasterio._env.GDALEnv object at 0x102cb7700>.
DEBUG:rasterio.env:Entered env context: <rasterio.env.Env object at 0x102cb7bb0>
DEBUG:rasterio._base:Sharing flag: 0
DEBUG:rasterio._base:Nodata success: 0, Nodata value: 0.000000
DEBUG:rasterio._base:Nodata success: 0, Nodata value: 0.000000
DEBUG:rasterio._base:Nodata success: 0, Nodata value: 0.000000
DEBUG:rasterio._base:Dataset <open DatasetReader name='S-2_20200422_COG.tif' mode='r'> is started.
DEBUG:rasterio.env:Exiting env context: <rasterio.env.Env object at 0x102cb7bb0>
DEBUG:rasterio.env:Cleared existing <rasterio._env.GDALEnv object at 0x102cb7700> options
DEBUG:rasterio._env:Stopped GDALEnv <rasterio._env.GDALEnv object at 0x102cb7700>.
DEBUG:rasterio.env:Exiting outermost env
DEBUG:rasterio.env:Exited env context: <rasterio.env.Env object at 0x102cb7bb0>
DEBUG:rasterio.crs:Matched. confidence=100, c_code=b'32632', c_name=b'EPSG'
{'driver': 'GTiff', 'dtype': 'uint8', 'nodata': None, 'width': 33145, 'height': 28870, 'count': 3, 'crs': CRS.from_epsg(32632), 'transform': Affine(10.0, 0.0, 342765.0,
       0.0, -10.0, 5971585.0)}

I can't reproduce locally 🤷

@ygesher-pw please provide a full reproductible example and mention how you installed rasterio and your system 🙏

vincentsarago · 2022-12-19T08:37:42Z

Update:

If you use with rasterio.Env() you'll create an AWS session by default if you have AWS credential in your environment (see https://github.com/rasterio/rasterio/blob/main/rasterio/env.py#L205-L206)

In [1]: import rasterio
   ...: import logging
   ...: logging.basicConfig(level=logging.DEBUG)
   ...: 
   ...: with rasterio.Env():
   ...:     pass
   ...: 

DEBUG:botocore.hooks:Changing event name from creating-client-class.iot-data to creating-client-class.iot-data-plane
DEBUG:botocore.hooks:Changing event name from before-call.apigateway to before-call.api-gateway
DEBUG:botocore.hooks:Changing event name from request-created.machinelearning.Predict to request-created.machine-learning.Predict
DEBUG:botocore.hooks:Changing event name from before-parameter-build.autoscaling.CreateLaunchConfiguration to before-parameter-build.auto-scaling.CreateLaunchConfiguration
DEBUG:botocore.hooks:Changing event name from before-parameter-build.route53 to before-parameter-build.route-53
DEBUG:botocore.hooks:Changing event name from request-created.cloudsearchdomain.Search to request-created.cloudsearch-domain.Search
DEBUG:botocore.hooks:Changing event name from docs.*.autoscaling.CreateLaunchConfiguration.complete-section to docs.*.auto-scaling.CreateLaunchConfiguration.complete-section
DEBUG:botocore.hooks:Changing event name from before-parameter-build.logs.CreateExportTask to before-parameter-build.cloudwatch-logs.CreateExportTask
DEBUG:botocore.hooks:Changing event name from docs.*.logs.CreateExportTask.complete-section to docs.*.cloudwatch-logs.CreateExportTask.complete-section
DEBUG:botocore.hooks:Changing event name from before-parameter-build.cloudsearchdomain.Search to before-parameter-build.cloudsearch-domain.Search
DEBUG:botocore.hooks:Changing event name from docs.*.cloudsearchdomain.Search.complete-section to docs.*.cloudsearch-domain.Search.complete-section
DEBUG:botocore.utils:IMDS ENDPOINT: https://169.254.169.254/
DEBUG:botocore.credentials:Looking for credentials via: env
INFO:botocore.credentials:Found credentials in environment variables.
DEBUG:rasterio.env:Entering env context: <rasterio.env.Env object at 0x1073ab8b0>
DEBUG:rasterio.env:Starting outermost env
DEBUG:rasterio.env:No GDAL environment exists
DEBUG:rasterio.env:New GDAL environment <rasterio._env.GDALEnv object at 0x118cb71f0> created
DEBUG:rasterio._filepath:Installing FilePath filesystem handler plugin...
DEBUG:rasterio._env:GDAL_DATA found in environment.
DEBUG:rasterio._env:PROJ_LIB found in environment.
DEBUG:rasterio._env:Started GDALEnv: self=<rasterio._env.GDALEnv object at 0x118cb71f0>.
DEBUG:rasterio.env:Entered env context: <rasterio.env.Env object at 0x1073ab8b0>
DEBUG:rasterio.env:Exiting env context: <rasterio.env.Env object at 0x1073ab8b0>
DEBUG:rasterio.env:Cleared existing <rasterio._env.GDALEnv object at 0x118cb71f0> options
DEBUG:rasterio._env:Stopped GDALEnv <rasterio._env.GDALEnv object at 0x118cb71f0>.
DEBUG:rasterio.env:Exiting outermost env
DEBUG:rasterio.env:Exited env context: <rasterio.env.Env object at 0x1073ab8b0>

vincentsarago · 2022-12-19T08:49:47Z

previous issues #1864

weither Rasterio should automatically create an AWSSession could be arguable, but I guess this would be a kinda breaking change cc @sgillies

ygesher-pw · 2022-12-19T13:25:08Z

I apologize, I think I've been barking up the wrong tree. The code snippet that logs this line has both a geopandas.read_file() call as well as rasterio.open(). So the problem is probably over there

ygesher-pw · 2022-12-19T14:29:06Z

Ok after a little additional debugging I successfully isolated the line responsible - it's actually rasterio.features.rasterize() that causes it. Perhaps a separate issue is still in order?

sgillies added the bug label Oct 15, 2018

sgillies self-assigned this Oct 15, 2018

sgillies added this to the 1.0.9 milestone Oct 15, 2018

scottyhq mentioned this issue Oct 22, 2018

Improving Performance with Cloud-Optimized Geotiffs (COGs) - xarray,rasterio,dask pangeo-data/pangeo-example-notebooks#21

Open

sgillies pushed a commit that referenced this issue Oct 23, 2018

Don't clobber credentials in the outer Env

d5f2cd6

Resolves #1507

sgillies closed this as completed Oct 23, 2018

sgillies mentioned this issue Oct 23, 2018

Performance regression when opening files from S3 #1513

Closed

fungjj92 mentioned this issue Oct 24, 2018

Beekeeper raster endpoint project-icp/bee-pollinator-app#305

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

When there are AWS credentials in the environment, the session is ignored. #1507

When there are AWS credentials in the environment, the session is ignored. #1507

wmaiouiru commented Oct 15, 2018

sgillies commented Oct 15, 2018

wmaiouiru commented Oct 15, 2018

sgillies commented Oct 15, 2018

fungjj92 commented Oct 16, 2018 •

edited

Loading

Kirill888 commented Oct 20, 2018

sgillies commented Oct 23, 2018

ygesher-pw commented Dec 15, 2022

sgillies commented Dec 16, 2022

vincentsarago commented Dec 16, 2022 •

edited

Loading

ygesher-pw commented Dec 19, 2022 •

edited

Loading

vincentsarago commented Dec 19, 2022

Kirill888 commented Dec 19, 2022 •

edited

Loading

ygesher-pw commented Dec 19, 2022

vincentsarago commented Dec 19, 2022

vincentsarago commented Dec 19, 2022

vincentsarago commented Dec 19, 2022

ygesher-pw commented Dec 19, 2022

ygesher-pw commented Dec 19, 2022

When there are AWS credentials in the environment, the session is ignored. #1507

When there are AWS credentials in the environment, the session is ignored. #1507

Comments

wmaiouiru commented Oct 15, 2018

Expected behavior and actual behavior.

Steps to reproduce the problem.

Operating system

Rasterio version and provenance

sgillies commented Oct 15, 2018

wmaiouiru commented Oct 15, 2018

sgillies commented Oct 15, 2018

fungjj92 commented Oct 16, 2018 • edited Loading

Kirill888 commented Oct 20, 2018

sgillies commented Oct 23, 2018

ygesher-pw commented Dec 15, 2022

sgillies commented Dec 16, 2022

vincentsarago commented Dec 16, 2022 • edited Loading

ygesher-pw commented Dec 19, 2022 • edited Loading

vincentsarago commented Dec 19, 2022

Kirill888 commented Dec 19, 2022 • edited Loading

ygesher-pw commented Dec 19, 2022

vincentsarago commented Dec 19, 2022

vincentsarago commented Dec 19, 2022

vincentsarago commented Dec 19, 2022

ygesher-pw commented Dec 19, 2022

ygesher-pw commented Dec 19, 2022

fungjj92 commented Oct 16, 2018 •

edited

Loading

vincentsarago commented Dec 16, 2022 •

edited

Loading

ygesher-pw commented Dec 19, 2022 •

edited

Loading

Kirill888 commented Dec 19, 2022 •

edited

Loading