Ggtcf

When two POV characters meet

What does it mean when multiple 々 marks follow a 、?

How do anti-virus programs start at Windows boot?

Is having access to past exams cheating and, if yes, could it be proven just by a good grade?

Want to switch to tankless, but can I use my existing wiring?

Should we release the security issues we found in our product as CVE or we can just update those on weekly release notes?

Making a sword in the stone, in a medieval world without magic

Best mythical creature to use as livestock?

How could a female member of a species produce eggs unto death?

As a monk, can you make a melee attack roll using your Strength modifier, but roll damage with your Dexterity modifier?

Why does Deadpool say "You're welcome, Canada," after shooting Ryan Reynolds in the end credits?

Is a lawful good "antagonist" effective?

If the Captain's screens are out, does he switch seats with the co-pilot?

Identifying the interval from A♭ to D♯

Single word request: Harming the benefactor

validation vs test vs training accuracy, which one to compare for claiming overfit?

Potentiometer like component

Can infringement of a trademark be pursued for using a company's name in a sentence?

What is the dot in “1.2.4."

Time dilation for a moving electronic clock

Is going from continuous data to categorical always wrong?

Excess Zinc in garden soil

Is "history" a male-biased word ("his+story")?

Ban on all campaign finance?

read .pkl files from IBM object storage

0

I am trying to read '.pkl' files stored in IBM object storage into IBM cloud/jupyter notebook using function given below. I am using python 2.7.

from ibm_botocore.client import Config

import ibm_boto3

COS_ENDPOINT = "https://s3.private.us.cloud-object- 
torage.appdomain.cloud" 
COS_API_KEY_ID = "xxxxxxxxxxxx"
COS_AUTH_ENDPOINT = "https://iam.ng.bluemix.net/oidc/token"
COS_RESOURCE_CRN = "xxxxxxxxxxxxxxxxx"
COS_BUCKET_LOCATION = "us-geo"

# Create resource
cos = ibm_boto3.resource("s3",
 ibm_api_key_id=COS_API_KEY_ID,
 ibm_service_instance_id=COS_RESOURCE_CRN,
 ibm_auth_endpoint=COS_AUTH_ENDPOINT,
 config=Config(signature_version="oauth"),
 endpoint_url=COS_ENDPOINT
)

def get_item(bucket_name, item_name):
 print("Retrieving item from bucket: 0, key: 
 1".format(bucket_name, item_name))
 try:
 file = cos.Object(bucket_name, item_name).get()
 print("File Contents: 0".format(file["Body"].read()))
 except ClientError as be:
 print("CLIENT ERROR: 0n".format(be))
 except Exception as e:
 print("Unable to retrieve file contents: 0".format(e))

get_item('bucket_name', 'item_name')

The function get_item is returning empty string when trying to read '.pkl' file. But using same function I am able to read a '.txt' file. The '.pkl' file is 30 MB in size so I am not able to download them into IBM cloud because of size constraint. Could anyone please let me know how to stream cloud object storage data without downloading them.

python-2.7 ibm-cloud object-storage

share|improve this question

asked Mar 7 at 11:07

VinayVinay

33

add a comment | 

0

I am trying to read '.pkl' files stored in IBM object storage into IBM cloud/jupyter notebook using function given below. I am using python 2.7.

from ibm_botocore.client import Config

import ibm_boto3

COS_ENDPOINT = "https://s3.private.us.cloud-object- 
torage.appdomain.cloud" 
COS_API_KEY_ID = "xxxxxxxxxxxx"
COS_AUTH_ENDPOINT = "https://iam.ng.bluemix.net/oidc/token"
COS_RESOURCE_CRN = "xxxxxxxxxxxxxxxxx"
COS_BUCKET_LOCATION = "us-geo"

# Create resource
cos = ibm_boto3.resource("s3",
 ibm_api_key_id=COS_API_KEY_ID,
 ibm_service_instance_id=COS_RESOURCE_CRN,
 ibm_auth_endpoint=COS_AUTH_ENDPOINT,
 config=Config(signature_version="oauth"),
 endpoint_url=COS_ENDPOINT
)

def get_item(bucket_name, item_name):
 print("Retrieving item from bucket: 0, key: 
 1".format(bucket_name, item_name))
 try:
 file = cos.Object(bucket_name, item_name).get()
 print("File Contents: 0".format(file["Body"].read()))
 except ClientError as be:
 print("CLIENT ERROR: 0n".format(be))
 except Exception as e:
 print("Unable to retrieve file contents: 0".format(e))

get_item('bucket_name', 'item_name')

The function get_item is returning empty string when trying to read '.pkl' file. But using same function I am able to read a '.txt' file. The '.pkl' file is 30 MB in size so I am not able to download them into IBM cloud because of size constraint. Could anyone please let me know how to stream cloud object storage data without downloading them.

python-2.7 ibm-cloud object-storage

share|improve this question

asked Mar 7 at 11:07

VinayVinay

33

add a comment | 

I am trying to read '.pkl' files stored in IBM object storage into IBM cloud/jupyter notebook using function given below. I am using python 2.7.

from ibm_botocore.client import Config

import ibm_boto3

COS_ENDPOINT = "https://s3.private.us.cloud-object- 
torage.appdomain.cloud" 
COS_API_KEY_ID = "xxxxxxxxxxxx"
COS_AUTH_ENDPOINT = "https://iam.ng.bluemix.net/oidc/token"
COS_RESOURCE_CRN = "xxxxxxxxxxxxxxxxx"
COS_BUCKET_LOCATION = "us-geo"

# Create resource
cos = ibm_boto3.resource("s3",
 ibm_api_key_id=COS_API_KEY_ID,
 ibm_service_instance_id=COS_RESOURCE_CRN,
 ibm_auth_endpoint=COS_AUTH_ENDPOINT,
 config=Config(signature_version="oauth"),
 endpoint_url=COS_ENDPOINT
)

def get_item(bucket_name, item_name):
 print("Retrieving item from bucket: 0, key: 
 1".format(bucket_name, item_name))
 try:
 file = cos.Object(bucket_name, item_name).get()
 print("File Contents: 0".format(file["Body"].read()))
 except ClientError as be:
 print("CLIENT ERROR: 0n".format(be))
 except Exception as e:
 print("Unable to retrieve file contents: 0".format(e))

get_item('bucket_name', 'item_name')

The function get_item is returning empty string when trying to read '.pkl' file. But using same function I am able to read a '.txt' file. The '.pkl' file is 30 MB in size so I am not able to download them into IBM cloud because of size constraint. Could anyone please let me know how to stream cloud object storage data without downloading them.

python-2.7 ibm-cloud object-storage

share|improve this question

asked Mar 7 at 11:07

VinayVinay

33

from ibm_botocore.client import Config

import ibm_boto3

COS_ENDPOINT = "https://s3.private.us.cloud-object- 
torage.appdomain.cloud" 
COS_API_KEY_ID = "xxxxxxxxxxxx"
COS_AUTH_ENDPOINT = "https://iam.ng.bluemix.net/oidc/token"
COS_RESOURCE_CRN = "xxxxxxxxxxxxxxxxx"
COS_BUCKET_LOCATION = "us-geo"

# Create resource
cos = ibm_boto3.resource("s3",
 ibm_api_key_id=COS_API_KEY_ID,
 ibm_service_instance_id=COS_RESOURCE_CRN,
 ibm_auth_endpoint=COS_AUTH_ENDPOINT,
 config=Config(signature_version="oauth"),
 endpoint_url=COS_ENDPOINT
)

def get_item(bucket_name, item_name):
 print("Retrieving item from bucket: 0, key: 
 1".format(bucket_name, item_name))
 try:
 file = cos.Object(bucket_name, item_name).get()
 print("File Contents: 0".format(file["Body"].read()))
 except ClientError as be:
 print("CLIENT ERROR: 0n".format(be))
 except Exception as e:
 print("Unable to retrieve file contents: 0".format(e))

get_item('bucket_name', 'item_name')

share|improve this question

asked Mar 7 at 11:07

VinayVinay

33

share|improve this question

asked Mar 7 at 11:07

VinayVinay

33

asked Mar 7 at 11:07

VinayVinay

33

asked Mar 7 at 11:07

VinayVinay

33