{r Qc @ s* d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z
d d l m Z d d l
m Z d d l m Z d d l m Z d d l
m Z d d l m Z y d d l m Z Wn! e k
rd d l m Z n Xd e f d
YZ d S( iN( t BotoClientError( t Provider( t KeyFile( t User( t UserAgent( t compute_md5( t md5t Keyc B s e Z d Z d Z d Z d Z e d d d d d d g Z e Z x' e D] Z e j
e j d
d qL WdE dE d Z
d
Z d Z d Z d Z e d Z d Z d Z e d Z d Z dE d dE dE d Z dE dE d Z d dE dE dE d Z e Z e d Z d Z d d Z dE e d Z! dE e e e e d Z" d! Z# d" Z$ d# Z% d$ Z& d% Z' d& Z( d' Z) dE d( Z* dE d) Z+ dE d* Z, dE d+ Z- dE d, Z. d- Z/ d. Z0 dE d/ Z1 d0 dE e e dE e dE dE e e d1
Z2 dE dE d2 dE e dE d3 Z3 dE d4 Z4 dE e dE d2 dE e dE dE d5 Z5 dE e dE d2 dE dE e dE e dE e d6 Z6 dE e dE d2 dE dE e e d7 Z7 dE e dE d2 dE dE e e d8 Z8 dE dE d2 e dE dE dE d9 Z9 dE dE d2 e dE dE dE dE d: Z: dE dE d2 d; Z; dE dE d2 e dE dE dE d< Z< dE dE d2 e dE dE dE d= Z= dE dE d2 e dE dE d> Z> dE d? Z? dE dE d@ Z@ dA ZA dE dB ZB dE dC ZC dE dD ZD RS(F sC
Represents a key (object) in an S3 bucket.
:ivar bucket: The parent :class:`boto.s3.bucket.Bucket`.
:ivar name: The name of this Key object.
:ivar metadata: A dictionary containing user metadata that you
wish to store with the object or that has been retrieved from
an existing object.
:ivar cache_control: The value of the `Cache-Control` HTTP header.
:ivar content_type: The value of the `Content-Type` HTTP header.
:ivar content_encoding: The value of the `Content-Encoding` HTTP header.
:ivar content_disposition: The value of the `Content-Disposition` HTTP
header.
:ivar content_language: The value of the `Content-Language` HTTP header.
:ivar etag: The `etag` associated with this object.
:ivar last_modified: The string timestamp representing the last
time this object was modified in S3.
:ivar owner: The ID of the owner of this object.
:ivar storage_class: The storage class of the object. Currently, one of:
STANDARD | REDUCED_REDUNDANCY | GLACIER
:ivar md5: The MD5 hash of the contents of the object.
:ivar size: The size, in bytes, of the object.
:ivar version_id: The version ID of this object, if it is a versioned
object.
:ivar encrypted: Whether the object is encrypted while at rest on
the server.
s application/octet-streams
%s
i s
cache-controls content-dispositions content-encodings content-languages content-md5s content-typet -t _c C s | | _ | | _ i | _ d | _ | j | _ d | _ d | _ d | _ d | _
d | _ t | _
d | _ d | _ d | _ d | _ d | _ d | _ d | _ d | _ d | _ d | _ d | _ t | _ d | _ d | _ d | _ d S( Nt STANDARD( t buckett namet metadatat Nonet
cache_controlt DefaultContentTypet content_typet content_encodingt content_dispositiont content_languaget filenamet etagt Falset is_latestt
last_modifiedt ownert
storage_classR t base64md5t patht respt modet sizet
version_idt source_version_idt
delete_markert encryptedt ongoing_restoret expiry_date( t selfR R ( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyt __init__a s4 c C s/ | j r d | j j | j f Sd | j Sd S( Ns s ( R R ( R' ( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyt __repr__ s c C s | d k r | j St d S( Nt key( R t AttributeError( R' R ( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyt __getattr__ s c C s- | d k r | | j d | d d !} n | | f S( s
A utility function to create the 2-tuple (md5hexdigest, base64md5)
from just having a precalculated md5_hexdigest.
is
i ( t binasciit unhexlifyt base64t encodestring( R' t
md5_hexdigestt digestR ( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyt get_md5_from_hexdigest s
c C s@ | j j j } | j r3 | j | j d | _ n d | _ d S( N( R R1 R2 t server_side_encryption_headert getheaderR R$ ( R' R R2 ( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyt handle_encryption_headers s c C s | j j j } | j d k s$ | r? | j | j d | _ n | j | j d | _ | j | j d d k r~ t | _ n t
| _ d S( Nt falset true( R R1 R2 R! R R; t copy_source_version_idR" R# t TrueR ( R' R t forceR2 ( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyt handle_version_headers s c C s | j d } | d k r d S| j d d } x | D] } g | j d D] } | j ^ qN \ } } | j d d } | d k r | j d k r t n t | _ q8 | d k r8 | | _ q8 q8 Wd S(
Ns
x-amz-restoret ,i t =t "t s ongoing-requestR> s expiry-date(
R; R t splitt stript replacet lowerR@ R R% R& ( R' t responset headert partst partt iR* t val( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyt handle_restore_headers s
. $ RF c
C sW | j d k rSd | _ | j j j } | j j j d | j j | j | d | d | | _ | j j d k s | j j d k r | j j } | j
| j j | j j | n | j j } t
j j | | | _ xU| j D]G\ } } | j d k r!d | k r!t | | _ q | j d k rZt j d
d | } t | | _ q | j d k rx| | _ q | j d
k r| | _ q | j d k r| | _ q | j d k r| | _ q | j d k r| | _ q | j d k r| | _ q | j d k r | | _ q q W| j | j | j | j n d S( s
Open this key for reading
:type headers: dict
:param headers: Headers to pass in the web request
:type query_args: string
:param query_args: Arguments to pass in the query string
(ie, 'torrent')
:type override_num_retries: int
:param override_num_retries: If not None will override configured
num_retries parameter for underlying GET.
:type response_headers: dict
:param response_headers: A dictionary containing HTTP
headers/values that will override any headers associated
with the stored object in the response. See
http://goo.gl/EWOPb for details.
t rt GETt
query_argst override_num_retriesi i+ s content-lengths
Content-Ranges
content-ranges .*/(.*)s \1R s content-types content-encodings content-languages
last-modifieds
cache-controls content-dispositionN( R R R R R1 R2 t make_requestR t statust readt storage_response_errort reasont msgt botot utilst get_aws_metadataR
t itemsRJ t intR t ret subR R R R R R R RB R< (
R' t headersRT RU t response_headersR2 t bodyR R. t end_range( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyt open_read sJ $ c C s t d d S( sK
Open this key for writing.
Not yet implemented
:type headers: dict
:param headers: Headers to pass in the write request
:type override_num_retries: int
:param override_num_retries: If not None will override configured
num_retries parameter for underlying PUT.
s Not ImplementedN( R ( R' Rc RU ( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyt
open_write
s RR c C sv | d k r4 d | _ | j d | d | d | n> | d k rb d | _ | j d | d | n t d | d S( NRR Rc RT RU t ws Invalid mode: %s( R Rg Rh R ( R' R Rc RT RU ( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyt open s
c C s? | j r | r | j j n d | _ d | _ t | _ d S( s
Close this key.
:type fast: bool
:param fast: True if you want the connection to be closed without first
reading the content. This should only be used in cases where subsequent
calls don't need to return the content from the open HTTP connection.
Note: As explained at
http://docs.python.org/2/library/httplib.html#httplib.HTTPConnection.getresponse,
callers must read the whole response before sending a new request to the
server. Calling Key.close(fast=True) and making a subsequent request to
the server will work because boto will get an httplib exception and
close/reopen the connection.
N( R RX R R R@ t closed( R' t fast( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyt close* s
c C s< | j | j j | j } | s8 | j t n | S( s
By providing a next method, the key object supports use as an iterator.
For example, you can now say:
for bytes in key:
write bytes to a file or whatever
All of the HTTP connection stuff is handled for you.
( Rg R RX t
BufferSizeRm t
StopIteration( R' t data( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyt next@ s
i c C sQ | j | d k r( | j j } n | j j | } | sM | j n | S( Ni ( Rg R RX Rm ( R' R Rp ( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyRX Q s
c C s | d k r7 | j | j j | j d t d t d | S| d k rn | j | j j | j d t d t d | St d | d S( s
Change the storage class of an existing key.
Depending on whether a different destination bucket is supplied
or not, this will either move the item within the bucket, preserving
all metadata and ACL info bucket changing the storage class or it
will copy the item to the provided destination bucket, also
preserving metadata and ACL info.
:type new_storage_class: string
:param new_storage_class: The new storage class for the Key.
Possible values are:
* STANDARD
* REDUCED_REDUNDANCY
:type dst_bucket: string
:param dst_bucket: The name of a destination bucket. If not
provided the current bucket of the key will be used.
:type validate_dst_bucket: bool
:param validate_dst_bucket: If True, will validate the dst_bucket
by using an extra list request.
R
t reduced_redundancyt preserve_aclt validate_dst_buckett REDUCED_REDUNDANCYs Invalid storage class: %sN( t copyR R R R@ R ( R' t new_storage_classt
dst_bucketRt ( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyt change_storage_class[ s c C sa | j j j | | } | r' d } n | j } | j | | j j | j | d | d | d | S( s
Copy this Key to another bucket.
:type dst_bucket: string
:param dst_bucket: The name of the destination bucket
:type dst_key: string
:param dst_key: The name of the destination key
:type metadata: dict
:param metadata: Metadata to be associated with new key. If
metadata is supplied, it will replace the metadata of the
source key being copied. If no metadata is supplied, the
source key's metadata will be copied to the new key.
:type reduced_redundancy: bool
:param reduced_redundancy: If True, this will force the
storage class of the new Key to be REDUCED_REDUNDANCY
regardless of the storage class of the key being copied.
The Reduced Redundancy Storage (RRS) feature of S3,
provides lower redundancy at lower storage cost.
:type preserve_acl: bool
:param preserve_acl: If True, the ACL from the source key will
be copied to the destination key. If False, the
destination key will have the default ACL. Note that
preserving the ACL in the new key object will require two
additional API calls to S3, one to retrieve the current
ACL and one to set that ACL on the new object. If you
don't care about the ACL, a value of False will be
significantly more efficient.
:type encrypt_key: bool
:param encrypt_key: If True, the new copy of the object will
be encrypted on the server-side by S3 and will be stored
in an encrypted form while at rest in S3.
:type validate_dst_bucket: bool
:param validate_dst_bucket: If True, will validate the dst_bucket
by using an extra list request.
:rtype: :class:`boto.s3.key.Key` or subclass
:returns: An instance of the newly created key object
Ru R Rs t encrypt_key( R R1 t lookupR t copy_keyR ( R' Rx t dst_keyR
Rr Rs Rz Rt R ( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyRv s / c C s* | d k r" t | | _ | j Sd Sd S( Nt Owner( R R R ( R' R t attrsR1 ( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyt startElement s c C s | d k r | | _ n | d k r0 | | _ n | d k r` | d k rT t | _ q t | _ n | d k rx | | _ nm | d k r t | | _ nO | d k r | | _ n7 | d k r n( | d k r | | _ n t
| | | d S(
NR t ETagt IsLatestR> t LastModifiedt Sizet StorageClassR~ t VersionId( R R R@ R R R R` R R R! t setattr( R' R R. R1 ( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyt
endElement s& c C s t | j j | j S( st
Returns True if the key exists
:rtype: bool
:return: Whether the key exists on S3
( t boolR R{ R ( R' ( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyt exists s c C s | j j | j d | j S( s)
Delete this key from S3
R! ( R t
delete_keyR R! ( R' ( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyt delete s c C s | j j | S( N( R
t get( R' R ( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyt get_metadata s c C s | | j | t j } | j | | | | d | d | d | | j S( s
Retrieve an object from S3 using the name of the Key object as the
key in S3. Return the contents of the object as a string.
See get_contents_to_file method for details about the
parameters.
:type headers: dict
:param headers: Any additional headers to send in the request
:type cb: function
:param cb: a callback function that will be called to report
progress on the upload. The callback should accept two
integer parameters, the first representing the number of
bytes that have been successfully transmitted to S3 and
the second representing the size of the to be transmitted
object.
:type cb: int
:param num_cb: (optional) If a callback is specified with the
cb parameter this parameter determines the granularity of
the callback by defining the maximum number of times the
callback will be called during the file transfer.
:type torrent: bool
:param torrent: If True, returns the contents of a torrent file
as a string.
:type response_headers: dict
:param response_headers: A dictionary containing HTTP
headers/values that will override any headers associated
with the stored object in the response. See
http://goo.gl/EWOPb for details.
:rtype: string
:returns: The contents of the file as a string
R R! Rd ( R R t getvalue( R' Rc R R R R! Rd R ( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyt get_contents_as_string s
) c C s< | j d | } | j j | | | j | d | d S( s
Convenience method that provides a quick way to add an email grant
to a key. This method retrieves the current ACL, creates a new
grant based on the parameters passed in, adds that grant to the ACL
and then PUT's the new ACL back to S3.
:type permission: string
:param permission: The permission being granted. Should be one of:
(READ, WRITE, READ_ACP, WRITE_ACP, FULL_CONTROL).
:type email_address: string
:param email_address: The email address associated with the AWS
account your are granting the permission to.
:type recursive: boolean
:param recursive: A boolean value to controls whether the
command will apply the grant to all keys within the bucket
or not. The default value is False. By passing a True
value, the call will iterate through all keys in the
bucket and apply the same grant to each key. CAUTION: If
you have a lot of keys, this could take a long time!
Rc N( R t aclt add_email_grantR ( R' t
permissiont
email_addressRc R ( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyR - s c C sB | j d | } | j j | | d | | j | d | d S( s
Convenience method that provides a quick way to add a canonical
user grant to a key. This method retrieves the current ACL,
creates a new grant based on the parameters passed in, adds that
grant to the ACL and then PUT's the new ACL back to S3.
:type permission: string
:param permission: The permission being granted. Should be one of:
(READ, WRITE, READ_ACP, WRITE_ACP, FULL_CONTROL).
:type user_id: string
:param user_id: The canonical user id associated with the AWS
account your are granting the permission to.
:type display_name: string
:param display_name: An option string containing the user's
Display Name. Only required on Walrus.
Rc t display_nameN( R R t add_user_grantR ( R' R t user_idRc R R ( ( s. /tmp/tmp.yUYbTOKr8o/gsutil/boto/boto/s3/key.pyR H s c C sq t | t k rB t } xO | D] } | j | j q" Wn+ i } x" | D] } | | | | j | | =q> q> W| j } i } xa | D]Y } | j d s | j d r | j d d j d d } n | } | | | | s(