Y
@ s d Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m
Z
y d d l m Z Wn" e
k
r d d l m Z Yn Xd d l Z d d l m Z m Z m Z m Z d d l Z d d l m Z m Z m Z m Z m Z m Z m Z m Z m Z m Z m! Z! m" Z" d d l m# Z# d d l$ m% Z% d d l& m' Z' d d
l( m) Z) d d l* m+ Z+ d d l, m- Z- e j. d
Z/ e j. d e j0 Z1 e j. d Z2 e j. d e j0 j3 Z4 d j5 Z6 d d d d g Z7 d Z8 d Z9 e9 j: d e j; d d d e Z< d d Z= d d Z> d d Z? d d d Z@ d d! d" ZA d d# d$ ZB d e d d% d ZC d d& d' ZD d( d) ZE e j. d* e j0 ZF eE d+ d, ZG Gd- d. d. eH ZI Gd/ d0 d0 eI ZJ Gd1 d d e ZK e j. d2 jL ZM d3 d4 ZN d5 d6 ZO d7 d8 ZP d d9 d: ZQ d; d< ZR Gd= d> d> eH ZS Gd? d@ d@ e jT ZU e jV jW dA dB ZX eQ e8 eX ZX dC dD ZY dE dF ZZ d S)Gz#PyPI and direct package downloading N)wraps) splituser)urllib http_client configparsermap)
CHECKOUT_DIST Distribution BINARY_DISTnormalize_path SOURCE_DIST Environmentfind_distributions safe_name safe_version to_filename Requirement DEVELOP_DIST) ssl_support)log)DistutilsError) translate)strip_fragment)get_all_headersz^egg=([-A-Za-z0-9_.+!]+)$zhref\s*=\s*['"]?([^'"> ]+)z([^<]+)
\s+\(md5\)z([-+.a-z0-9]{2,}):z .tar.gz .tar.bz2 .tar .zip .tgz PackageIndexdistros_for_urlparse_bdist_wininstinterpret_distro_name z/tmp/pip-build-3puug3g5/setuptools/setuptools/package_index.pyparse_requirement_arg6 s
r& c C s | j } d \ } } } | j d r | j d rR | d d } d } n | j d d r | d d } | d d } d } n` | j d
r | d d } d } n8 | j d
d r | d d } | d d } d } | | | f S)z=Return (base,pyversion) or (None,None) for possible .exe nameNz.exez
.win32.exe
win32z .win32-py z.win-amd64.exe z win-amd64z
.win-amd64-py )NNNiiiiiiir. i)lowerendswith
startswith)namer/ basepy_verplatr$ r$ r% r ? s$ c C s t j j | } | \ } } } } } } t j j | j d d } | d k r | d k r t j j | j d d } d | k r | j d d \ } } | | f S) N/ zsourceforge.netdownload #)r r! urlparseunquotesplit) urlpartsschemeserverpathZ
parametersqueryfragmentr3 r$ r$ r% egg_info_for_urlW s rG c c s t | \ } } x t | | | D] } | Vq% W| r t j | } | r x. t | | j d | d t D] } | Vqq Wd S)zEYield egg or source distribution objects that might be found at a URLr7
precedenceN)rG distros_for_location EGG_FRAGMENTmatchr groupr )r@ metadatar3 rF distrK r$ r$ r% r b s "c C s | j d r | d d } | j d rP d | k rP t j | | | g S| j d r t | \ } } } | d k r t | | | | t | SxD t D]< } | j | r | d t | } t | | | Sq Wg S)z:Yield egg or source distribution objects based on basenamez.egg.zipNr+ z.egg-z.exer. )r0 r
from_locationr r r
EXTENSIONSlen)locationbasenamerM Zwin_baser4 platformextr$ r$ r% rI p s
rI c C s" t t | t j j | | S)zEYield possible egg or source distribution objects based on a filename)rI r osrD rT )filenamerM r$ r$ r% distros_for_filename s rY c c s | j d } | r= t d d | d d D r= d Sxm t d t | d D]R } t | | d j | d | d j | | d d | d | d | VqW Wd S)
zGenerate alternative interpretations of a source distro name
Note: if `location` is a filesystem filename, you should call
``pkg_resources.normalize_path()`` on it before passing it to this
routine!
rO c s s! | ] } t j d | Vq d S)z py\d\.\d$N)rerK ).0pr$ r$ r% s z(interpret_distro_name..r9 Nr7
py_versionrH rU )r? anyrangerR r join)rS rT rM r^ rH rU rA r\ r$ r$ r% r s * 5 c c s t } | j } | d k rS xj t j j | j | D] } | | | Vq7 Wn8 x5 | D]- } | | } | | k rZ | | | VqZ Wd S)zHList unique elements, preserving order. Remember all elements ever seen.N)setaddsixmoves filterfalse __contains__)iterablekeyseenZseen_addelementkr$ r$ r% unique_everseen s
rm c s" t f d d } | S)zs
Wrap a function returning an iterable such that the resulting iterable
only ever yields unique items.
c s t | | S)N)rm )argskwargs)funcr$ r% wrapper s z unique_values..wrapper)r )rp rq r$ )rp r%
unique_values s rr z(<([^>]*\srel\s*=\s*['"]?([^'">]+)[^>]*)>c c s x t j | D] } | j \ } } t t t j | j j d } d | k sg d | k r x: t j | D]) } t
j j | t
| j d Vqw Wq Wxd d D]\ } | j | } | d k r t j | | } | r t
j j | t
| j d Vq Wd S)
zEFind rel="homepage" and rel="download" links in `page`, yielding URLs,Zhomepager8 r7
| Home Page | Download URLN)rt ru r; )RELfinditergroupsrb r strstripr/ r? HREFr r! urljoin
htmldecoderL findsearch)r@ pagerK tagrelZrelsposr$ r$ r% find_external_links s '+
r c @ s: e Z d Z d Z d d Z d d Z d d Z d S) ContentCheckerzP
A null content checker that defines the interface for checking content
c C s d S)z3
Feed a block of data to the hash.
Nr$ )selfblockr$ r$ r% feed s zContentChecker.feedc C s d S)zC
Check the hash. Return False if validation fails.
Tr$ )r r$ r$ r% is_valid s zContentChecker.is_validc C s d S)zu
Call reporter with information about the checker (hash name)
substituted into the template.
Nr$ )r reportertemplater$ r$ r% report s zContentChecker.reportN)__name__
__module__ __qualname____doc__r r r r$ r$ r$ r% r s r c @ sa e Z d Z e j d Z d d Z e d d Z d d Z d d Z
d
d Z d S)
HashCheckerzK(?Psha1|sha224|sha384|sha256|sha512|md5)=(?P[a-f0-9]+)c C s( | | _ t j | | _ | | _ d S)N) hash_namehashlibnewhashexpected)r r r r$ r$ r% __init__ s zHashChecker.__init__c C sR t j j | d } | s# t S| j j | } | sB t S| | j S)z5Construct a (possibly null) ContentChecker from a URLr7 r; )r r! r= r patternr groupdict)clsr@ rF rK r$ r$ r% from_url s zHashChecker.from_urlc C s | j j | d S)N)r update)r r r$ r$ r% r s zHashChecker.feedc C s | j j | j k S)N)r hexdigestr )r r$ r$ r% r s zHashChecker.is_validc C s | | j } | | S)N)r )r r r msgr$ r$ r% r s
zHashChecker.reportN) r r r rZ compiler r classmethodr r r r r$ r$ r$ r% r s r c s e Z d Z d Z d dJ d d d d Z d d d
Z d d d Z d d
d Z d d Z d d Z d d Z
d d Z d d d Z d d Z
d f d d Z d d Z d d Z d! d" Z d# d$ Z d% d& Z d d d d d' d( Z d d d) d* Z d+ d, Z d- Z d. d/ Z d0 d1 Z d d2 d3 Z d4 d5 Z d6 d7 Z d8 d9 Z d: d; Z d< d= Z e d d> d? Z! d@ dA Z" dB dC Z# dD dE Z$ dF dG Z% dH dI Z& S)Kr z;A distribution index that scans web pages for download URLsz https://pypi.python.org/simple*NTc O s t j | | | | d d | j d | _ i | _ i | _ i | _ t j d j t
t | j | _
g | _ | o t j o | p t j } | r t j | | _ n t j j | _ d S)Nr6 |)r
r r0 index_url scanned_urls fetched_urls
package_pagesrZ r ra r r rK allowsto_scanr Z is_availableZfind_ca_bundleZ
opener_foropenerr requesturlopen)r r hostsZ ca_bundleZ
verify_sslrn kwZuse_sslr$ r$ r% r $ s ! ' zPackageIndex.__init__Fc C s^ | | j k r | r d Sd | j | .)filterrW rD r r itertoolsstarmap
scan_egg_link)r search_pathdirsZ egg_linksr$ r$ r% scan_egg_links s
zPackageIndex.scan_egg_linksc
C s t t j j | | ( } t t d t t j | } Wd QRXt | d k r\ d S| \ } } xQ t
t j j | | D]4 } t j j | | | _ t | _
| j | q Wd S)Nr9 )openrW rD ra r r r ry rz rR r rS r rH rc )r rD r Z raw_lineslinesZegg_pathZ
setup_pathrN r$ r$ r% r s ( " zPackageIndex.scan_egg_linkc
s f d d } xX t j | D]G } y, | t j j | t | j d Wq" t k
rh Yq" Xq" W| | \ } } | rxv t | | D]e } t | \ } } | j
d r | r | r | d | | f 7} n
j | j | q Wt
j d d | Sd Sd S)
z#Process the contents of a PyPI pagec s | j j r t t t j j | t j d j d } t | d k r d | d k r t | d } t
| d } d j j | j
i | rR r? r r r
setdefaultr/ r )r rA pkgver)r r$ r% scan s 1" z(PackageIndex.process_index..scanr7 z.pyz
#egg=%s-%sc S s d | j d d d S)Nz%sr7 r r9 )rL )mr$ r$ r% s z,PackageIndex.process_index..r N)r{ rw r r! r| r} rL r" r rG r0 need_version_infoscan_urlPYPI_MD5sub)
r r@ r r rK r r new_urlr3 fragr$ )r r% r s$ ,
zPackageIndex.process_indexc C s | j d | d S)NzPPage at %s links to .py file(s) without version info; an index scan is required.)scan_all)r r@ r$ r$ r% r s z PackageIndex.need_version_infoc G sI | j | j k r5 | r( | j | | | j d | j | j d S)Nz6Scanning index of all packages (this may take a while))r r r r r )r r rn r$ r$ r% r s zPackageIndex.scan_allc C s | j | j | j d | j j | j sK | j | j | j d | j j | j sm | j | x3 t | j j | j f D] } | j | q Wd S)Nr6 ) r r unsafe_namer r ri project_namenot_found_in_indexr )r requirementr@ r$ r$ r%
find_packages s
%zPackageIndex.find_packagesc sk | j | j | x8 | | j D]) } | | k r; | S| j d | | q% Wt t | j | | S)Nz%s does not match %s)prescanr ri r superr obtain)r r installerrN ) __class__r$ r% r s
zPackageIndex.obtainc C sf | j | j d | | j sb | j t j | t d | j j t j j
| f d S)z-
checker is a ContentChecker
z Validating %%s checksum for %sz7%s validation failed for %s; possible download problem?N) r r r r rW unlinkr r r2 rD rT )r checkerrX tfpr$ r$ r%
check_hash s
zPackageIndex.check_hashc C sr xk | D]c } | j d k sJ t | sJ | j d sJ t t | rZ | j | q | j j | q Wd S)z;Add `urls` to the list that will be prescanned for searchesNzfile:)r r r1 r r r append)r urlsr@ r$ r$ r% add_find_links s
zPackageIndex.add_find_linksc C s/ | j r" t t | j | j d | _ d S)z7Scan urls scheduled for prescanning (e.g. --find-links)N)r r r r )r r$ r$ r% r s zPackageIndex.prescanc C sN | | j r | j d } } n | j d } } | | | j | j d S)Nz#Couldn't retrieve index page for %rz3Couldn't find index page for %r (maybe misspelled?))ri r r r r )r r methr r$ r$ r% r s
z PackageIndex.not_found_in_indexc C s t | t s t | } | ry | j | j d | | } t | \ } } | j d ru | j | | | } | St j j
| r | St | } t | j
| | d d S)a Locate and/or download `spec` to `tmpdir`, returning a local path
`spec` may be a ``Requirement`` object, or a string containing a URL,
an existing local filename, or a project/version requirement spec
(i.e. the string form of a ``Requirement`` object). If it is the URL
of a .py file with an unambiguous ``#egg=name-version`` tag (i.e., one
that escapes ``-`` as ``_`` throughout), a trivial ``setup.py`` is
automatically created alongside the downloaded file.
If `spec` is a ``Requirement`` object or a string containing a
project/version requirement spec, this method returns the location of
a matching distribution (possibly after downloading it to `tmpdir`).
If `spec` is a locally existing file or directory name, it is simply
returned unchanged. If `spec` is a URL, it is downloaded to a subpath
of `tmpdir`, and the local filename is returned. Various errors may be
raised if a problem occurs during downloading.
r7 z.pyrS N)r r r
_download_urlrL rG r0 gen_setuprW rD r r& r fetch_distribution)r r# tmpdirrB foundr3 rF r$ r$ r% r8 s zPackageIndex.downloadc s: j d | i d } d f d d } | rf j j | | | } | r | d k r | | | } | d k r j d k r j | | } | d k r | r j | | | } | d k r j d rd p d | n# j d | | j d | j Sd S)
a| Obtain a distribution suitable for fulfilling `requirement`
`requirement` must be a ``pkg_resources.Requirement`` instance.
If necessary, or if the `force_scan` flag is set, the requirement is
searched for in the (online) package index as well as the locally
installed packages. If a distribution matching `requirement` is found,
the returned distribution's ``location`` is the value you would have
gotten from calling the ``download()`` method with the matching
distribution's URL or filename. If no matching distribution is found,
``None`` is returned.
If the `source` flag is set, only source distributions and source
checkout links will be considered. Unless the `develop_ok` flag is
set, development and system eggs (i.e., those using the ``.egg-info``
format) will be ignored.
zSearching for %sNc s | d k r } x | | j D] } | j t k re re | k r j d | d | .findz:No local packages or working download links found for %s%sza source distribution of r zBest match: %srS )r r r r r cloner ) r r r
force_scanr
r Z local_indexrN r~ r$ )r r r r
r r% r B s0 !
z PackageIndex.fetch_distributionc C s/ | j | | | | } | d k r+ | j Sd S)a3 Obtain a file suitable for fulfilling `requirement`
DEPRECATED; use the ``fetch_distribution()`` method now instead. For
backward compatibility, this routine is identical but returns the
``location`` of the downloaded distribution instead of a distribution
object.
N)r rS )r r r r r
rN r$ r$ r% fetch s zPackageIndex.fetchc
C s\ t j | } | r= d d t | | j d d D p@ g } t | d k r-t j j | } t j j | | k r t j j | | } d d l
m } | | | s t j
| | | } t t j j | d d ? } | j d | d j | d j t j j | d f Wd QRX| S| rLt d | | f n t d
d S) Nc S s g | ] } | j r | q Sr$ )version)r[ dr$ r$ r%
s z*PackageIndex.gen_setup..r7 r )samefilezsetup.pywzIfrom setuptools import setup
setup(name=%r, version=%r, py_modules=[%r])
zCan't unambiguously interpret project/version identifier %r; any dashes in the name or version should be escaped using underscores. %rzpCan't process plain .py files without an '#egg=name-version' suffix to enable automatic setup script generation.)rJ rK r rL rR rW rD rT dirnamera Z setuptools.command.easy_installr shutilcopy2r writer r splitextr )
r rX rF r rK r rT dstr r r$ r$ r% r s2 !"zPackageIndex.gen_setupi c
C s | j d | d \ } } zSt j | } | j t | } t | t j j rw t d | | j
| j f | j } d } | j } d } d | k r t
| d }
t t t |
} | j | | | | | t | d w } xZ | j | } | rK| j | | j | | d 7} | j | | | | | q Pq W| j | | | Wd QRX| SWd | r| j Xd S)
NzDownloading %szCan't download %s: %s %sr r7 zcontent-lengthzContent-Lengthwb)NNr; )r r r r r r r r r r r r dl_blocksizer maxr int
reporthookr r r r r r )
r r@ rX fpr r r blocknumbssizesizesr r r$ r$ r% _download_to s:
zPackageIndex._download_toc C s d S)Nr$ )r r@ rX r Zblksizer! r$ r$ r% r s zPackageIndex.reporthookc C s | j d r t | Sy t | | j SWnt t j f k
r } zS d j d d | j D } | r | j | | n t
d | | f WYd d } ~ XnIt j j
k
r } z | SWYd d } ~ Xnt j j k
r8} z: | r
| j | | j n t
d | | j f WYd d } ~ Xn t j k
r} z: | ri| j | | j n t
d | | j f WYd d } ~ Xn` t j t j f k
r} z4 | r| j | | n t
d | | f WYd d } ~ Xn Xd S)Nzfile: c S s g | ] } t | q Sr$ )ry )r[ argr$ r$ r% r s z)PackageIndex.open_url..z%s %szDownload error for %s: %sz;%s returned a bad status line. The server might be down, %s)r1
local_openopen_with_authr r" r
InvalidURLra rn r r r r r URLErrorreason
BadStatusLineline
HTTPExceptionsocket)r r@ warningvr r$ r$ r% r s6
(%% zPackageIndex.open_urlc C sK t | \ } } | rL x7 d | k rH | j d d j d d } q Wn d } | j d rq | d d } t j j | | } | d k s | j d r | j | | S| d
k s | j d r | j | | S| j d r | j | | S| d
k r't
j j t
j
j | d S| j | d | j | | Sd S)Nz...\_Z__downloaded__z.egg.zipr+ svnzsvn+gitzgit+zhg+r r9 Tr. )rG replacer0 rW rD ra r1
_download_svn
_download_git _download_hgr r url2pathnamer! r= r _attempt_download)r rB r@ r r2 rF rX r$ r$ r% r
s$ % zPackageIndex._download_urlc C s | j | d d S)NT)r )r r@ r$ r$ r% r ' s zPackageIndex.scan_urlc C sK | j | | } d | j d d j k rC | j | | | S| Sd S)Nr z content-typer )r# r r/ _download_html)r r@ rX r r$ r$ r% r; * s z PackageIndex._attempt_downloadc C s t | } xT | D]L } | j r t j d | r^ | j t j | | j | | SPq W| j t j | t d | d S)Nz ([^- ]+ - )?Revision \d+:z Unexpected HTML page found at ) r rz rZ r r rW r r7 r )r r@ r rX r r, r$ r$ r% r< 1 s
zPackageIndex._download_htmlc C si | j d d d } d } | j j d r8d | k r8t j j | \ } } } } } } | r8| j d r8d | d d k r8| d d j d d \ } } t | \ }
} |
r8d
|
k r |
j d
d \ } }
d | |
f } n
d |
} | } | | | | | | f } t j j | } | j d
| | t j
d | | | f | S)Nr: r7 r r zsvn:@z//r6 r9 :z --username=%s --password=%sz --username=z'Doing subversion checkout from %s to %szsvn checkout%s -q %s %s) r? r/ r1 r r! r= r
urlunparser rW system)r r@ rX credsrB netlocrD r\ qr authhostuserpwrA r$ r$ r% r7 @ s$ !$,"
zPackageIndex._download_svnc C s t j j | \ } } } } } | j d d d } | j d d d } d } d | k rw | j d d \ } } t j j | | | | d f } | | f S)N+r7 r: r r= r r; )r r! urlsplitr? rsplit
urlunsplit)r@
pop_prefixrB rB rD rE r revr$ r$ r% _vcs_split_rev_from_urlU s ! !z$PackageIndex._vcs_split_rev_from_urlc C s | j d d d } | j | d d \ } } | j d | | t j d | | f | d k r | j d | t j d | | f | S)
Nr: r7 r rL Tz Doing git clone from %s to %szgit clone --quiet %s %szChecking out %sz"(cd %s && git checkout --quiet %s))r? rN r rW r@ )r r@ rX rM r$ r$ r% r8 g s zPackageIndex._download_gitc C s | j d d d } | j | d d \ } } | j d | | t j d | | f | d k r | j d | t j d | | f | S)
Nr: r7 r rL Tz Doing hg clone from %s to %szhg clone --quiet %s %szUpdating to %sz (cd %s && hg up -C -r %s >&-))r? rN r rW r@ )r r@ rX rM r$ r$ r% r9 w s zPackageIndex._download_hgc G s t j | | d S)N)r r )r r rn r$ r$ r% r s zPackageIndex.debugc G s t j | | d S)N)r r )r r rn r$ r$ r% r s zPackageIndex.infoc G s t j | | d S)N)r r )r r rn r$ r$ r% r s zPackageIndex.warn)r )'r r r r r r r r r r r r r r r r r r r r8 r r
r r r# r r r r r; r< r7 staticmethodrN r8 r9 r r r r$ r$ )r r% r ! sL 2
+ #D
) $ # z!&(#(\d+|x[\da-fA-F]+)|[\w.:-]+);?c C s6 t | t s | S| d k r, t j | St | S)N )r r rd unichrchr)cr$ r$ r% uchr s
rT c C s | j d } | j d r: t | d d d } nL | j d rb t | d d } n$ t j j j j | | j d } t | S)Nr7 z#xr9 r) r: r ) rL r1 r rd re
html_entitiesname2codepointr rT )rK whatr$ r$ r%
decode_entity s $rX c C s
t t | S)z'Decode HTML entities in the given text.)
entity_subrX )textr$ r$ r% r} s r} c s f d d } | S)Nc s f d d } | S)Nc s? t j } t j z | | SWd t j | Xd S)N)r. getdefaulttimeoutsetdefaulttimeout)rn ro Z old_timeout)rp timeoutr$ r% _socket_timeout s
z@socket_timeout.<locals>._socket_timeout.<locals>._socket_timeoutr$ )rp r^ )r] )rp r% r^ s z'socket_timeout.<locals>._socket_timeoutr$ )r] r^ r$ )r] r% socket_timeout s r_ c C sI t j j | } | j } t j | } | j } | j d d S)aq
A function compatible with Python 2.3-3.3 that will encode
auth from a URL suitable for an HTTP header.
>>> str(_encode_auth('username%3Apassword'))
'dXNlcm5hbWU6cGFzc3dvcmQ='
Long auth strings should not cause a newline to be inserted.
>>> long_auth = 'username:' + 'password'*10
>>> chr(10) in str(_encode_auth(long_auth))
False
r )r r! r> encodebase64 encodestringr r6 )rD Zauth_sZ
auth_bytesZ
encoded_bytesencodedr$ r$ r% _encode_auth s
re c @ s: e Z d Z d Z d d Z d d Z d d Z d S)
Credentialz:
A username/password pair. Use like a namedtuple.
c C s | | _ | | _ d S)N)usernamepassword)r rg rh r$ r$ r% r s zCredential.__init__c c s | j V| j Vd S)N)rg rh )r r$ r$ r% __iter__ s zCredential.__iter__c C s d t | S)Nz%(username)s:%(password)s)vars)r r$ r$ r% __str__ s zCredential.__str__N)r r r r r ri rk r$ r$ r$ r% rf s rf c @ sF e Z d Z d d Z e d d Z d d Z d d Z d S)
PyPIConfigc C sr t j d d d g d } t j j | | t j j t j j d d } t j j | rn | j
| d S)z%
Load from ~/.pypirc
rg rh
repositoryr ~z.pypircN) dictfromkeysr RawConfigParserr rW rD ra
expanduserr r )r defaultsrcr$ r$ r% r s
!zPyPIConfig.__init__c s5 f d d j D } t t j | S)Nc s. g | ]$ } j | d j r | q S)rm )r rz )r[ section)r r$ r% r s z2PyPIConfig.creds_by_repository.<locals>.<listcomp>)sectionsro r _get_repo_cred)r Zsections_with_repositoriesr$ )r r% creds_by_repository s z PyPIConfig.creds_by_repositoryc C sO | j | d j } | t | j | d j | j | d j f S)Nrm rg rh )r rz rf )r ru repor$ r$ r% rw s zPyPIConfig._get_repo_credc C s7 x0 | j j D] \ } } | j | r | Sq Wd S)z
If the URL indicated appears to be a repository defined in this
config, return the credential for that repository.
N)rx itemsr1 )r r@ rm credr$ r$ r% find_credential s zPyPIConfig.find_credentialN)r r r r propertyrx rw r| r$ r$ r$ r% rl s rl c C s t j j | \ } } } } } } | j d rB t j d | d
k rc t | \ } } n d } | s t j | }
|
r t |
} |
j
| f } t j d | | rd t
| } | | | | | | f } t j j | }
t j j |
} | j d | n t j j | } | j d t | | } | rt j j | j \ } } } } } } | | k r| | k r| | | | | | f } t j j | | _ | S) z4Open a urllib2 request, handling HTTP authenticationr> znonnumeric port: ''httphttpsNz*Authenticating as %s for %s (from .pypirc)zBasic
Authorizationz
User-Agent)zhttpzhttps)r r! r= r0 r r( r rl r| ry rg r r re r? r Request
add_header
user_agentr@ )r@ r rB rB rD paramsrE r rD rE r{ r rA r r r s2h2path2Zparam2Zquery2Zfrag2r$ r$ r% r' s6 $ 'r' c C s | S)Nr$ )r@ r$ r$ r%
fix_sf_url< s r c C s t j j | \ } } } } } } t j j | } t j j | rX t j j | S| j d rNt j j
| rNg } x t j | D] } t j j | | }
| d k r t
|
d } | j } Wd QRXPn t j j
|
r | d 7} | j d j d | q Wd }
|
j d | d d
j | } d \ } } n d \ } } } d d i } t j | } t j j | | | | | S)z7Read a local path, with special support for directoriesr6 z
index.htmlrNz<a href="{name}">{name}</a>r2 zB<html><head><title>{url}{files} |