Severe server slowdowns

Let me echo Matt’s thank you! We treat conda-forge specially precisely because of its size, so this is definitely a surprising find. That said, I do not find this same slowdown from my location—which is not within Anaconda’s internal network, mind you, so I am not being treated specially! So if you can indeed respond to Matt’s request for verbose log, we’d definitely appreciate it. This will help us determine exactly where within our server & CDN structure the slowdown seems to be appearing.

To give you a sense of what we’d be looking at, here is my verbose log of this curl command. Note in particular the handoff to CloudFlare.

 % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0*   Trying 104.17.92.24...
* TCP_NODELAY set
* Connected to conda.anaconda.org (104.17.92.24) port 443 (#0)
* ALPN, offering h2
* ALPN, offering http/1.1
* successfully set certificate verify locations:
*   CAfile: /etc/ssl/cert.pem
  CApath: none
* TLSv1.2 (OUT), TLS handshake, Client hello (1):
} [232 bytes data]
* TLSv1.2 (IN), TLS handshake, Server hello (2):
{ [100 bytes data]
* TLSv1.2 (IN), TLS handshake, Certificate (11):
{ [2319 bytes data]
* TLSv1.2 (IN), TLS handshake, Server key exchange (12):
{ [114 bytes data]
* TLSv1.2 (IN), TLS handshake, Server finished (14):
{ [4 bytes data]
* TLSv1.2 (OUT), TLS handshake, Client key exchange (16):
} [37 bytes data]
* TLSv1.2 (OUT), TLS change cipher, Change cipher spec (1):
} [1 bytes data]
* TLSv1.2 (OUT), TLS handshake, Finished (20):
} [16 bytes data]
* TLSv1.2 (IN), TLS change cipher, Change cipher spec (1):
{ [1 bytes data]
* TLSv1.2 (IN), TLS handshake, Finished (20):
{ [16 bytes data]
* SSL connection using TLSv1.2 / ECDHE-ECDSA-CHACHA20-POLY1305
* ALPN, server accepted to use h2
* Server certificate:
*  subject: C=US; ST=California; L=San Francisco; O=Cloudflare, Inc.; CN=anaconda.org
*  start date: Jun  5 00:00:00 2021 GMT
*  expire date: Jun  4 23:59:59 2022 GMT
*  subjectAltName: host "conda.anaconda.org" matched cert's "*.anaconda.org"
*  issuer: C=US; O=Cloudflare, Inc.; CN=Cloudflare Inc ECC CA-3
*  SSL certificate verify ok.
* Using HTTP2, server supports multi-use
* Connection state changed (HTTP/2 confirmed)
* Copying HTTP/2 data in stream buffer to connection buffer after upgrade: len=0
* Using Stream ID: 1 (easy handle 0x7faa3a80f200)
> GET /conda-forge/linux-64/repodata.json HTTP/2
> Host: conda.anaconda.org
> User-Agent: curl/7.64.1
> Accept: */*
> 
* Connection state changed (MAX_CONCURRENT_STREAMS == 256)!
< HTTP/2 200 
< date: Fri, 07 Jan 2022 14:39:54 GMT
< content-type: application/json
< content-length: 165252103
< cf-ray: 6c9df02cdad5d2a6-DFW
< accept-ranges: bytes
< age: 3973
< cache-control: public, max-age=1200
< etag: "920537c2276f96fe135feeb9174923bc-20"
< expires: Fri, 07 Jan 2022 14:59:54 GMT
< last-modified: Fri, 07 Jan 2022 13:22:21 GMT
< vary: Accept-Encoding
< cf-cache-status: HIT
< expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
< x-amz-id-2: xWV1tgHLA6Fq4gN6Uu63jCLX4hEOZ0I25rwWDIRgCz7KGetyBI4xdNbINY39c+A8K4Y2bVTaSr4=
< x-amz-request-id: CKZG3KJW9YAAG0DK
< x-amz-version-id: null
< set-cookie: __cf_bm=GQheCekKN6kOitXdHmZW5upW_2E2kqfRxwuMMrEqefo-1641566394-0-Ab1ZAl8fh1i4kXcmg4Two4X6QOlJHeMJ/TqzzOLOTeB+8Mdq2PMdpjyjXg8a/bOJwHhr6OHTKne55pCbk05IncWlFbFdCaT5/Adb5cPAza/C; path=/; expires=Fri, 07-Jan-22 15:09:54 GMT; domain=.anaconda.org; HttpOnly; Secure; SameSite=None
< server: cloudflare
< 
{ [731 bytes data]
100  157M  100  157M    0     0  11.0M      0  0:00:14  0:00:14 --:--:-- 11.1M
* Connection #0 to host conda.anaconda.org left intact
* Closing connection 0