Restic hangs on init in B2 / ubuntu 20.04 - restic

Output of restic version

Tested first with the apt-installed version: restic 0.9.6 compiled with go1.12.12 on linux/amd64 ..and again after self-updating: restic 0.12.0 compiled with go1.15.8 on linux/amd64

How did you run restic exactly?

export B2_ACCOUNT_ID=...
export B2_ACCOUNT_KEY=...
restic -r b2:bucket-name init

Output:

enter password for new repository: 
enter password again:

Restic hangs at this point.

What backend/server/service did you use to store the repository?

backblaze

Expected behavior

Either initialize the repository or exit with an error message.

Actual behavior

Restic hangs indefinitely after asking for the new repository password confirmation.

If I run kill -s SIGABRT `pidof restic`

then I get the following backtraces:

SIGABRT: abort
PC=0x45c8f3 m=0 sigcode=0

goroutine 51 [syscall]:
runtime.notetsleepg(0x1504020, 0x2540b9e16, 0x1401)
        /usr/lib/go-1.12/src/runtime/lock_futex.go:227 +0x34 fp=0xc000185f60 sp=0xc000185f30 pc=0x40c4d4
runtime.timerproc(0x1504000)
        /usr/lib/go-1.12/src/runtime/time.go:311 +0x2ea fp=0xc000185fd8 sp=0xc000185f60 pc=0x44bf2a
runtime.goexit()
        /usr/lib/go-1.12/src/runtime/asm_amd64.s:1337 +0x1 fp=0xc000185fe0 sp=0xc000185fd8 pc=0x45aa91
created by runtime.(*timersBucket).addtimerLocked
        /usr/lib/go-1.12/src/runtime/time.go:169 +0x10e

goroutine 1 [select]:
net/http.(*persistConn).roundTrip(0xc0001a05a0, 0xc000366240, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/http/transport.go:2194 +0x75c
net/http.(*Transport).roundTrip(0xc0000c9320, 0xc000156a00, 0x60dba649, 0x3653425d, 0x331d0c763718)
        /usr/lib/go-1.12/src/net/http/transport.go:481 +0xa1b
net/http.(*Transport).RoundTrip(0xc0000c9320, 0xc000156a00, 0x14ff520, 0xdadf96, 0x11)
        /usr/lib/go-1.12/src/net/http/roundtrip.go:17 +0x35
github.com/kurin/blazer/b2.(*clientTransport).RoundTrip(0xc000224aa0, 0xc000156a00, 0x9b20ff, 0xcecde0, 0xc000366210)
        github.com/kurin/blazer/b2/b2.go:165 +0xe6
github.com/kurin/blazer/base.makeNetRequest(0xef3ae0, 0xc000032300, 0xc000156700, 0xedee20, 0xc000224aa0, 0xc00021c0d0, 0x4, 0x0)
        github.com/kurin/blazer/base/base.go:290 +0xe8
github.com/kurin/blazer/base.(*b2Options).makeRequest(0xc0004a8d00, 0xef3ae0, 0xc000032300, 0xdadf96, 0x11, 0xda2924, 0x4, 0xc002690000, 0x39, 0xc0a000, ...)
        github.com/kurin/blazer/base/base.go:383 +0x6b7
github.com/kurin/blazer/base.(*Bucket).GetUploadURL(0xc000152de0, 0xef3ae0, 0xc000032300, 0xc0003931b0, 0x40d629, 0xc0003661b0)
        github.com/kurin/blazer/base/base.go:669 +0x27a
github.com/kurin/blazer/b2.(*b2Bucket).getUploadURL(0xc000226168, 0xef3ae0, 0xc000032300, 0x28, 0xc0003661b0, 0x45, 0xdb4404)
        github.com/kurin/blazer/b2/baseline.go:281 +0x46
github.com/kurin/blazer/b2.(*beBucket).getUploadURL.func1.1(0xe, 0xc0003931e0)
        github.com/kurin/blazer/b2/backend.go:252 +0x56
github.com/kurin/blazer/b2.withReauth(0xef3ae0, 0xc000032300, 0xefd2e0, 0xc0000c4a00, 0xc0003661b0, 0xc000393248, 0x9d8b98)
        github.com/kurin/blazer/b2/backend.go:690 +0x2b
github.com/kurin/blazer/b2.(*beBucket).getUploadURL.func1(0xc0000c4a00, 0xee0820)
        github.com/kurin/blazer/b2/backend.go:262 +0xc3
github.com/kurin/blazer/b2.withBackoff(0xef3ae0, 0xc000032300, 0xefd2e0, 0xc0000c4a00, 0xc000366180, 0xee0820, 0xc000366150)
        github.com/kurin/blazer/b2/backend.go:671 +0x4d
github.com/kurin/blazer/b2.(*beBucket).getUploadURL(0xc000224200, 0xef3ae0, 0xc000032300, 0xee7701, 0xc00021ef30, 0x1cc, 0xc0004aa280)
        github.com/kurin/blazer/b2/backend.go:264 +0xbd
github.com/kurin/blazer/b2.(*Writer).simpleWriteFile(0xc0004cedc0, 0x0, 0x0)
        github.com/kurin/blazer/b2/writer.go:282 +0x430
github.com/kurin/blazer/b2.(*Writer).Close.func1()
        github.com/kurin/blazer/b2/writer.go:456 +0x1e1
sync.(*Once).Do(0xc0004cee54, 0xc0003934f8)
        /usr/lib/go-1.12/src/sync/once.go:44 +0xb3
github.com/kurin/blazer/b2.(*Writer).Close(0xc0004cedc0, 0xc0000365e8, 0x7f86cc4202d8)
        github.com/kurin/blazer/b2/writer.go:444 +0x57
github.com/restic/restic/internal/backend/b2.(*b2Backend).Save(0xc00058e400, 0xef3b20, 0xc0000b6070, 0xda2470, 0x3, 0xc0004e2740, 0x40, 0xef03a0, 0xc00006e230, 0x0, ...)
        github.com/restic/restic/internal/backend/b2/b2.go:211 +0x445
github.com/restic/restic/internal/repository.AddKey(0xef3b20, 0xc0000b6070, 0xc000393b08, 0xc0004c4040, 0x13, 0x0, 0xc00024d7d0, 0x4152c5, 0xc0004c6660)
        github.com/restic/restic/internal/repository/key.go:277 +0x5df
github.com/restic/restic/internal/repository.createMasterKey(...)
        github.com/restic/restic/internal/repository/key.go:61
github.com/restic/restic/internal/repository.(*Repository).init(0xc000393b08, 0xef3ae0, 0xc0000bdc80, 0xc0004c4040, 0x13, 0x1, 0xc0004e3640, 0x40, 0x2c726d35ece0d5, 0x0, ...)
        github.com/restic/restic/internal/repository/repository.go:612 +0x80
github.com/restic/restic/internal/repository.(*Repository).Init(0xc00024db08, 0xef3ae0, 0xc0000bdc80, 0xc0004c4040, 0x13, 0x0, 0x0)
        github.com/restic/restic/internal/repository/repository.go:606 +0x11d
main.runInit(0x7fff71ab20ee, 0x19, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
        github.com/restic/restic/cmd/restic/cmd_init.go:45 +0x41c
main.glob..func11(0x14f2200, 0xc0000ada80, 0x0, 0x2, 0x0, 0x0)
        github.com/restic/restic/cmd/restic/cmd_init.go:18 +0x91
github.com/spf13/cobra.(*Command).execute(0x14f2200, 0xc0000ada20, 0x2, 0x2, 0x14f2200, 0xc0000ada20)
        github.com/spf13/cobra/command.go:762 +0x465
github.com/spf13/cobra.(*Command).ExecuteC(0x14f1d40, 0x9, 0xc000342790, 0xc0000ad9a0)
        github.com/spf13/cobra/command.go:850 +0x2fc
github.com/spf13/cobra.(*Command).Execute(...)
        github.com/spf13/cobra/command.go:800
main.main()
        github.com/restic/restic/cmd/restic/main.go:86 +0xa0

goroutine 19 [syscall, 2 minutes]:
os/signal.signal_recv(0x0)
        /usr/lib/go-1.12/src/runtime/sigqueue.go:139 +0x9c
os/signal.loop()
        /usr/lib/go-1.12/src/os/signal/signal_unix.go:23 +0x22
created by os/signal.init.0
        /usr/lib/go-1.12/src/os/signal/signal_unix.go:29 +0x41

goroutine 20 [chan receive, 2 minutes]:
github.com/restic/restic/internal/restic.init.0.func1.1()
        github.com/restic/restic/internal/restic/lock.go:257 +0xb4
created by github.com/restic/restic/internal/restic.init.0.func1
        github.com/restic/restic/internal/restic/lock.go:254 +0x35

goroutine 34 [chan receive, 2 minutes]:
github.com/restic/restic/internal/restic.init.2.func1(0xc000098180)
        github.com/restic/restic/internal/restic/progress_unix.go:17 +0x64
created by github.com/restic/restic/internal/restic.init.2
        github.com/restic/restic/internal/restic/progress_unix.go:16 +0xab

goroutine 23 [select]:
go.opencensus.io/stats/view.(*worker).start(0xc0000c47d0)
        go.opencensus.io/stats/view/worker.go:154 +0x100
created by go.opencensus.io/stats/view.init.0
        go.opencensus.io/stats/view/worker.go:32 +0x57

goroutine 24 [chan receive, 2 minutes]:
main.CleanupHandler(0xc000098a20)
        github.com/restic/restic/cmd/restic/cleanup.go:62 +0x5d
created by main.init.0
        github.com/restic/restic/cmd/restic/cleanup.go:24 +0x67

goroutine 3553 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cd66cca8, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00001d318, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00001d300, 0xc0002ca800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00001d300, 0xc0002ca800, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc0001461d0, 0xc0002ca800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc0004922c0, 0xc0002ca800, 0x1585, 0x1585, 0x2, 0xa, 0xc0005af938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc002675ad8, 0xedea60, 0xc0004922c0, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc002675880, 0xedfdc0, 0xc0001461d0, 0x5, 0xc0001461d0, 0x203000)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc002675880, 0xde6e00, 0xc0026759b8, 0xc0005afb88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc002675880, 0xc0004f8000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc0000c9560, 0xc0004f8000, 0x1000, 0x1000, 0xc0005afc88, 0x406d45, 0xc00052de00)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc0002b66c0)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc0002b66c0, 0x1, 0x0, 0x0, 0x1, 0xc00003b900, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc0000c9560)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 87 [select]:
net/http.(*persistConn).writeLoop(0xc0001a05a0)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 86 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cd66cfe8, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00001c198, 0x72, 0x1600, 0x168a, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00001c180, 0xc0001c1000, 0x168a, 0x168a, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00001c180, 0xc0001c1000, 0x168a, 0x168a, 0x203000, 0x0, 0x35)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc000010008, 0xc0001c1000, 0x168a, 0x168a, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc0004fab40, 0xc0001c1000, 0x168a, 0x168a, 0x3, 0xa, 0xc000066938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc000369ad8, 0xedea60, 0xc0004fab40, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc000369880, 0xedfdc0, 0xc000010008, 0x5, 0xc000010008, 0x203000)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc000369880, 0xde6e00, 0xc0003699b8, 0xc000066b88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc000369880, 0xc0004ae000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc0001a05a0, 0xc0004ae000, 0x1000, 0x1000, 0xc000066c88, 0x406d45, 0xc000098f00)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc00012ee40)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc00012ee40, 0x1, 0x0, 0x0, 0x1, 0xc00052d100, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc0001a05a0)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3698 [select]:
net/http.(*persistConn).writeLoop(0xc0000c97a0)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3649 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cd66c558, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00058e798, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00058e780, 0xc002649000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00058e780, 0xc002649000, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc0000b80e8, 0xc002649000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc0004b01e0, 0xc002649000, 0x1585, 0x1585, 0x2, 0xa, 0xc00054a938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc000383ad8, 0xedea60, 0xc0004b01e0, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc000383880, 0xedfdc0, 0xc0000b80e8, 0x5, 0xc0000b80e8, 0x203000)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc000383880, 0xde6e00, 0xc0003839b8, 0xc00054ab88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc000383880, 0xc002712000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc0000c97a0, 0xc002712000, 0x1000, 0x1000, 0xc00054ac88, 0x406d45, 0xc00052c8a0)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc000081a40)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc000081a40, 0x1, 0x0, 0x0, 0x1, 0xc000099d00, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc0000c97a0)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3594 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cd66d0b8, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00057ad98, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00057ad80, 0xc000309000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00057ad80, 0xc000309000, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc0000b8208, 0xc000309000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc000276980, 0xc000309000, 0x1585, 0x1585, 0x2, 0xa, 0xc000537938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc000117758, 0xedea60, 0xc000276980, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc000117500, 0xedfdc0, 0xc0000b8208, 0x5, 0xc0000b8208, 0x203000)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc000117500, 0xde6e00, 0xc000117638, 0xc000537b88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc000117500, 0xc00268c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc0000c8900, 0xc00268c000, 0x1000, 0x1000, 0xc000537c88, 0x406d45, 0xc000098480)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc00012e180)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc00012e180, 0x1, 0x0, 0x0, 0x1, 0xc0026f0100, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc0000c8900)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3644 [select]:
net/http.(*persistConn).writeLoop(0xc000179320)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3710 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cc628eb0, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00058e518, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00058e500, 0xc000553000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00058e500, 0xc000553000, 0x1585, 0x1585, 0x203000, 0x7f86cd667a58, 0x80)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc000226048, 0xc000553000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc000487000, 0xc000553000, 0x1585, 0x1585, 0x40, 0xa, 0xc0001ae938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc00005d3d8, 0xedea60, 0xc000487000, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc00005d180, 0xedfdc0, 0xc000226048, 0x5, 0xc000226048, 0x203000)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc00005d180, 0xde6e00, 0xc00005d2b8, 0xc0001aeb88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc00005d180, 0xc0026c4000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc0000c86c0, 0xc0026c4000, 0x1000, 0x1000, 0xc0001aec88, 0x406d45, 0xc0000995c0)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc00053d9e0)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc00053d9e0, 0x1, 0x0, 0x0, 0x1, 0xc00003b100, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc0000c86c0)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3731 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cc628d10, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00057a418, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00057a400, 0xc0001be000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00057a400, 0xc0001be000, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc000226020, 0xc0001be000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc000276400, 0xc0001be000, 0x1585, 0x1585, 0x2, 0xa, 0xc000019938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc0003693d8, 0xedea60, 0xc000276400, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc000369180, 0xedfdc0, 0xc000226020, 0x5, 0xc000226020, 0x7f86d20c0b98)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc000369180, 0xde6e00, 0xc0003692b8, 0xc000019b88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc000369180, 0xc000572000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc0002b0000, 0xc000572000, 0x1000, 0x1000, 0xc000019c88, 0x406d45, 0xc00052c660)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc0001538c0)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc0001538c0, 0x1, 0x0, 0x0, 0x1, 0xc00052c500, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc0002b0000)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3684 [select]:
net/http.(*persistConn).writeLoop(0xc000179200)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3652 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cd66c2e8, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00058ea98, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00058ea80, 0xc0001bf800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00058ea80, 0xc0001bf800, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc0001461e8, 0xc0001bf800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc000492b80, 0xc0001bf800, 0x1585, 0x1585, 0x2, 0xa, 0xc000067938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc0026f93d8, 0xedea60, 0xc000492b80, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc0026f9180, 0xedfdc0, 0xc0001461e8, 0x5, 0xc0001461e8, 0x203000)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc0026f9180, 0xde6e00, 0xc0026f92b8, 0xc000067b88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc0026f9180, 0xc0005a1000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc0001a1440, 0xc0005a1000, 0x1000, 0x1000, 0xc000067c88, 0x406d45, 0xc00003be00)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc0002b7500)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc0002b7500, 0x1, 0x0, 0x0, 0x1, 0xc00003bd00, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc0001a1440)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3732 [select]:
net/http.(*persistConn).writeLoop(0xc0002b0000)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3622 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cd66cb08, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00001c998, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00001c980, 0xc000554800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00001c980, 0xc000554800, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc000010078, 0xc000554800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc0004601c0, 0xc000554800, 0x1585, 0x1585, 0x2, 0xa, 0xc0005a9938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc0026a9058, 0xedea60, 0xc0004601c0, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc0026a8e00, 0xedfdc0, 0xc000010078, 0x5, 0xc000010078, 0x203000)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc0026a8e00, 0xde6e00, 0xc0026a8f38, 0xc0005a9b88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc0026a8e00, 0xc0005b9000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc0000c9200, 0xc0005b9000, 0x1000, 0x1000, 0xc0005a9c88, 0x406d45, 0xc00012c720)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc000546300)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc000546300, 0x1, 0x0, 0x0, 0x1, 0xc00012c600, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc0000c9200)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3659 [select]:
net/http.(*persistConn).writeLoop(0xc0000c9680)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3643 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cd66c218, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00058e118, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00058e100, 0xc000551800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00058e100, 0xc000551800, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc0001461a0, 0xc000551800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc000458da0, 0xc000551800, 0x1585, 0x1585, 0x2, 0xa, 0xc00006c938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc0026a9e58, 0xedea60, 0xc000458da0, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc0026a9c00, 0xedfdc0, 0xc0001461a0, 0x5, 0xc0001461a0, 0x203000)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc0026a9c00, 0xde6e00, 0xc0026a9d38, 0xc00006cb88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc0026a9c00, 0xc0026c5000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc000179320, 0xc0026c5000, 0x1000, 0x1000, 0xc00006cc88, 0x406d45, 0xc0000993e0)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc0000803c0)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc0000803c0, 0x1, 0x0, 0x0, 0x1, 0xc000099300, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc000179320)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3550 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cd66c898, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00001c598, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00001c580, 0xc0002c7800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00001c580, 0xc0002c7800, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc000146188, 0xc0002c7800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc0000ade60, 0xc0002c7800, 0x1585, 0x1585, 0x2, 0xa, 0xc000535938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc002674cd8, 0xedea60, 0xc0000ade60, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc002674a80, 0xedfdc0, 0xc000146188, 0x5, 0xc000146188, 0x203000)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc002674a80, 0xde6e00, 0xc002674bb8, 0xc000535b88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc002674a80, 0xc000293000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc0000c90e0, 0xc000293000, 0x1000, 0x1000, 0xc000535c88, 0x406d45, 0xc00003b500)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc000081140)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc000081140, 0x1, 0x0, 0x0, 0x1, 0xc00003b400, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc0000c90e0)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3653 [select]:
net/http.(*persistConn).writeLoop(0xc0001a1440)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3623 [select]:
net/http.(*persistConn).writeLoop(0xc0000c9200)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3746 [select]:
net/http.(*persistConn).writeLoop(0xc0002b0480)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3701 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cd66cd78, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00057b098, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00057b080, 0xc00264a800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00057b080, 0xc00264a800, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc000226118, 0xc00264a800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc000276f60, 0xc00264a800, 0x1585, 0x1585, 0x2, 0xa, 0xc000534938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc0026f8258, 0xedea60, 0xc000276f60, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc0026f8000, 0xedfdc0, 0xc000226118, 0x5, 0xc000226118, 0x203000)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc0026f8000, 0xde6e00, 0xc0026f8138, 0xc000534b88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc0026f8000, 0xc0026f2000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc0002b07e0, 0xc0026f2000, 0x1000, 0x1000, 0xc000534c88, 0x406d45, 0xc0026f0900)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc00012ff20)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc00012ff20, 0x1, 0x0, 0x0, 0x1, 0xc0026f0700, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc0002b07e0)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3668 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cc628de0, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00057b418, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00057b400, 0xc0003aa800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00057b400, 0xc0003aa800, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc0000b8218, 0xc0003aa800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc000486280, 0xc0003aa800, 0x1585, 0x1585, 0x2, 0xa, 0xc000015938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc000369058, 0xedea60, 0xc000486280, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc000368e00, 0xedfdc0, 0xc0000b8218, 0x5, 0xc0000b8218, 0x7f86d20c2728)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc000368e00, 0xde6e00, 0xc000368f38, 0xc000015b88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc000368e00, 0xc0026d6000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc0002b0900, 0xc0026d6000, 0x1000, 0x1000, 0xc000015c88, 0x406d45, 0xc00052c000)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc0005306c0)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc0005306c0, 0x1, 0x0, 0x0, 0x1, 0xc000098300, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc0002b0900)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3711 [select]:
net/http.(*persistConn).writeLoop(0xc0000c86c0)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3661 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cd66c7c8, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00057a498, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00057a480, 0xc000550000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00057a480, 0xc000550000, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc000146000, 0xc000550000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc0004ef320, 0xc000550000, 0x1585, 0x1585, 0x2, 0xa, 0xc0005ab938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc0026a8258, 0xedea60, 0xc0004ef320, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc0026a8000, 0xedfdc0, 0xc000146000, 0x5, 0xc000146000, 0x203000)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc0026a8000, 0xde6e00, 0xc0026a8138, 0xc0005abb88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc0026a8000, 0xc002715000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc0002b0120, 0xc002715000, 0x1000, 0x1000, 0xc0005abc88, 0x406d45, 0xc00052c4e0)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc0002b7260)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc0002b7260, 0x1, 0x0, 0x0, 0x1, 0xc00003ad00, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc0002b0120)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3625 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cd66cf18, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00001ce98, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00001ce80, 0xc00030a800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00001ce80, 0xc00030a800, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc0000100a0, 0xc00030a800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc000458a40, 0xc00030a800, 0x1585, 0x1585, 0x2, 0xa, 0xc0001b4938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc0026a9758, 0xedea60, 0xc000458a40, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc0026a9500, 0xedfdc0, 0xc0000100a0, 0x5, 0xc0000100a0, 0x203000)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc0026a9500, 0xde6e00, 0xc0026a9638, 0xc0001b4b88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc0026a9500, 0xc00271a000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc0000c9440, 0xc00271a000, 0x1000, 0x1000, 0xc0001b4c88, 0x406d45, 0xc00052d740)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc000547380)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc000547380, 0x1, 0x0, 0x0, 0x1, 0xc00003ae00, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc0000c9440)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3705 [select]:
net/http.(*persistConn).writeLoop(0xc0002b0360)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3655 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cd66c488, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00058ee98, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00058ee80, 0xc0001c2800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00058ee80, 0xc0001c2800, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc0001461f8, 0xc0001c2800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc000492f60, 0xc0001c2800, 0x1585, 0x1585, 0x2, 0xa, 0xc00053b938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc0026f9ad8, 0xedea60, 0xc000492f60, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc0026f9880, 0xedfdc0, 0xc0001461f8, 0x5, 0xc0001461f8, 0x203000)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc0026f9880, 0xde6e00, 0xc0026f99b8, 0xc00053bb88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc0026f9880, 0xc002692000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc0001a1560, 0xc002692000, 0x1000, 0x1000, 0xc00053bc88, 0x406d45, 0xc00012db00)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc0026b0180)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc0026b0180, 0x1, 0x0, 0x0, 0x1, 0xc0026f0400, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc0001a1560)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3704 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cd66ce48, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00057a718, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00057a700, 0xc000520000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00057a700, 0xc000520000, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc000146010, 0xc000520000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc000486d60, 0xc000520000, 0x1585, 0x1585, 0x2, 0xa, 0xc00054c938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc0003833d8, 0xedea60, 0xc000486d60, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc000383180, 0xedfdc0, 0xc000146010, 0x5, 0xc000146010, 0x203000)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc000383180, 0xde6e00, 0xc0003832b8, 0xc00054cb88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc000383180, 0xc0026dc000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc0002b0360, 0xc0026dc000, 0x1000, 0x1000, 0xc00054cc88, 0x406d45, 0xc00003ac60)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc00053d3e0)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc00053d3e0, 0x1, 0x0, 0x0, 0x1, 0xc00003ab00, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc0002b0360)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3683 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cd66c6f8, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00001c698, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00001c680, 0xc000523000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00001c680, 0xc000523000, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc000226038, 0xc000523000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc0004b5420, 0xc000523000, 0x1585, 0x1585, 0x2, 0xa, 0xc000012938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc0026745d8, 0xedea60, 0xc0004b5420, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc002674380, 0xedfdc0, 0xc000226038, 0x5, 0xc000226038, 0x203000)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc002674380, 0xde6e00, 0xc0026744b8, 0xc000012b88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc002674380, 0xc0003af000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc000179200, 0xc0003af000, 0x1000, 0x1000, 0xc000012c88, 0x406d45, 0xc000099020)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc0002b79e0)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc0002b79e0, 0x1, 0x0, 0x0, 0x1, 0xc00003b300, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc000179200)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3595 [select]:
net/http.(*persistConn).writeLoop(0xc0000c8900)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3669 [select]:
net/http.(*persistConn).writeLoop(0xc0002b0900)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3694 [select]:
net/http.(*persistConn).writeLoop(0xc000179680)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3650 [select]:
net/http.(*persistConn).writeLoop(0xc0000c9560)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3656 [select]:
net/http.(*persistConn).writeLoop(0xc0001a1560)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3662 [select]:
net/http.(*persistConn).writeLoop(0xc0002b0120)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3713 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cd66ca38, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00057ac98, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00057ac80, 0xc000521800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00057ac80, 0xc000521800, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc000146108, 0xc000521800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc000487600, 0xc000521800, 0x1585, 0x1585, 0x2, 0xa, 0xc00006b938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc0026a8958, 0xedea60, 0xc000487600, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc0026a8700, 0xedfdc0, 0xc000146108, 0x5, 0xc000146108, 0x203000)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc0026a8700, 0xde6e00, 0xc0026a8838, 0xc00006bb88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc0026a8700, 0xc0003ae000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc0002b0480, 0xc0003ae000, 0x1000, 0x1000, 0xc00006bc88, 0x406d45, 0xc00052d0e0)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc0002b6c00)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc0002b6c00, 0x1, 0x0, 0x0, 0x1, 0xc00003b700, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc0002b0480)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3752 [select]:
net/http.(*persistConn).writeLoop(0xc0000c99e0)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3719 [select]:
net/http.(*persistConn).writeLoop(0xc0002b0240)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3693 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cd66c3b8, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00001cc18, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00001cc00, 0xc0002c9000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00001cc00, 0xc0002c9000, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc0000b80d0, 0xc0002c9000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc0004590e0, 0xc0002c9000, 0x1585, 0x1585, 0x2, 0xa, 0xc000017938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc000383758, 0xedea60, 0xc0004590e0, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc000383500, 0xedfdc0, 0xc0000b80d0, 0x5, 0xc0000b80d0, 0x203000)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc000383500, 0xde6e00, 0xc000383638, 0xc000017b88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc000383500, 0xc0026dd000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc000179680, 0xc0026dd000, 0x1000, 0x1000, 0xc000017c88, 0x406d45, 0xc002746540)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc0027265a0)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc0027265a0, 0x1, 0x0, 0x0, 0x1, 0xc002746400, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc000179680)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3751 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cc628f80, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00058e898, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00058e880, 0xc000306000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00058e880, 0xc000306000, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc0000b8180, 0xc000306000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc0004ee280, 0xc000306000, 0x1585, 0x1585, 0x2, 0xa, 0xc00054d938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc0026f8958, 0xedea60, 0xc0004ee280, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc0026f8700, 0xedfdc0, 0xc0000b8180, 0x5, 0xc0000b8180, 0x7f86cc41db08)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc0026f8700, 0xde6e00, 0xc0026f8838, 0xc00054db88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc0026f8700, 0xc0005c0000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc0000c99e0, 0xc0005c0000, 0x1000, 0x1000, 0xc00054dc88, 0x406d45, 0xc00052d9e0)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc0002b7320)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc0002b7320, 0x1, 0x0, 0x0, 0x1, 0xc00003bb00, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc0000c99e0)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3626 [select]:
net/http.(*persistConn).writeLoop(0xc0000c9440)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3551 [select]:
net/http.(*persistConn).writeLoop(0xc0000c90e0)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3702 [select]:
net/http.(*persistConn).writeLoop(0xc0002b07e0)
        /usr/lib/go-1.12/src/net/http/transport.go:1978 +0x113
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1360 +0xb0d

goroutine 3658 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cc629050, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00057ae18, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00057ae00, 0xc00029b800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00057ae00, 0xc00029b800, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc000010108, 0xc00029b800, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc000458360, 0xc00029b800, 0x1585, 0x1585, 0x2, 0xa, 0xc000280938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc000116958, 0xedea60, 0xc000458360, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc000116700, 0xedfdc0, 0xc000010108, 0x5, 0xc000010108, 0x7f86cd6668e8)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc000116700, 0xde6e00, 0xc000116838, 0xc000280b88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc000116700, 0xc0026ec000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc0000c9680, 0xc0026ec000, 0x1000, 0x1000, 0xc000280c88, 0x406d45, 0xc00003a780)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc0002b6420)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc0002b6420, 0x1, 0x0, 0x0, 0x1, 0xc00003a200, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc0000c9680)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

goroutine 3718 [IO wait]:
internal/poll.runtime_pollWait(0x7f86cd66c628, 0x72, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/runtime/netpoll.go:182 +0x56
internal/poll.(*pollDesc).wait(0xc00057ab18, 0x72, 0x1500, 0x1585, 0xffffffffffffffff)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:87 +0x9b
internal/poll.(*pollDesc).waitRead(...)
        /usr/lib/go-1.12/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00057ab00, 0xc0003a9000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/internal/poll/fd_unix.go:169 +0x19b
net.(*netFD).Read(0xc00057ab00, 0xc0003a9000, 0x1585, 0x1585, 0x203000, 0x0, 0x32)
        /usr/lib/go-1.12/src/net/fd_unix.go:202 +0x4f
net.(*conn).Read(0xc0002260d8, 0xc0003a9000, 0x1585, 0x1585, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/net/net.go:177 +0x69
crypto/tls.(*atLeastReader).Read(0xc0000add40, 0xc0003a9000, 0x1585, 0x1585, 0x2, 0xa, 0xc000281938)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:761 +0x60
bytes.(*Buffer).ReadFrom(0xc00008acd8, 0xedea60, 0xc0000add40, 0x40b735, 0xca32e0, 0xd77a20)
        /usr/lib/go-1.12/src/bytes/buffer.go:207 +0xbd
crypto/tls.(*Conn).readFromUntil(0xc00008aa80, 0xedfdc0, 0xc0002260d8, 0x5, 0xc0002260d8, 0x203000)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:783 +0xf8
crypto/tls.(*Conn).readRecordOrCCS(0xc00008aa80, 0xde6e00, 0xc00008abb8, 0xc000281b88)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:590 +0x125
crypto/tls.(*Conn).readRecord(...)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:558
crypto/tls.(*Conn).Read(0xc00008aa80, 0xc0026ea000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        /usr/lib/go-1.12/src/crypto/tls/conn.go:1236 +0x137
net/http.(*persistConn).Read(0xc0002b0240, 0xc0026ea000, 0x1000, 0x1000, 0xc000281c88, 0x406d45, 0xc0026f0000)
        /usr/lib/go-1.12/src/net/http/transport.go:1526 +0x7b
bufio.(*Reader).fill(0xc0005314a0)
        /usr/lib/go-1.12/src/bufio/bufio.go:100 +0x10f
bufio.(*Reader).Peek(0xc0005314a0, 0x1, 0x0, 0x0, 0x1, 0xc00052d000, 0x0)
        /usr/lib/go-1.12/src/bufio/bufio.go:138 +0x4f
net/http.(*persistConn).readLoop(0xc0002b0240)
        /usr/lib/go-1.12/src/net/http/transport.go:1679 +0x1a3
created by net/http.(*Transport).dialConn
        /usr/lib/go-1.12/src/net/http/transport.go:1359 +0xae8

rax    0xfffffffffffffffc
rbx    0x3b9a8416
rcx    0x45c8f3
rdx    0x0
rdi    0x1504020
rsi    0x80
rbp    0xc000185ee8
rsp    0xc000185ea0
r8     0x0
r9     0x0
r10    0xc000185ed8
r11    0x202
r12    0x1
r13    0x1
r14    0x2
r15    0x0
rip    0x45c8f3
rflags 0x202
cs     0x33
fs     0x0
gs     0x0

Steps to reproduce the behavior

From ubuntu 20.04.2: 1. Create B2 bucket on backblaze 2. Create application key with read/write access to bucket 3. Export application id and key to env variables 4. sudo apt install restic 5. optional: sudo restic self-update 6. restic -r b2:bucket-name init

Do you have any idea what may have caused this?

No, but I see similar issues:

Do you have an idea how to solve the issue?

No

Did restic help you today? Did it make you happy in any way?

Haven't used it yet, but I love the concept!

Asked Sep 27 '21 23:09
avatar campagnola
campagnola

6 Answer:

To differentiate a bit from #2172, my application key is restricted to a single bucket, but not a subfolder. Permissions configured via backblaze:

capabilities:
deleteFiles, listAllBucketNames, listBuckets, listFiles, readBucketEncryption, 
readBuckets, readFiles, shareFiles, writeBucketEncryption, writeFiles
1
Answered Jun 29 '21 at 23:28
avatar  of campagnola
campagnola

Hmm, restic seems to be stuck while trying to save the first file in the repository (look for github.com/restic/restic/internal/repository.createMasterKey in the stack trace).

For further investigation please try to initialize the repository using a debug version of restic. There's a short explanation at https://github.com/restic/restic/blob/master/CONTRIBUTING.md#reporting-bugs . Feel free to ask if you need more detailed instructions. The debug log should then contain a frequently repeated upload request. The interesting part would be how B2 responds. When posting the debug log, make sure to remove account credentials from the log output.

1
Answered Jul 03 '21 at 20:17
avatar  of MichaelEischer
MichaelEischer

Removed comment by @campagnola :

Debug log attached. I verified that createMasterKey appeared in the stack trace for this run as well.

[Edit by @MichaelEischer]Link to restic-debug.log removed[/Edit]

@campagnola I'm pretty sure that your debug logfile still included the B2 application key in one of the dumped http requests. I've removed your comment as I couldn't clear that comments history :-( . Please rotate that application key to make sure nobody will abuse it.

1
Answered Aug 04 '21 at 19:45
avatar  of MichaelEischer
MichaelEischer

The interesting snippets from the log files are the following:

2021/08/03 14:33:02 debug/round_tripper_debug.go:82 debug.loggingRoundTripper.RoundTrip 1   ------------  HTTP REQUEST -----------
GET /file/<bucket-name>/config HTTP/1.1
Host: f002.backblazeb2.com
User-Agent: blazer/0.5.3
Authorization: xxxxxxxxxxx
Range: bytes=0-0
X-Blazer-Method: b2_download_file_by_name
X-Blazer-Request-Id: 8


2021/08/03 14:33:02 debug/round_tripper_debug.go:95 debug.loggingRoundTripper.RoundTrip 1   ------------  HTTP RESPONSE ----------
HTTP/1.1 401 
Content-Length: 62
Cache-Control: max-age=0, no-cache, no-store
Content-Type: application/json;charset=utf-8
Date: Tue, 03 Aug 2021 21:33:01 GMT
2021/08/03 14:33:29 debug/round_tripper_debug.go:82 debug.loggingRoundTripper.RoundTrip 1   ------------  HTTP REQUEST -----------
POST /b2api/v1/b2_upload_file/9c8b25e8d0555c9f72ac0212/c002_v0001162_t0002 HTTP/1.1
Host: pod-000-1162-13.backblaze.com
User-Agent: blazer/0.5.3
Content-Length: 447
Authorization: xxxxxxxxxxx
Content-Type: application/octet-stream
X-Blazer-Method: b2_upload_file
X-Blazer-Request-Id: 190
X-Bz-Content-Sha1: 9e0571df444b4a6cd8f4a982b0c9e315591c96e0
X-Bz-File-Name: keys/bb91369d228ab2b73adfc445cb3c08fe2f2b0b72e5ec6184a70913b33d61d07f
Accept-Encoding: gzip


2021/08/03 14:33:30 debug/round_tripper_debug.go:95 debug.loggingRoundTripper.RoundTrip 1   ------------  HTTP RESPONSE ----------
HTTP/1.1 401 
Content-Length: 62
Cache-Control: max-age=0, no-cache, no-store
Content-Type: application/json;charset=utf-8
Date: Tue, 03 Aug 2021 21:33:29 GMT

The only request except b2_authorize_account that did not fail seems to be the initial bucket listing:

2021/08/03 14:33:01 debug/round_tripper_debug.go:82 debug.loggingRoundTripper.RoundTrip 1   ------------  HTTP REQUEST -----------
POST /b2api/v1/b2_list_buckets HTTP/1.1
Host: api002.backblazeb2.com
User-Agent: blazer/0.5.3
Content-Length: 66
Authorization: xxxxxxxxxxx
X-Blazer-Method: b2_list_buckets
X-Blazer-Request-Id: 2
Accept-Encoding: gzip


2021/08/03 14:33:01 debug/round_tripper_debug.go:95 debug.loggingRoundTripper.RoundTrip 1   ------------  HTTP RESPONSE ----------
HTTP/1.1 200 
Content-Length: 610
Cache-Control: max-age=0, no-cache, no-store
Content-Type: application/json;charset=UTF-8
Date: Tue, 03 Aug 2021 21:33:01 GMT

B2 seems to reply with status code 401 Unauthorized to every request. So there seems to be something wrong with the permissions of the application key. For the failing operations here readFiles and writeFiles permissions should be enough (other parts of restic still require additional permissions).

The fact that restic hangs is a problem in the error handling of the blazer B2 library which endlessly retries the failed request.

1
Answered Aug 04 '21 at 20:00
avatar  of MichaelEischer
MichaelEischer

Thanks @MichaelEischer, I don't see any application keys left in the debug log that I posted, but perhaps I'm not looking for the right thing. I appreciate the caution either way (and thanks for 3470 as well).

Given the 401 errors, I have created a new application key and the problem is gone. This new key has the same permissions as were listed above, so I'm not sure why this fixed the problem.

1
Answered Aug 05 '21 at 00:30
avatar  of campagnola
campagnola

@campagnola Look for the Authorization header in the b2_authorize_account calls. That one contains a base64 encoded version of the application key.

As the new application key works, it looks like something was wrong with the old one. Maybe a typo in the bucket name or the key was broken in some other way? Anyways, I think we can then close this issue?

1
Answered Aug 05 '21 at 18:51
avatar  of MichaelEischer
MichaelEischer