Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=3) [.....................................................X.X....] duration:
530.93821ms
FAIL (2025-12-03 03:08:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 530.957347ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
402.103125ms
FAIL (2025-12-03 03:08:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
ZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.080302860 (879h51m26.781247775s) [noise=true , address=145.79.227.31:4812 , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.080400042 (879h51m26.781344947s) [noise=true , address=77.90.31.13:4657 , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.080935558 (879h51m26.781880473s) [noise=true , address=77.90.31.14:4676 , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.081500607 (879h51m26.782445523s) [noise=true , address=145.79.227.18:4025 , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.082102287 (879h51m26.783047202s) [noise=true , address=45.91.116.5:4319 , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.082736237 (879h51m26.783681152s) [noise=true , address=77.90.31.19:4860 , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.083237186 (879h51m26.784182102s) [noise=true , address=45.91.116.9:4288 , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.083737716 (879h51m26.784682621s) [noise=true , address=45.91.116.6:4997 , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.084351898 (879h51m26.785296783s) [noise=true , address=45.91.116.14:4218 , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.084701986 (879h51m26.78564687s) [noise=true , address=145.79.227.15:4891 , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085026945 (879h51m26.78597183s) [noise=true , address=45.91.116.13:4165 , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085353417 (879h51m26.786298303s) [noise=true , address=77.90.31.15:4705 , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085650906 (879h51m26.786595801s) [noise=true , address=45.91.116.7:4039 , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085949286 (879h51m26.786894181s) [noise=true , address=77.90.31.11:4582 , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.086195117 (879h51m26.787140012s) [noise=true , address=45.91.116.11:4148 , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.086467669 (879h51m26.787412564s) [noise=true , address=64.49.13.154:4932 , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.164815383 (879h51m26.865760268s) [upload=774178]: Next returned nil segment
Dec 3 03:05:00.164840239 (879h51m26.865785125s) [upload=774178]: Waiting for error group managing segments...
Dec 3 03:05:00.174108452 (879h51m26.875053357s) [noise=true , address=77.90.31.15:4705 , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.174142326 (879h51m26.87508723s) [noise=true , address=45.91.116.13:4165 , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.175189781 (879h51m26.876134687s) [noise=true , address=77.90.31.12:4618 , piece_id=TUIE7COH6746VZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.178871150 (879h51m26.879816035s) [noise=true , address=145.79.227.18:4025 , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.182466616 (879h51m26.883411501s) [noise=true , address=45.91.116.11:4148 , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.184850901 (879h51m26.885795796s) [noise=true , address=45.91.116.14:4218 , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.186313426 (879h51m26.887258321s) [noise=true , address=45.91.116.7:4039 , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.187108287 (879h51m26.888053172s) [noise=true , address=45.91.116.6:4997 , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.188257253 (879h51m26.889202148s) [noise=true , address=45.91.116.9:4288 , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.191179818 (879h51m26.892124703s) [noise=true , address=77.90.31.18:4837 , piece_id=XQGP57SUAR7DNHY6UYF6TPCPN7MM6WMUX4WMJJCCF5BBBEJYIQ7A, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.193701038 (879h51m26.894645933s) [noise=true , address=45.91.116.5:4319 , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.194005079 (879h51m26.894949984s) [noise=true , address=145.79.227.31:4812 , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.199219063 (879h51m26.900163958s) [noise=true , address=77.90.31.13:4657 , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.208591191 (879h51m26.909536076s) [noise=true , address=77.90.31.11:4582 , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.208619464 (879h51m26.909564349s) [seg_pos={0 0}, upload=774178]: Segment reached optimal threshold of 14 pieces.
Dec 3 03:05:00.208754597 (879h51m26.909699482s) [noise=true , address=145.79.227.15:4891 , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Newezba9KBtr5PcBVDypYdAxRFdsMtVMUTMcPWLWPLziaJhyK): protocol: expected piece hash; context canceled; EOF
Dec 3 03:05:00.208763324 (879h51m26.909708209s) [noise=true , address=145.79.227.15:4891 , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208776869 (879h51m26.909721754s) [noise=true , address=77.90.31.19:4860 , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17ddUMj4ZejcjjWGzkGEM63vbCoEPnu7ePznzAPyzQofW8Q4gd): protocol: expected piece hash; context canceled; EOF
Dec 3 03:05:00.208784383 (879h51m26.909729268s) [noise=true , address=77.90.31.19:4860 , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208884902 (879h51m26.909829797s) [noise=true , address=77.90.31.14:4676 , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tpRh8Xvyxe72LDgR9rkUFx9qV88axb9DUYDhRnrzST2cQuHqC): protocol: expected piece hash; context canceled; EOF
Dec 3 03:05:00.208890072 (879h51m26.909834967s) [noise=true , address=77.90.31.14:4676 , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208952639 (879h51m26.909897524s) [noise=true , address=64.49.13.154:4932 , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UhZuvUKofduRzgCWi3WQcfZVuekxBJUXydn3H1ktQ7AmRRvcx): protocol: read tcp 5.161.89.252:62308->64.49.13.154:4932: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 3 03:05:00.208961976 (879h51m26.909906891s) [noise=true , address=64.49.13.154:4932 , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208979329 (879h51m26.909924214s) [seg_pos={0 0}, upload=774178]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 3 03:05:00.209054830 (879h51m26.909999705s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 3 03:05:00.209061283 (879h51m26.910006168s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 3 03:05:00.243054974 (879h51m26.943999869s) [upload=774178]: Done uploading segments...
Dec 3 03:05:00.243070513 (879h51m26.944015398s) [upload=774178]: Upload finished. err: <nil>
Duration: 402.131187ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
26.19449286s
FAIL (2025-12-03 03:08:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
ZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.080302860 (879h51m26.781247775s) [noise=true , address=145.79.227.31:4812 , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.080400042 (879h51m26.781344947s) [noise=true , address=77.90.31.13:4657 , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.080935558 (879h51m26.781880473s) [noise=true , address=77.90.31.14:4676 , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.081500607 (879h51m26.782445523s) [noise=true , address=145.79.227.18:4025 , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.082102287 (879h51m26.783047202s) [noise=true , address=45.91.116.5:4319 , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.082736237 (879h51m26.783681152s) [noise=true , address=77.90.31.19:4860 , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.083237186 (879h51m26.784182102s) [noise=true , address=45.91.116.9:4288 , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.083737716 (879h51m26.784682621s) [noise=true , address=45.91.116.6:4997 , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.084351898 (879h51m26.785296783s) [noise=true , address=45.91.116.14:4218 , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.084701986 (879h51m26.78564687s) [noise=true , address=145.79.227.15:4891 , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085026945 (879h51m26.78597183s) [noise=true , address=45.91.116.13:4165 , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085353417 (879h51m26.786298303s) [noise=true , address=77.90.31.15:4705 , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085650906 (879h51m26.786595801s) [noise=true , address=45.91.116.7:4039 , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085949286 (879h51m26.786894181s) [noise=true , address=77.90.31.11:4582 , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.086195117 (879h51m26.787140012s) [noise=true , address=45.91.116.11:4148 , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.086467669 (879h51m26.787412564s) [noise=true , address=64.49.13.154:4932 , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.164815383 (879h51m26.865760268s) [upload=774178]: Next returned nil segment
Dec 3 03:05:00.164840239 (879h51m26.865785125s) [upload=774178]: Waiting for error group managing segments...
Dec 3 03:05:00.174108452 (879h51m26.875053357s) [noise=true , address=77.90.31.15:4705 , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.174142326 (879h51m26.87508723s) [noise=true , address=45.91.116.13:4165 , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.175189781 (879h51m26.876134687s) [noise=true , address=77.90.31.12:4618 , piece_id=TUIE7COH6746VZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.178871150 (879h51m26.879816035s) [noise=true , address=145.79.227.18:4025 , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.182466616 (879h51m26.883411501s) [noise=true , address=45.91.116.11:4148 , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.184850901 (879h51m26.885795796s) [noise=true , address=45.91.116.14:4218 , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.186313426 (879h51m26.887258321s) [noise=true , address=45.91.116.7:4039 , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.187108287 (879h51m26.888053172s) [noise=true , address=45.91.116.6:4997 , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.188257253 (879h51m26.889202148s) [noise=true , address=45.91.116.9:4288 , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.191179818 (879h51m26.892124703s) [noise=true , address=77.90.31.18:4837 , piece_id=XQGP57SUAR7DNHY6UYF6TPCPN7MM6WMUX4WMJJCCF5BBBEJYIQ7A, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.193701038 (879h51m26.894645933s) [noise=true , address=45.91.116.5:4319 , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.194005079 (879h51m26.894949984s) [noise=true , address=145.79.227.31:4812 , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.199219063 (879h51m26.900163958s) [noise=true , address=77.90.31.13:4657 , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.208591191 (879h51m26.909536076s) [noise=true , address=77.90.31.11:4582 , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.208619464 (879h51m26.909564349s) [seg_pos={0 0}, upload=774178]: Segment reached optimal threshold of 14 pieces.
Dec 3 03:05:00.208754597 (879h51m26.909699482s) [noise=true , address=145.79.227.15:4891 , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Newezba9KBtr5PcBVDypYdAxRFdsMtVMUTMcPWLWPLziaJhyK): protocol: expected piece hash; context canceled; EOF
Dec 3 03:05:00.208763324 (879h51m26.909708209s) [noise=true , address=145.79.227.15:4891 , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208776869 (879h51m26.909721754s) [noise=true , address=77.90.31.19:4860 , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17ddUMj4ZejcjjWGzkGEM63vbCoEPnu7ePznzAPyzQofW8Q4gd): protocol: expected piece hash; context canceled; EOF
Dec 3 03:05:00.208784383 (879h51m26.909729268s) [noise=true , address=77.90.31.19:4860 , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208884902 (879h51m26.909829797s) [noise=true , address=77.90.31.14:4676 , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tpRh8Xvyxe72LDgR9rkUFx9qV88axb9DUYDhRnrzST2cQuHqC): protocol: expected piece hash; context canceled; EOF
Dec 3 03:05:00.208890072 (879h51m26.909834967s) [noise=true , address=77.90.31.14:4676 , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208952639 (879h51m26.909897524s) [noise=true , address=64.49.13.154:4932 , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UhZuvUKofduRzgCWi3WQcfZVuekxBJUXydn3H1ktQ7AmRRvcx): protocol: read tcp 5.161.89.252:62308->64.49.13.154:4932: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 3 03:05:00.208961976 (879h51m26.909906891s) [noise=true , address=64.49.13.154:4932 , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208979329 (879h51m26.909924214s) [seg_pos={0 0}, upload=774178]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 3 03:05:00.209054830 (879h51m26.909999705s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 3 03:05:00.209061283 (879h51m26.910006168s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 3 03:05:00.243054974 (879h51m26.943999869s) [upload=774178]: Done uploading segments...
Dec 3 03:05:00.243070513 (879h51m26.944015398s) [upload=774178]: Upload finished. err: <nil>
Duration: 26.19451369s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=3) [......................................................X.X...] duration:
485.390527ms
FAIL (2025-12-03 03:07:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 485.437625ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=3) [.......................................................X.X..] duration:
695.446289ms
FAIL (2025-12-03 03:06:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 695.465334ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
472.422721ms
FAIL (2025-12-03 03:06:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
ZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.080302860 (879h51m26.781247775s) [noise=true , address=145.79.227.31:4812 , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.080400042 (879h51m26.781344947s) [noise=true , address=77.90.31.13:4657 , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.080935558 (879h51m26.781880473s) [noise=true , address=77.90.31.14:4676 , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.081500607 (879h51m26.782445523s) [noise=true , address=145.79.227.18:4025 , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.082102287 (879h51m26.783047202s) [noise=true , address=45.91.116.5:4319 , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.082736237 (879h51m26.783681152s) [noise=true , address=77.90.31.19:4860 , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.083237186 (879h51m26.784182102s) [noise=true , address=45.91.116.9:4288 , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.083737716 (879h51m26.784682621s) [noise=true , address=45.91.116.6:4997 , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.084351898 (879h51m26.785296783s) [noise=true , address=45.91.116.14:4218 , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.084701986 (879h51m26.78564687s) [noise=true , address=145.79.227.15:4891 , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085026945 (879h51m26.78597183s) [noise=true , address=45.91.116.13:4165 , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085353417 (879h51m26.786298303s) [noise=true , address=77.90.31.15:4705 , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085650906 (879h51m26.786595801s) [noise=true , address=45.91.116.7:4039 , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085949286 (879h51m26.786894181s) [noise=true , address=77.90.31.11:4582 , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.086195117 (879h51m26.787140012s) [noise=true , address=45.91.116.11:4148 , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.086467669 (879h51m26.787412564s) [noise=true , address=64.49.13.154:4932 , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.164815383 (879h51m26.865760268s) [upload=774178]: Next returned nil segment
Dec 3 03:05:00.164840239 (879h51m26.865785125s) [upload=774178]: Waiting for error group managing segments...
Dec 3 03:05:00.174108452 (879h51m26.875053357s) [noise=true , address=77.90.31.15:4705 , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.174142326 (879h51m26.87508723s) [noise=true , address=45.91.116.13:4165 , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.175189781 (879h51m26.876134687s) [noise=true , address=77.90.31.12:4618 , piece_id=TUIE7COH6746VZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.178871150 (879h51m26.879816035s) [noise=true , address=145.79.227.18:4025 , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.182466616 (879h51m26.883411501s) [noise=true , address=45.91.116.11:4148 , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.184850901 (879h51m26.885795796s) [noise=true , address=45.91.116.14:4218 , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.186313426 (879h51m26.887258321s) [noise=true , address=45.91.116.7:4039 , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.187108287 (879h51m26.888053172s) [noise=true , address=45.91.116.6:4997 , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.188257253 (879h51m26.889202148s) [noise=true , address=45.91.116.9:4288 , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.191179818 (879h51m26.892124703s) [noise=true , address=77.90.31.18:4837 , piece_id=XQGP57SUAR7DNHY6UYF6TPCPN7MM6WMUX4WMJJCCF5BBBEJYIQ7A, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.193701038 (879h51m26.894645933s) [noise=true , address=45.91.116.5:4319 , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.194005079 (879h51m26.894949984s) [noise=true , address=145.79.227.31:4812 , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.199219063 (879h51m26.900163958s) [noise=true , address=77.90.31.13:4657 , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.208591191 (879h51m26.909536076s) [noise=true , address=77.90.31.11:4582 , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.208619464 (879h51m26.909564349s) [seg_pos={0 0}, upload=774178]: Segment reached optimal threshold of 14 pieces.
Dec 3 03:05:00.208754597 (879h51m26.909699482s) [noise=true , address=145.79.227.15:4891 , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Newezba9KBtr5PcBVDypYdAxRFdsMtVMUTMcPWLWPLziaJhyK): protocol: expected piece hash; context canceled; EOF
Dec 3 03:05:00.208763324 (879h51m26.909708209s) [noise=true , address=145.79.227.15:4891 , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208776869 (879h51m26.909721754s) [noise=true , address=77.90.31.19:4860 , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17ddUMj4ZejcjjWGzkGEM63vbCoEPnu7ePznzAPyzQofW8Q4gd): protocol: expected piece hash; context canceled; EOF
Dec 3 03:05:00.208784383 (879h51m26.909729268s) [noise=true , address=77.90.31.19:4860 , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208884902 (879h51m26.909829797s) [noise=true , address=77.90.31.14:4676 , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tpRh8Xvyxe72LDgR9rkUFx9qV88axb9DUYDhRnrzST2cQuHqC): protocol: expected piece hash; context canceled; EOF
Dec 3 03:05:00.208890072 (879h51m26.909834967s) [noise=true , address=77.90.31.14:4676 , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208952639 (879h51m26.909897524s) [noise=true , address=64.49.13.154:4932 , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UhZuvUKofduRzgCWi3WQcfZVuekxBJUXydn3H1ktQ7AmRRvcx): protocol: read tcp 5.161.89.252:62308->64.49.13.154:4932: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 3 03:05:00.208961976 (879h51m26.909906891s) [noise=true , address=64.49.13.154:4932 , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208979329 (879h51m26.909924214s) [seg_pos={0 0}, upload=774178]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 3 03:05:00.209054830 (879h51m26.909999705s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 3 03:05:00.209061283 (879h51m26.910006168s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 3 03:05:00.243054974 (879h51m26.943999869s) [upload=774178]: Done uploading segments...
Dec 3 03:05:00.243070513 (879h51m26.944015398s) [upload=774178]: Upload finished. err: <nil>
Duration: 472.447377ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
8.218613703s
FAIL (2025-12-03 03:06:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
ZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.080302860 (879h51m26.781247775s) [noise=true , address=145.79.227.31:4812 , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.080400042 (879h51m26.781344947s) [noise=true , address=77.90.31.13:4657 , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.080935558 (879h51m26.781880473s) [noise=true , address=77.90.31.14:4676 , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.081500607 (879h51m26.782445523s) [noise=true , address=145.79.227.18:4025 , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.082102287 (879h51m26.783047202s) [noise=true , address=45.91.116.5:4319 , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.082736237 (879h51m26.783681152s) [noise=true , address=77.90.31.19:4860 , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.083237186 (879h51m26.784182102s) [noise=true , address=45.91.116.9:4288 , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.083737716 (879h51m26.784682621s) [noise=true , address=45.91.116.6:4997 , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.084351898 (879h51m26.785296783s) [noise=true , address=45.91.116.14:4218 , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.084701986 (879h51m26.78564687s) [noise=true , address=145.79.227.15:4891 , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085026945 (879h51m26.78597183s) [noise=true , address=45.91.116.13:4165 , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085353417 (879h51m26.786298303s) [noise=true , address=77.90.31.15:4705 , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085650906 (879h51m26.786595801s) [noise=true , address=45.91.116.7:4039 , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085949286 (879h51m26.786894181s) [noise=true , address=77.90.31.11:4582 , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.086195117 (879h51m26.787140012s) [noise=true , address=45.91.116.11:4148 , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.086467669 (879h51m26.787412564s) [noise=true , address=64.49.13.154:4932 , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.164815383 (879h51m26.865760268s) [upload=774178]: Next returned nil segment
Dec 3 03:05:00.164840239 (879h51m26.865785125s) [upload=774178]: Waiting for error group managing segments...
Dec 3 03:05:00.174108452 (879h51m26.875053357s) [noise=true , address=77.90.31.15:4705 , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.174142326 (879h51m26.87508723s) [noise=true , address=45.91.116.13:4165 , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.175189781 (879h51m26.876134687s) [noise=true , address=77.90.31.12:4618 , piece_id=TUIE7COH6746VZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.178871150 (879h51m26.879816035s) [noise=true , address=145.79.227.18:4025 , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.182466616 (879h51m26.883411501s) [noise=true , address=45.91.116.11:4148 , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.184850901 (879h51m26.885795796s) [noise=true , address=45.91.116.14:4218 , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.186313426 (879h51m26.887258321s) [noise=true , address=45.91.116.7:4039 , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.187108287 (879h51m26.888053172s) [noise=true , address=45.91.116.6:4997 , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.188257253 (879h51m26.889202148s) [noise=true , address=45.91.116.9:4288 , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.191179818 (879h51m26.892124703s) [noise=true , address=77.90.31.18:4837 , piece_id=XQGP57SUAR7DNHY6UYF6TPCPN7MM6WMUX4WMJJCCF5BBBEJYIQ7A, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.193701038 (879h51m26.894645933s) [noise=true , address=45.91.116.5:4319 , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.194005079 (879h51m26.894949984s) [noise=true , address=145.79.227.31:4812 , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.199219063 (879h51m26.900163958s) [noise=true , address=77.90.31.13:4657 , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.208591191 (879h51m26.909536076s) [noise=true , address=77.90.31.11:4582 , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.208619464 (879h51m26.909564349s) [seg_pos={0 0}, upload=774178]: Segment reached optimal threshold of 14 pieces.
Dec 3 03:05:00.208754597 (879h51m26.909699482s) [noise=true , address=145.79.227.15:4891 , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Newezba9KBtr5PcBVDypYdAxRFdsMtVMUTMcPWLWPLziaJhyK): protocol: expected piece hash; context canceled; EOF
Dec 3 03:05:00.208763324 (879h51m26.909708209s) [noise=true , address=145.79.227.15:4891 , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208776869 (879h51m26.909721754s) [noise=true , address=77.90.31.19:4860 , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17ddUMj4ZejcjjWGzkGEM63vbCoEPnu7ePznzAPyzQofW8Q4gd): protocol: expected piece hash; context canceled; EOF
Dec 3 03:05:00.208784383 (879h51m26.909729268s) [noise=true , address=77.90.31.19:4860 , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208884902 (879h51m26.909829797s) [noise=true , address=77.90.31.14:4676 , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tpRh8Xvyxe72LDgR9rkUFx9qV88axb9DUYDhRnrzST2cQuHqC): protocol: expected piece hash; context canceled; EOF
Dec 3 03:05:00.208890072 (879h51m26.909834967s) [noise=true , address=77.90.31.14:4676 , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208952639 (879h51m26.909897524s) [noise=true , address=64.49.13.154:4932 , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UhZuvUKofduRzgCWi3WQcfZVuekxBJUXydn3H1ktQ7AmRRvcx): protocol: read tcp 5.161.89.252:62308->64.49.13.154:4932: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 3 03:05:00.208961976 (879h51m26.909906891s) [noise=true , address=64.49.13.154:4932 , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208979329 (879h51m26.909924214s) [seg_pos={0 0}, upload=774178]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 3 03:05:00.209054830 (879h51m26.909999705s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 3 03:05:00.209061283 (879h51m26.910006168s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 3 03:05:00.243054974 (879h51m26.943999869s) [upload=774178]: Done uploading segments...
Dec 3 03:05:00.243070513 (879h51m26.944015398s) [upload=774178]: Upload finished. err: <nil>
Duration: 8.21864371s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=3) [........................................................X.X.] duration:
662.859248ms
FAIL (2025-12-03 03:05:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 662.874016ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=3) [.........................................................X.X] duration:
5.001055358s
FAIL (2025-12-03 03:05:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001074264s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
12.316515601s
FAIL (2025-12-03 03:05:12 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
ZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.080302860 (879h51m26.781247775s) [noise=true , address=145.79.227.31:4812 , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.080400042 (879h51m26.781344947s) [noise=true , address=77.90.31.13:4657 , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.080935558 (879h51m26.781880473s) [noise=true , address=77.90.31.14:4676 , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.081500607 (879h51m26.782445523s) [noise=true , address=145.79.227.18:4025 , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.082102287 (879h51m26.783047202s) [noise=true , address=45.91.116.5:4319 , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.082736237 (879h51m26.783681152s) [noise=true , address=77.90.31.19:4860 , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.083237186 (879h51m26.784182102s) [noise=true , address=45.91.116.9:4288 , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.083737716 (879h51m26.784682621s) [noise=true , address=45.91.116.6:4997 , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.084351898 (879h51m26.785296783s) [noise=true , address=45.91.116.14:4218 , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.084701986 (879h51m26.78564687s) [noise=true , address=145.79.227.15:4891 , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085026945 (879h51m26.78597183s) [noise=true , address=45.91.116.13:4165 , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085353417 (879h51m26.786298303s) [noise=true , address=77.90.31.15:4705 , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085650906 (879h51m26.786595801s) [noise=true , address=45.91.116.7:4039 , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.085949286 (879h51m26.786894181s) [noise=true , address=77.90.31.11:4582 , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.086195117 (879h51m26.787140012s) [noise=true , address=45.91.116.11:4148 , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.086467669 (879h51m26.787412564s) [noise=true , address=64.49.13.154:4932 , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Uploading piece...
Dec 3 03:05:00.164815383 (879h51m26.865760268s) [upload=774178]: Next returned nil segment
Dec 3 03:05:00.164840239 (879h51m26.865785125s) [upload=774178]: Waiting for error group managing segments...
Dec 3 03:05:00.174108452 (879h51m26.875053357s) [noise=true , address=77.90.31.15:4705 , piece_id=3PAE3AI74Y2URW5FWQLHVWS3GHAZRNXS5QXVEPLYEWRIZPXVRWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.174142326 (879h51m26.87508723s) [noise=true , address=45.91.116.13:4165 , piece_id=H36AJQ6TM42ZWYJ5NQPSSIOC6XYWDCACCYIPPYBRAVYBZACCYIVA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.175189781 (879h51m26.876134687s) [noise=true , address=77.90.31.12:4618 , piece_id=TUIE7COH6746VZAEK5CH7A4CLFLSQZHE3FQLXGOUIAL6P2LJRNYQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.178871150 (879h51m26.879816035s) [noise=true , address=145.79.227.18:4025 , piece_id=7NACG5YCV33VISNW4JX6AHLMZHLI456NQY4EVO6YTQ32MHI46TTA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.182466616 (879h51m26.883411501s) [noise=true , address=45.91.116.11:4148 , piece_id=QE6B7FVHLWTJ6XJFXAKIGWAIZATSHPOW4CA4E5UPJBSDJAJSPSJA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.184850901 (879h51m26.885795796s) [noise=true , address=45.91.116.14:4218 , piece_id=KDXUEVSB4UCJQQD4QLHOXD3RLKS2KW237S44S43K7AHHC3KV6DQQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.186313426 (879h51m26.887258321s) [noise=true , address=45.91.116.7:4039 , piece_id=HXDSSB5O467DEMIMCXZ4OWGIV5OKB4TTDZSXSD7PZYWMYDYORVPA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.187108287 (879h51m26.888053172s) [noise=true , address=45.91.116.6:4997 , piece_id=XYO3QD6DOBNHMUYYUNO2VKRPL7OMCCIA4DNLOFOMGZDDZAQLYNDQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.188257253 (879h51m26.889202148s) [noise=true , address=45.91.116.9:4288 , piece_id=5PXKYPZY7PN2TU6IXOPASYSV7YOOX7AMVRELMFN25T2XSHPX2C7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.191179818 (879h51m26.892124703s) [noise=true , address=77.90.31.18:4837 , piece_id=XQGP57SUAR7DNHY6UYF6TPCPN7MM6WMUX4WMJJCCF5BBBEJYIQ7A, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.193701038 (879h51m26.894645933s) [noise=true , address=45.91.116.5:4319 , piece_id=7V3JWIGKHHVQRHBQ5VZFSHQ6ACAKRXLKRA7QPXXLDG2QSHP5ET7Q, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.194005079 (879h51m26.894949984s) [noise=true , address=145.79.227.31:4812 , piece_id=6XBCHYA3OQJU5HLGA6MXPCKRU53ZS3T7NMQUQIDEPEADZICY2CDA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.199219063 (879h51m26.900163958s) [noise=true , address=77.90.31.13:4657 , piece_id=XOOB4JBYVH64ZTWXC4WL53VHYV5H6D5VJSYY2EQZMMYZLBDESLBQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.208591191 (879h51m26.909536076s) [noise=true , address=77.90.31.11:4582 , piece_id=7NGIKVWARZJ32OLOHJNZ4L7XDV564CDJUWMWENT7XQM43BUHV4BA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: <nil>
Dec 3 03:05:00.208619464 (879h51m26.909564349s) [seg_pos={0 0}, upload=774178]: Segment reached optimal threshold of 14 pieces.
Dec 3 03:05:00.208754597 (879h51m26.909699482s) [noise=true , address=145.79.227.15:4891 , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Newezba9KBtr5PcBVDypYdAxRFdsMtVMUTMcPWLWPLziaJhyK): protocol: expected piece hash; context canceled; EOF
Dec 3 03:05:00.208763324 (879h51m26.909708209s) [noise=true , address=145.79.227.15:4891 , piece_id=FD4FK6VIVG22HXG7Y5B7TU2LPB3WG574TMW426N2WVQVJ3I433HQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208776869 (879h51m26.909721754s) [noise=true , address=77.90.31.19:4860 , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17ddUMj4ZejcjjWGzkGEM63vbCoEPnu7ePznzAPyzQofW8Q4gd): protocol: expected piece hash; context canceled; EOF
Dec 3 03:05:00.208784383 (879h51m26.909729268s) [noise=true , address=77.90.31.19:4860 , piece_id=K5STJFARBSLBH4SLDBF6FWBMS4TBLMNS6RLHQTETJVYPTG3RXWWQ, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208884902 (879h51m26.909829797s) [noise=true , address=77.90.31.14:4676 , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tpRh8Xvyxe72LDgR9rkUFx9qV88axb9DUYDhRnrzST2cQuHqC): protocol: expected piece hash; context canceled; EOF
Dec 3 03:05:00.208890072 (879h51m26.909834967s) [noise=true , address=77.90.31.14:4676 , piece_id=GJICEDQC4NRRCFYNRY7SK43DC4FLFFN2EPIMNH6EO4GTX4EYOTNA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208952639 (879h51m26.909897524s) [noise=true , address=64.49.13.154:4932 , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UhZuvUKofduRzgCWi3WQcfZVuekxBJUXydn3H1ktQ7AmRRvcx): protocol: read tcp 5.161.89.252:62308->64.49.13.154:4932: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 3 03:05:00.208961976 (879h51m26.909906891s) [noise=true , address=64.49.13.154:4932 , piece_id=SEFZ2SSUNFLGV6KXBFUANOHS4ESFEL7G67B4MWFF23O7V4SQ5IFA, seg_pos={0 0}, upload=774178]: Long tail cancellation due to optimal threshold
Dec 3 03:05:00.208979329 (879h51m26.909924214s) [seg_pos={0 0}, upload=774178]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 3 03:05:00.209054830 (879h51m26.909999705s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 3 03:05:00.209061283 (879h51m26.910006168s) [upload=774178]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 3 03:05:00.243054974 (879h51m26.943999869s) [upload=774178]: Done uploading segments...
Dec 3 03:05:00.243070513 (879h51m26.944015398s) [upload=774178]: Upload finished. err: <nil>
Duration: 12.316560275s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
724.821585ms
FAIL (2025-12-03 03:04:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 724.833687ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 3/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
5.000895149s
FAIL (2025-12-03 03:03:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000915166s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
27.11924ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-12-02 22:02:51 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 27.137294ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
19.439334ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-12-02 22:02:16 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 19.480711ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
23.71399ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-12-02 22:01:37 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 23.731354ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
199.781109ms
FAIL (2025-12-02 22:01:23 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 199.798262ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
18.655584ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-12-02 22:00:55 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 18.676713ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
191.029884ms
FAIL (2025-12-02 22:00:49 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 191.052476ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
27.853076ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-12-02 22:00:18 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 27.872984ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................] duration:
269.148104ms
FAIL (2025-12-02 22:00:12 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 269.169173ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
341.545451ms
FAIL (2025-12-02 21:59:54 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 341.668062ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
330.509191ms
FAIL (2025-12-02 21:59:32 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 330.519361ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................] duration:
176.983326ms
FAIL (2025-12-02 21:59:28 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 177.000117ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
23.602472ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-12-02 21:59:14 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 23.622019ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
31.992309ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-12-02 21:58:47 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 32.013939ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
372.65666ms
FAIL (2025-12-02 21:58:22 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 372.673782ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [...XX.......................................................] duration:
219.705863ms
FAIL (2025-12-02 21:58:14 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 219.72064ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
10.727152ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-12-02 21:58:04 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 10.74733ms
edge
linksharing
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
27.688076ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-12-02 21:57:59 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 27.704146ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
324.786809ms
FAIL (2025-12-02 21:57:24 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 324.902085ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
18.554504ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-12-02 21:57:23 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 18.572609ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
12.106598ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-12-02 21:57:13 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 12.136415ms
edge
linksharing
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [....XX......................................................] duration:
188.808397ms
FAIL (2025-12-02 21:57:10 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 188.827593ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
22.718665ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-12-02 21:57:01 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 22.741927ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
333.783462ms
FAIL (2025-12-02 21:56:32 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 333.813167ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
3.814516ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-12-02 21:56:31 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 3.832199ms
edge
linksharing
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration:
203.994982ms
FAIL (2025-12-02 21:56:07 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 204.011483ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
10.131203ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-12-02 21:56:06 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 10.148185ms
edge
linksharing
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
24.09174ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-12-02 21:55:59 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 24.110326ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
384.091937ms
FAIL (2025-12-02 21:55:39 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 384.112856ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
3.644607ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-12-02 21:55:34 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 3.669082ms
edge
linksharing
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
21.891462ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-12-02 21:55:17 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 21.950203ms
edge
linksharing
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [......XX....................................................] duration:
184.228887ms
FAIL (2025-12-02 21:55:17 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 184.25183ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
349.675634ms
FAIL (2025-12-02 21:55:12 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 349.693047ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
3.133887ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-12-02 21:55:01 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 3.154537ms
edge
linksharing
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
23.850158ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-12-02 21:54:56 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 23.903768ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
411.01614ms
FAIL (2025-12-02 21:54:33 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 411.041368ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
21.697511ms target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-12-02 21:54:27 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 21.716496ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......XX...................................................] duration:
197.77751ms
FAIL (2025-12-02 21:54:25 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 197.793149ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
21.546406ms target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-12-02 21:54:22 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 21.56492ms
edge
linksharing
us-select-1
|