Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X..........................X.........................] duration:
565.252561ms
FAIL (2025-08-17 17:29:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 565.275503ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
206.104959ms
FAIL (2025-08-17 17:29:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:19:01.051954194 (215h52m41.783221844s) [upload=224621]: Starting upload Aug 17 17:19:01.052034164 (215h52m41.783301814s) [upload=224621]: Done starting upload Aug 17 17:19:01.052129795 (215h52m41.783397444s) [upload=224621]: Uploading segments... Aug 17 17:19:01.052180960 (215h52m41.78344861s) [upload=224621]: Got next segment. Inline: true Aug 17 17:19:01.052186601 (215h52m41.783454261s) [upload=224621]: Waiting for error group managing segments... Aug 17 17:19:01.052229962 (215h52m41.783497613s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:19:01.052235393 (215h52m41.783503042s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:19:01.052238809 (215h52m41.783506459s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:19:01.123780830 (215h52m41.85504848s) [upload=224621]: Done uploading segments... Aug 17 17:19:01.123798303 (215h52m41.855065953s) [upload=224621]: Upload finished. err: metaclient: Too Many Requests
Duration: 206.119916ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
468.04919ms
FAIL (2025-08-17 17:29:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:19:01.051954194 (215h52m41.783221844s) [upload=224621]: Starting upload Aug 17 17:19:01.052034164 (215h52m41.783301814s) [upload=224621]: Done starting upload Aug 17 17:19:01.052129795 (215h52m41.783397444s) [upload=224621]: Uploading segments... Aug 17 17:19:01.052180960 (215h52m41.78344861s) [upload=224621]: Got next segment. Inline: true Aug 17 17:19:01.052186601 (215h52m41.783454261s) [upload=224621]: Waiting for error group managing segments... Aug 17 17:19:01.052229962 (215h52m41.783497613s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:19:01.052235393 (215h52m41.783503042s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:19:01.052238809 (215h52m41.783506459s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:19:01.123780830 (215h52m41.85504848s) [upload=224621]: Done uploading segments... Aug 17 17:19:01.123798303 (215h52m41.855065953s) [upload=224621]: Upload finished. err: metaclient: Too Many Requests
Duration: 468.071812ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
468.427983ms
FAIL (2025-08-17 17:28:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 468.451747ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X..........................X........................] duration:
810.406587ms
FAIL (2025-08-17 17:28:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 810.425382ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
472.870901ms
FAIL (2025-08-17 17:28:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 472.901328ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
507.462758ms
FAIL (2025-08-17 17:28:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:19:01.051954194 (215h52m41.783221844s) [upload=224621]: Starting upload Aug 17 17:19:01.052034164 (215h52m41.783301814s) [upload=224621]: Done starting upload Aug 17 17:19:01.052129795 (215h52m41.783397444s) [upload=224621]: Uploading segments... Aug 17 17:19:01.052180960 (215h52m41.78344861s) [upload=224621]: Got next segment. Inline: true Aug 17 17:19:01.052186601 (215h52m41.783454261s) [upload=224621]: Waiting for error group managing segments... Aug 17 17:19:01.052229962 (215h52m41.783497613s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:19:01.052235393 (215h52m41.783503042s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:19:01.052238809 (215h52m41.783506459s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:19:01.123780830 (215h52m41.85504848s) [upload=224621]: Done uploading segments... Aug 17 17:19:01.123798303 (215h52m41.855065953s) [upload=224621]: Upload finished. err: metaclient: Too Many Requests
Duration: 507.483337ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000540465s
FAIL (2025-08-17 17:27:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.000559912s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X..........................X.......................] duration:
621.779626ms
FAIL (2025-08-17 17:27:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 621.801416ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X..........................X......................] duration:
476.155291ms
FAIL (2025-08-17 17:27:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 476.174476ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X..........................X.....................] duration:
725.527672ms
FAIL (2025-08-17 17:26:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 725.557989ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
482.67522ms
FAIL (2025-08-17 17:26:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:19:01.051954194 (215h52m41.783221844s) [upload=224621]: Starting upload Aug 17 17:19:01.052034164 (215h52m41.783301814s) [upload=224621]: Done starting upload Aug 17 17:19:01.052129795 (215h52m41.783397444s) [upload=224621]: Uploading segments... Aug 17 17:19:01.052180960 (215h52m41.78344861s) [upload=224621]: Got next segment. Inline: true Aug 17 17:19:01.052186601 (215h52m41.783454261s) [upload=224621]: Waiting for error group managing segments... Aug 17 17:19:01.052229962 (215h52m41.783497613s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:19:01.052235393 (215h52m41.783503042s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:19:01.052238809 (215h52m41.783506459s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:19:01.123780830 (215h52m41.85504848s) [upload=224621]: Done uploading segments... Aug 17 17:19:01.123798303 (215h52m41.855065953s) [upload=224621]: Upload finished. err: metaclient: Too Many Requests
Duration: 482.704976ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X..........................X....................] duration:
713.128537ms
FAIL (2025-08-17 17:26:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 713.151289ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
147.68643ms
FAIL (2025-08-17 17:26:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:19:01.051954194 (215h52m41.783221844s) [upload=224621]: Starting upload Aug 17 17:19:01.052034164 (215h52m41.783301814s) [upload=224621]: Done starting upload Aug 17 17:19:01.052129795 (215h52m41.783397444s) [upload=224621]: Uploading segments... Aug 17 17:19:01.052180960 (215h52m41.78344861s) [upload=224621]: Got next segment. Inline: true Aug 17 17:19:01.052186601 (215h52m41.783454261s) [upload=224621]: Waiting for error group managing segments... Aug 17 17:19:01.052229962 (215h52m41.783497613s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:19:01.052235393 (215h52m41.783503042s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:19:01.052238809 (215h52m41.783506459s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:19:01.123780830 (215h52m41.85504848s) [upload=224621]: Done uploading segments... Aug 17 17:19:01.123798303 (215h52m41.855065953s) [upload=224621]: Upload finished. err: metaclient: Too Many Requests
Duration: 147.705705ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X..........................X...................] duration:
644.107266ms
FAIL (2025-08-17 17:25:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 644.132053ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
431.593666ms
FAIL (2025-08-17 17:24:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:19:01.051954194 (215h52m41.783221844s) [upload=224621]: Starting upload Aug 17 17:19:01.052034164 (215h52m41.783301814s) [upload=224621]: Done starting upload Aug 17 17:19:01.052129795 (215h52m41.783397444s) [upload=224621]: Uploading segments... Aug 17 17:19:01.052180960 (215h52m41.78344861s) [upload=224621]: Got next segment. Inline: true Aug 17 17:19:01.052186601 (215h52m41.783454261s) [upload=224621]: Waiting for error group managing segments... Aug 17 17:19:01.052229962 (215h52m41.783497613s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:19:01.052235393 (215h52m41.783503042s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:19:01.052238809 (215h52m41.783506459s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:19:01.123780830 (215h52m41.85504848s) [upload=224621]: Done uploading segments... Aug 17 17:19:01.123798303 (215h52m41.855065953s) [upload=224621]: Upload finished. err: metaclient: Too Many Requests
Duration: 431.612803ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X..........................X..................] duration:
760.101547ms
FAIL (2025-08-17 17:24:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 760.125272ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
257.314702ms
FAIL (2025-08-17 17:24:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:19:01.051954194 (215h52m41.783221844s) [upload=224621]: Starting upload Aug 17 17:19:01.052034164 (215h52m41.783301814s) [upload=224621]: Done starting upload Aug 17 17:19:01.052129795 (215h52m41.783397444s) [upload=224621]: Uploading segments... Aug 17 17:19:01.052180960 (215h52m41.78344861s) [upload=224621]: Got next segment. Inline: true Aug 17 17:19:01.052186601 (215h52m41.783454261s) [upload=224621]: Waiting for error group managing segments... Aug 17 17:19:01.052229962 (215h52m41.783497613s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:19:01.052235393 (215h52m41.783503042s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:19:01.052238809 (215h52m41.783506459s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:19:01.123780830 (215h52m41.85504848s) [upload=224621]: Done uploading segments... Aug 17 17:19:01.123798303 (215h52m41.855065953s) [upload=224621]: Upload finished. err: metaclient: Too Many Requests
Duration: 257.348044ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X..........................X.................] duration:
653.683816ms
FAIL (2025-08-17 17:24:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 653.724774ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
344.802374ms
FAIL (2025-08-17 17:24:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:19:01.051954194 (215h52m41.783221844s) [upload=224621]: Starting upload Aug 17 17:19:01.052034164 (215h52m41.783301814s) [upload=224621]: Done starting upload Aug 17 17:19:01.052129795 (215h52m41.783397444s) [upload=224621]: Uploading segments... Aug 17 17:19:01.052180960 (215h52m41.78344861s) [upload=224621]: Got next segment. Inline: true Aug 17 17:19:01.052186601 (215h52m41.783454261s) [upload=224621]: Waiting for error group managing segments... Aug 17 17:19:01.052229962 (215h52m41.783497613s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:19:01.052235393 (215h52m41.783503042s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:19:01.052238809 (215h52m41.783506459s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:19:01.123780830 (215h52m41.85504848s) [upload=224621]: Done uploading segments... Aug 17 17:19:01.123798303 (215h52m41.855065953s) [upload=224621]: Upload finished. err: metaclient: Too Many Requests
Duration: 344.828604ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X..........................X................] duration:
999.030521ms
FAIL (2025-08-17 17:23:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 999.053254ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
161.874677ms
FAIL (2025-08-17 17:23:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:19:01.051954194 (215h52m41.783221844s) [upload=224621]: Starting upload Aug 17 17:19:01.052034164 (215h52m41.783301814s) [upload=224621]: Done starting upload Aug 17 17:19:01.052129795 (215h52m41.783397444s) [upload=224621]: Uploading segments... Aug 17 17:19:01.052180960 (215h52m41.78344861s) [upload=224621]: Got next segment. Inline: true Aug 17 17:19:01.052186601 (215h52m41.783454261s) [upload=224621]: Waiting for error group managing segments... Aug 17 17:19:01.052229962 (215h52m41.783497613s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:19:01.052235393 (215h52m41.783503042s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:19:01.052238809 (215h52m41.783506459s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:19:01.123780830 (215h52m41.85504848s) [upload=224621]: Done uploading segments... Aug 17 17:19:01.123798303 (215h52m41.855065953s) [upload=224621]: Upload finished. err: metaclient: Too Many Requests
Duration: 161.896218ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
529.679833ms
FAIL (2025-08-17 17:22:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:19:01.051954194 (215h52m41.783221844s) [upload=224621]: Starting upload Aug 17 17:19:01.052034164 (215h52m41.783301814s) [upload=224621]: Done starting upload Aug 17 17:19:01.052129795 (215h52m41.783397444s) [upload=224621]: Uploading segments... Aug 17 17:19:01.052180960 (215h52m41.78344861s) [upload=224621]: Got next segment. Inline: true Aug 17 17:19:01.052186601 (215h52m41.783454261s) [upload=224621]: Waiting for error group managing segments... Aug 17 17:19:01.052229962 (215h52m41.783497613s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:19:01.052235393 (215h52m41.783503042s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:19:01.052238809 (215h52m41.783506459s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:19:01.123780830 (215h52m41.85504848s) [upload=224621]: Done uploading segments... Aug 17 17:19:01.123798303 (215h52m41.855065953s) [upload=224621]: Upload finished. err: metaclient: Too Many Requests
Duration: 529.701272ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X..........................X...............] duration:
830.932991ms
FAIL (2025-08-17 17:22:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 830.957788ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
177.919363ms
FAIL (2025-08-17 17:21:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:19:01.051954194 (215h52m41.783221844s) [upload=224621]: Starting upload Aug 17 17:19:01.052034164 (215h52m41.783301814s) [upload=224621]: Done starting upload Aug 17 17:19:01.052129795 (215h52m41.783397444s) [upload=224621]: Uploading segments... Aug 17 17:19:01.052180960 (215h52m41.78344861s) [upload=224621]: Got next segment. Inline: true Aug 17 17:19:01.052186601 (215h52m41.783454261s) [upload=224621]: Waiting for error group managing segments... Aug 17 17:19:01.052229962 (215h52m41.783497613s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:19:01.052235393 (215h52m41.783503042s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:19:01.052238809 (215h52m41.783506459s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:19:01.123780830 (215h52m41.85504848s) [upload=224621]: Done uploading segments... Aug 17 17:19:01.123798303 (215h52m41.855065953s) [upload=224621]: Upload finished. err: metaclient: Too Many Requests
Duration: 177.941665ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
547.700092ms
FAIL (2025-08-17 17:21:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:19:01.051954194 (215h52m41.783221844s) [upload=224621]: Starting upload Aug 17 17:19:01.052034164 (215h52m41.783301814s) [upload=224621]: Done starting upload Aug 17 17:19:01.052129795 (215h52m41.783397444s) [upload=224621]: Uploading segments... Aug 17 17:19:01.052180960 (215h52m41.78344861s) [upload=224621]: Got next segment. Inline: true Aug 17 17:19:01.052186601 (215h52m41.783454261s) [upload=224621]: Waiting for error group managing segments... Aug 17 17:19:01.052229962 (215h52m41.783497613s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:19:01.052235393 (215h52m41.783503042s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:19:01.052238809 (215h52m41.783506459s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:19:01.123780830 (215h52m41.85504848s) [upload=224621]: Done uploading segments... Aug 17 17:19:01.123798303 (215h52m41.855065953s) [upload=224621]: Upload finished. err: metaclient: Too Many Requests
Duration: 547.722544ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X..........................X..............] duration:
512.441322ms
FAIL (2025-08-17 17:21:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 512.458494ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X..........................X.............] duration:
639.272269ms
FAIL (2025-08-17 17:20:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 639.29936ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
245.108017ms
FAIL (2025-08-17 17:20:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:19:01.051954194 (215h52m41.783221844s) [upload=224621]: Starting upload Aug 17 17:19:01.052034164 (215h52m41.783301814s) [upload=224621]: Done starting upload Aug 17 17:19:01.052129795 (215h52m41.783397444s) [upload=224621]: Uploading segments... Aug 17 17:19:01.052180960 (215h52m41.78344861s) [upload=224621]: Got next segment. Inline: true Aug 17 17:19:01.052186601 (215h52m41.783454261s) [upload=224621]: Waiting for error group managing segments... Aug 17 17:19:01.052229962 (215h52m41.783497613s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:19:01.052235393 (215h52m41.783503042s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:19:01.052238809 (215h52m41.783506459s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:19:01.123780830 (215h52m41.85504848s) [upload=224621]: Done uploading segments... Aug 17 17:19:01.123798303 (215h52m41.855065953s) [upload=224621]: Upload finished. err: metaclient: Too Many Requests
Duration: 245.216021ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
143.686035ms
FAIL (2025-08-17 17:19:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:19:01.051954194 (215h52m41.783221844s) [upload=224621]: Starting upload Aug 17 17:19:01.052034164 (215h52m41.783301814s) [upload=224621]: Done starting upload Aug 17 17:19:01.052129795 (215h52m41.783397444s) [upload=224621]: Uploading segments... Aug 17 17:19:01.052180960 (215h52m41.78344861s) [upload=224621]: Got next segment. Inline: true Aug 17 17:19:01.052186601 (215h52m41.783454261s) [upload=224621]: Waiting for error group managing segments... Aug 17 17:19:01.052229962 (215h52m41.783497613s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:19:01.052235393 (215h52m41.783503042s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:19:01.052238809 (215h52m41.783506459s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:19:01.123780830 (215h52m41.85504848s) [upload=224621]: Done uploading segments... Aug 17 17:19:01.123798303 (215h52m41.855065953s) [upload=224621]: Upload finished. err: metaclient: Too Many Requests
Duration: 143.704117ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X..........................X............] duration:
637.074768ms
FAIL (2025-08-17 17:19:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 637.103954ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
89.027716ms
FAIL (2025-08-17 17:19:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 17:19:01.051954194 (215h52m41.783221844s) [upload=224621]: Starting upload Aug 17 17:19:01.052034164 (215h52m41.783301814s) [upload=224621]: Done starting upload Aug 17 17:19:01.052129795 (215h52m41.783397444s) [upload=224621]: Uploading segments... Aug 17 17:19:01.052180960 (215h52m41.78344861s) [upload=224621]: Got next segment. Inline: true Aug 17 17:19:01.052186601 (215h52m41.783454261s) [upload=224621]: Waiting for error group managing segments... Aug 17 17:19:01.052229962 (215h52m41.783497613s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 17:19:01.052235393 (215h52m41.783503042s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 17:19:01.052238809 (215h52m41.783506459s) [upload=224621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 17:19:01.123780830 (215h52m41.85504848s) [upload=224621]: Done uploading segments... Aug 17 17:19:01.123798303 (215h52m41.855065953s) [upload=224621]: Upload finished. err: metaclient: Too Many Requests
Duration: 89.050098ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X..........................X...........] duration:
535.583664ms
FAIL (2025-08-17 17:18:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 535.608762ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X..........................X..........] duration:
598.076254ms
FAIL (2025-08-17 17:17:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 598.095761ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X..........................X.........] duration:
538.930725ms
FAIL (2025-08-17 17:16:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 538.976581ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X..........................X........] duration:
660.610521ms
FAIL (2025-08-17 17:16:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 660.637282ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X..........................X.......] duration:
707.99953ms
FAIL (2025-08-17 17:15:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 708.032493ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X..........................X......] duration:
649.559948ms
FAIL (2025-08-17 17:14:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 649.587901ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X..........................X.....] duration:
920.657596ms
FAIL (2025-08-17 17:14:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 920.68094ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X..........................X....] duration:
868.180347ms
FAIL (2025-08-17 17:13:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 868.205785ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X..........................X...] duration:
539.923881ms
FAIL (2025-08-17 17:12:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 539.947256ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X..........................X..] duration:
601.902813ms
FAIL (2025-08-17 17:11:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 601.922991ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X..........................X.] duration:
846.52584ms
FAIL (2025-08-17 17:11:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 846.54728ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X..........................X] duration:
389.183973ms
FAIL (2025-08-17 17:10:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 17:10:36.736024018 (215h44m17.467291638s) [upload=224466]: Starting upload
Aug 17 17:10:36.736053334 (215h44m17.467320964s) [upload=224466]: Done starting upload
Aug 17 17:10:36.736278267 (215h44m17.467545897s) [upload=224466]: Uploading segments...
Aug 17 17:10:36.736305127 (215h44m17.467572747s) [upload=224466]: Got next segment. Inline: false
Aug 17 17:10:36.736324683 (215h44m17.467592304s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 17:10:36.736328230 (215h44m17.46759586s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 17:10:36.764212012 (215h44m17.495479642s) [seg_pos={0 0}, upload=224466]: Begin upload segment...
Aug 17 17:10:36.764233994 (215h44m17.495501613s) [seg_pos={0 0}, upload=224466]: Done begin upload segment.
Aug 17 17:10:36.764250654 (215h44m17.495518284s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764348508 (215h44m17.495616128s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764552883 (215h44m17.495820513s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764832297 (215h44m17.496099918s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.764845943 (215h44m17.496113573s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765080853 (215h44m17.496348483s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765313040 (215h44m17.49658066s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765324832 (215h44m17.496592462s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765570123 (215h44m17.496837753s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765688776 (215h44m17.496956406s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.765839700 (215h44m17.49710733s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766077938 (215h44m17.497345568s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766234151 (215h44m17.497501781s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766305195 (215h44m17.497572815s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.766692773 (215h44m17.497960393s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.768238006 (215h44m17.499505636s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.770704380 (215h44m17.50197201s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.771034701 (215h44m17.502302331s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Uploading piece...
Aug 17 17:10:36.835770955 (215h44m17.567038575s) [upload=224466]: Next returned nil segment
Aug 17 17:10:36.835792005 (215h44m17.567059615s) [upload=224466]: Waiting for error group managing segments...
Aug 17 17:10:36.844845897 (215h44m17.576113516s) [noise=true , address=45.91.116.10:4098 , piece_id=NPDWTZNRAVIFCDGB4SDXNU7NGH3OWUKQOAYAJGHEKYZ4EXHVUDUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.865627683 (215h44m17.596895303s) [noise=true , address=45.91.116.9:4264 , piece_id=DDQWFI6GTPXJO3HB5UGHSJFTHWGLUCUQZVZIFYW5UEYTS6NHRPKQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.869301155 (215h44m17.600568775s) [noise=true , address=77.90.31.15:4705 , piece_id=7VYCQF2S3XZGR6OCWPLBOT4MYYQWTUQLIPM6EZP63WPTCQI2GY7A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.883594371 (215h44m17.614861991s) [noise=true , address=45.91.116.11:4147 , piece_id=MRDRPBOAF6PEOFZXLXEW2S6CTAJUY26N3EHSQA6XT2YL5VDMFV4A, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.884240355 (215h44m17.615507985s) [noise=true , address=104.36.82.20:4451 , piece_id=NF4EBLMGZZ6OL3JX7MK2LJBU5RZCBX5Q42ST2XCUTNBW7IRQ7JZQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.889457137 (215h44m17.620724767s) [noise=true , address=104.36.82.58:4287 , piece_id=6H66FDNFGIZHIP5D7IKZZMFNPSJPMYPV56KWPCLUCXUSL3HV7QPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.896778182 (215h44m17.628045812s) [noise=true , address=104.36.82.23:4469 , piece_id=STLCPDGV7R5LGUVGKOLV47CIUSCHRUBXGKLTV5TERJYKH4G5DGUQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.912526090 (215h44m17.643793721s) [noise=true , address=45.91.116.6:4007 , piece_id=76VXIISGTSF2JO2GWHPYYR427456WPSXJAHJEYSNTMMM2FC7S4DQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.921311498 (215h44m17.652579118s) [noise=true , address=104.36.82.11:4128 , piece_id=VEFBJ7XB3WZDLTQ2FBVH7H2J4DQSO4XPKMUPOHHF3DUYBJOWY5RQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.932604948 (215h44m17.663872578s) [noise=true , address=104.36.82.38:4709 , piece_id=ZMSWCVPWZPP7E3NK76EJW3AKYSOYSXI4H4ZUNKR5I5CVVDDGSJRA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.940245825 (215h44m17.671513474s) [noise=true , address=104.36.82.15:4267 , piece_id=3SX4CBJFYF5ECBEUXC72UHNZNDU4KETE5YRFW5HV2KJVKSNFFGNA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.967670051 (215h44m17.698937681s) [noise=true , address=104.36.82.4:4830 , piece_id=TTHEDXVCFZCP2LS6NK5UPVRZART2NUO7DNH2YGRRUAC2SKHQWGPA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:36.998475643 (215h44m17.729743263s) [noise=true , address=104.36.82.59:4333 , piece_id=KY7A7Z52HZLK3BOLLT4LAFGTSD32XUTHMUEB6VWHXVJP4BQJDTHA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011502039 (215h44m17.742769659s) [noise=true , address=104.36.82.61:4385 , piece_id=EEAX7TA5DXWNHJP2CS6E3UD6R232A5DNVHDC64YTHIZLHJMXW3OA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: <nil>
Aug 17 17:10:37.011529370 (215h44m17.742797s) [seg_pos={0 0}, upload=224466]: Segment reached optimal threshold of 14 pieces.
Aug 17 17:10:37.011634136 (215h44m17.742901756s) [noise=true , address=77.90.31.19:4855 , piece_id=FRIVZHYQI4FBI3PF536T6WNEBGZPE65YJTAGTS263V7EFK3AGMPQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011812212 (215h44m17.743079861s) [noise=true , address=104.36.82.2:4745 , piece_id=3YKYPUKPCA6ORTV2NPWIWGSCXKV7VV66XET5GPBL7HBLBKP64IHQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1H9sLaFPDPZxKvwXho76wrqPiFe9yu87Ue9BT4ip92qfLmjbnF): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.011843510 (215h44m17.74311113s) [noise=true , address=77.90.31.18:4812 , piece_id=7MXQQKV2RGREU5PX2QLEIYT6VCN6EZX3SCJSGFT2AYV6QTDHIVDQ, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn): protocol: rpc: dial tcp 77.90.31.18:4812: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 17:10:37.011992320 (215h44m17.74325997s) [noise=true , address=104.36.82.13:4220 , piece_id=CZFOP6FSPW53DHTPNW62KCC46K726Q6YOWW3FBUB4EAWPJZF4YFA, seg_pos={0 0}, upload=224466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 17 17:10:37.012026795 (215h44m17.743294445s) [seg_pos={0 0}, upload=224466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 17:10:37.012163331 (215h44m17.743430991s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 17:10:37.012170013 (215h44m17.743437663s) [upload=224466]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 17:10:37.069232999 (215h44m17.80050065s) [upload=224466]: Done uploading segments...
Aug 17 17:10:37.069250773 (215h44m17.800518422s) [upload=224466]: Upload finished. err: <nil>
Duration: 389.200074ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
491.638999ms
FAIL (2025-08-17 17:09:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:51:01.489236530 (215h24m42.22050415s) [upload=224113]: Starting upload Aug 17 16:51:01.489287255 (215h24m42.220554885s) [upload=224113]: Done starting upload Aug 17 16:51:01.489480899 (215h24m42.220748549s) [upload=224113]: Uploading segments... Aug 17 16:51:01.489563053 (215h24m42.220830713s) [upload=224113]: Got next segment. Inline: false Aug 17 16:51:01.489605593 (215h24m42.220873243s) [upload=224113]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:51:01.489611163 (215h24m42.220878814s) [upload=224113]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 16:51:01.492764137 (215h24m42.224031788s) [upload=224113]: Next segment err: metaclient: Too Many Requests Aug 17 16:51:01.492796739 (215h24m42.224064389s) [upload=224113]: Done uploading segments... Aug 17 16:51:01.492814773 (215h24m42.224082422s) [upload=224113]: Upload finished. err: metaclient: Too Many Requests
Duration: 491.660228ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
787.802715ms
FAIL (2025-08-17 17:08:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:51:01.489236530 (215h24m42.22050415s) [upload=224113]: Starting upload Aug 17 16:51:01.489287255 (215h24m42.220554885s) [upload=224113]: Done starting upload Aug 17 16:51:01.489480899 (215h24m42.220748549s) [upload=224113]: Uploading segments... Aug 17 16:51:01.489563053 (215h24m42.220830713s) [upload=224113]: Got next segment. Inline: false Aug 17 16:51:01.489605593 (215h24m42.220873243s) [upload=224113]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:51:01.489611163 (215h24m42.220878814s) [upload=224113]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 16:51:01.492764137 (215h24m42.224031788s) [upload=224113]: Next segment err: metaclient: Too Many Requests Aug 17 16:51:01.492796739 (215h24m42.224064389s) [upload=224113]: Done uploading segments... Aug 17 16:51:01.492814773 (215h24m42.224082422s) [upload=224113]: Upload finished. err: metaclient: Too Many Requests
Duration: 787.829706ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
542.351294ms
FAIL (2025-08-17 17:08:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:51:01.489236530 (215h24m42.22050415s) [upload=224113]: Starting upload Aug 17 16:51:01.489287255 (215h24m42.220554885s) [upload=224113]: Done starting upload Aug 17 16:51:01.489480899 (215h24m42.220748549s) [upload=224113]: Uploading segments... Aug 17 16:51:01.489563053 (215h24m42.220830713s) [upload=224113]: Got next segment. Inline: false Aug 17 16:51:01.489605593 (215h24m42.220873243s) [upload=224113]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:51:01.489611163 (215h24m42.220878814s) [upload=224113]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 16:51:01.492764137 (215h24m42.224031788s) [upload=224113]: Next segment err: metaclient: Too Many Requests Aug 17 16:51:01.492796739 (215h24m42.224064389s) [upload=224113]: Done uploading segments... Aug 17 16:51:01.492814773 (215h24m42.224082422s) [upload=224113]: Upload finished. err: metaclient: Too Many Requests
Duration: 542.390496ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
593.82139ms
FAIL (2025-08-17 17:07:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:51:01.489236530 (215h24m42.22050415s) [upload=224113]: Starting upload Aug 17 16:51:01.489287255 (215h24m42.220554885s) [upload=224113]: Done starting upload Aug 17 16:51:01.489480899 (215h24m42.220748549s) [upload=224113]: Uploading segments... Aug 17 16:51:01.489563053 (215h24m42.220830713s) [upload=224113]: Got next segment. Inline: false Aug 17 16:51:01.489605593 (215h24m42.220873243s) [upload=224113]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:51:01.489611163 (215h24m42.220878814s) [upload=224113]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 16:51:01.492764137 (215h24m42.224031788s) [upload=224113]: Next segment err: metaclient: Too Many Requests Aug 17 16:51:01.492796739 (215h24m42.224064389s) [upload=224113]: Done uploading segments... Aug 17 16:51:01.492814773 (215h24m42.224082422s) [upload=224113]: Upload finished. err: metaclient: Too Many Requests
Duration: 593.848129ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X....................................X......................] duration:
1.206464824s
FAIL (2025-08-17 17:06:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:51:01.489236530 (215h24m42.22050415s) [upload=224113]: Starting upload Aug 17 16:51:01.489287255 (215h24m42.220554885s) [upload=224113]: Done starting upload Aug 17 16:51:01.489480899 (215h24m42.220748549s) [upload=224113]: Uploading segments... Aug 17 16:51:01.489563053 (215h24m42.220830713s) [upload=224113]: Got next segment. Inline: false Aug 17 16:51:01.489605593 (215h24m42.220873243s) [upload=224113]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:51:01.489611163 (215h24m42.220878814s) [upload=224113]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 16:51:01.492764137 (215h24m42.224031788s) [upload=224113]: Next segment err: metaclient: Too Many Requests Aug 17 16:51:01.492796739 (215h24m42.224064389s) [upload=224113]: Done uploading segments... Aug 17 16:51:01.492814773 (215h24m42.224082422s) [upload=224113]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.206487667s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X....................................X.....................] duration:
750.892383ms
FAIL (2025-08-17 17:06:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:51:01.489236530 (215h24m42.22050415s) [upload=224113]: Starting upload Aug 17 16:51:01.489287255 (215h24m42.220554885s) [upload=224113]: Done starting upload Aug 17 16:51:01.489480899 (215h24m42.220748549s) [upload=224113]: Uploading segments... Aug 17 16:51:01.489563053 (215h24m42.220830713s) [upload=224113]: Got next segment. Inline: false Aug 17 16:51:01.489605593 (215h24m42.220873243s) [upload=224113]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:51:01.489611163 (215h24m42.220878814s) [upload=224113]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 16:51:01.492764137 (215h24m42.224031788s) [upload=224113]: Next segment err: metaclient: Too Many Requests Aug 17 16:51:01.492796739 (215h24m42.224064389s) [upload=224113]: Done uploading segments... Aug 17 16:51:01.492814773 (215h24m42.224082422s) [upload=224113]: Upload finished. err: metaclient: Too Many Requests
Duration: 750.923681ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|