Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
166.778673ms
FAIL (2025-08-17 16:43:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 166.796968ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................XX............X..........................] duration:
402.76193ms
FAIL (2025-08-17 16:42:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 402.787889ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
168.356657ms
FAIL (2025-08-17 16:42:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 168.384229ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
171.38223ms
FAIL (2025-08-17 16:41:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 171.409141ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................XX............X.........................] duration:
480.788461ms
FAIL (2025-08-17 16:41:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 480.809732ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
215.164299ms
FAIL (2025-08-17 16:40:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 215.210585ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................XX............X........................] duration:
526.382ms
FAIL (2025-08-17 16:40:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 526.401977ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
156.744629ms
FAIL (2025-08-17 16:40:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 156.760498ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................XX............X.......................] duration:
452.582774ms
FAIL (2025-08-17 16:39:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 452.600598ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................XX............X......................] duration:
452.850113ms
FAIL (2025-08-17 16:39:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 452.870601ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
538.271341ms
FAIL (2025-08-17 16:39:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 538.304943ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................XX............X.....................] duration:
703.922957ms
FAIL (2025-08-17 16:38:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 703.960156ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
247.844993ms
FAIL (2025-08-17 16:38:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 247.872004ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................XX............X....................] duration:
607.387656ms
FAIL (2025-08-17 16:37:53 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 607.414146ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
145.368831ms
FAIL (2025-08-17 16:37:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 145.386305ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................XX............X...................] duration:
805.139235ms
FAIL (2025-08-17 16:36:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 805.165224ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
273.151386ms
FAIL (2025-08-17 16:36:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 273.176802ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................XX............X..................] duration:
501.620413ms
FAIL (2025-08-17 16:36:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 501.644167ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................XX............X.................] duration:
507.383958ms
FAIL (2025-08-17 16:35:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 507.454051ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
648.932839ms
FAIL (2025-08-17 16:35:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 648.962276ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
630.225168ms
FAIL (2025-08-17 16:35:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 630.24745ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............................XX............X................] duration:
909.211529ms
FAIL (2025-08-17 16:34:35 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 909.234432ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
484.639287ms
FAIL (2025-08-17 16:34:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 484.680966ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............................XX............X...............] duration:
515.238053ms
FAIL (2025-08-17 16:33:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 515.287084ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............................XX............X..............] duration:
669.02883ms
FAIL (2025-08-17 16:33:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 669.048137ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
502.527657ms
FAIL (2025-08-17 16:33:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 502.553835ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................................XX............X.............] duration:
883.808634ms
FAIL (2025-08-17 16:33:05 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 883.83819ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................................XX............X............] duration:
613.68576ms
FAIL (2025-08-17 16:32:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 613.7069ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
335.320825ms
FAIL (2025-08-17 16:32:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 335.355279ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................................XX............X...........] duration:
449.651069ms
FAIL (2025-08-17 16:32:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 449.683459ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
561.754299ms
FAIL (2025-08-17 16:32:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 561.790848ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................................XX............X..........] duration:
711.291088ms
FAIL (2025-08-17 16:31:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 711.313039ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
190.804644ms
FAIL (2025-08-17 16:31:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 190.822277ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................................XX............X.........] duration:
676.776801ms
FAIL (2025-08-17 16:30:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 676.802158ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
204.887695ms
FAIL (2025-08-17 16:30:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 204.914406ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
145.918822ms
FAIL (2025-08-17 16:29:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 145.934771ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................................XX............X........] duration:
514.129555ms
FAIL (2025-08-17 16:29:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 514.15837ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
200.455657ms
FAIL (2025-08-17 16:29:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 200.478619ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................................XX............X.......] duration:
788.543547ms
FAIL (2025-08-17 16:28:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 788.564797ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................................XX............X......] duration:
515.12725ms
FAIL (2025-08-17 16:28:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 515.178927ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
473.795746ms
FAIL (2025-08-17 16:28:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 473.814751ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
204.308768ms
FAIL (2025-08-17 16:27:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 204.33105ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................................XX............X.....] duration:
716.811819ms
FAIL (2025-08-17 16:27:05 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 716.829221ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
164.014997ms
FAIL (2025-08-17 16:26:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 164.045033ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
174.914504ms
FAIL (2025-08-17 16:26:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 174.94965ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................................XX............X....] duration:
537.98674ms
FAIL (2025-08-17 16:25:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 538.016074ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
250.645127ms
FAIL (2025-08-17 16:25:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 250.670444ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................................XX............X...] duration:
873.630771ms
FAIL (2025-08-17 16:25:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 873.652762ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
396.008985ms
FAIL (2025-08-17 16:25:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 16:16:33.915759247 (214h50m14.647026867s) [upload=223525]: Starting upload Aug 17 16:16:33.915852552 (214h50m14.647120173s) [upload=223525]: Done starting upload Aug 17 16:16:33.915897457 (214h50m14.647165087s) [upload=223525]: Uploading segments... Aug 17 16:16:33.915957580 (214h50m14.64722521s) [upload=223525]: Got next segment. Inline: true Aug 17 16:16:33.915961658 (214h50m14.647229288s) [upload=223525]: Waiting for error group managing segments... Aug 17 16:16:33.915991163 (214h50m14.647258783s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 16:16:33.915994529 (214h50m14.647262159s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 16:16:33.915996893 (214h50m14.647264523s) [upload=223525]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 16:16:33.919355074 (214h50m14.650622693s) [upload=223525]: Done uploading segments... Aug 17 16:16:33.919366986 (214h50m14.650634616s) [upload=223525]: Upload finished. err: metaclient: Too Many Requests
Duration: 396.039012ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................................XX............X..] duration:
685.659176ms
FAIL (2025-08-17 16:24:50 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 16:23:10.419656700 (214h56m51.15092432s) [upload=223637]: Starting upload
Aug 17 16:23:10.419695603 (214h56m51.150963223s) [upload=223637]: Done starting upload
Aug 17 16:23:10.419760885 (214h56m51.151028505s) [upload=223637]: Uploading segments...
Aug 17 16:23:10.419870842 (214h56m51.151138463s) [upload=223637]: Got next segment. Inline: false
Aug 17 16:23:10.419897492 (214h56m51.151165103s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 16:23:10.419901069 (214h56m51.151168689s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 16:23:10.558368688 (214h56m51.289636318s) [seg_pos={0 0}, upload=223637]: Begin upload segment...
Aug 17 16:23:10.558400196 (214h56m51.289667817s) [seg_pos={0 0}, upload=223637]: Done begin upload segment.
Aug 17 16:23:10.558418361 (214h56m51.289685981s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558424933 (214h56m51.289692553s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558705390 (214h56m51.289973011s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.558946273 (214h56m51.290213893s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559060869 (214h56m51.290328489s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559178640 (214h56m51.29044626s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559407850 (214h56m51.290675471s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559490857 (214h56m51.290758476s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.559736979 (214h56m51.291004599s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560007487 (214h56m51.291275098s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560162057 (214h56m51.291429677s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560446642 (214h56m51.291714262s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560603056 (214h56m51.291870676s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560802511 (214h56m51.292070131s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.560978412 (214h56m51.292246042s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561232559 (214h56m51.292500189s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561254430 (214h56m51.29252205s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.561453745 (214h56m51.292721364s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Uploading piece...
Aug 17 16:23:10.643778178 (214h56m51.375045799s) [upload=223637]: Next returned nil segment
Aug 17 16:23:10.643794249 (214h56m51.375062059s) [upload=223637]: Waiting for error group managing segments...
Aug 17 16:23:10.673967576 (214h56m51.405235196s) [noise=true , address=104.36.82.4:4806 , piece_id=QWVBRF7TUE6TAOVVZQHA4KCN4STWRX6LAXBR35RXUNNU4DQXM2GQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.677869699 (214h56m51.409137318s) [noise=true , address=104.36.82.51:4064 , piece_id=W4WQVAHWXPQUYYM6C72EEKJM3CZBOVPBQNPQ36JN2VGJBHNRE6WQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.679871430 (214h56m51.41113906s) [noise=true , address=104.36.82.23:4468 , piece_id=I2WJSDZVEKA6MCRZOUTG55Q3MBJUNGJGO3JL7AB5MVS6U7OUP33A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.682501030 (214h56m51.41376866s) [noise=true , address=104.36.82.5:4846 , piece_id=DWH2LV75PK5GOABIDO2K3SXZCUIPXGJGWTT4ZILYODAFUYIKVMWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.694728227 (214h56m51.425995857s) [noise=true , address=104.36.82.38:4720 , piece_id=VSIQTXDKDNQ4LNRPCCFURQAM7MOWGRV23OHSDSC5QN7VGIGFMT7A, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.702859625 (214h56m51.434127245s) [noise=true , address=104.36.82.4:4809 , piece_id=YXR65QLQRLAXWYUZ6MCEJELDWZIRPGGPXCU3L6KLSDBNQKNDQ4DA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.711721067 (214h56m51.442988686s) [noise=true , address=104.36.82.59:4317 , piece_id=HTO24KY36KZ4AJYQ3AVGE57KOS2VVEL4Q45N3SJIRCLO2AOJ7IOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.723466517 (214h56m51.454734137s) [noise=true , address=77.90.31.11:4586 , piece_id=4R3NYCKEAGLJDWB5FUGD23GIASBIOBSNJ6K5AVUKJYORX2BY45XA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.758547485 (214h56m51.489815115s) [noise=true , address=104.36.82.41:4770 , piece_id=7TJBUFEX2TQT4EVJ4BIBI5TNIQCLG2ZYHL3N73PNQOIJ3VIL6JPQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.786756451 (214h56m51.518024102s) [noise=true , address=77.90.31.14:4678 , piece_id=RLDT2PPI33D6ELBSZITUQLQV6LY6X2NNQ2EQ5N5OTS2WC6JVLZOA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.805572488 (214h56m51.536840138s) [noise=true , address=104.36.82.60:4372 , piece_id=YY6GS4SHSGYTFHD7SEAP4GGND3POYZ6R6262USAXWZAMGJHFYJLA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.842767401 (214h56m51.57403505s) [noise=true , address=45.91.116.8:4067 , piece_id=CAAY24BMXJXS5A52O6VMQLHN6WHGR5W4YSH34UJ3AZT7I57NRYPA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.943045728 (214h56m51.674313379s) [noise=true , address=104.36.82.22:4521 , piece_id=JMAU2Z6BFI3E7A5L2NNPVMCMCKRXC5QDM7EBO75V7IGO2UQBUAWA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962560538 (214h56m51.693828158s) [noise=true , address=45.91.116.6:4997 , piece_id=F77SGDV4UBO7IX7V4YOW3ZFNL6VJJQPZLYZ7CTLAWKISOEV2WFWQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: <nil>
Aug 17 16:23:10.962588711 (214h56m51.693856341s) [seg_pos={0 0}, upload=223637]: Segment reached optimal threshold of 14 pieces.
Aug 17 16:23:10.962724176 (214h56m51.693991796s) [noise=true , address=104.36.82.19:4436 , piece_id=MF2T2LMFUNZCMXHBIEUOIMAJKAYGAYRI2BYFJOPJYXU6DFAGZSRQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962756466 (214h56m51.694024097s) [noise=true , address=77.90.31.16:4762 , piece_id=527H6RWXDSOF7ALNSUET5EVANFJKYQ5XILDMJ6VLNFCSM4LHCGUA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR): protocol: expected piece hash; context canceled; EOF
Aug 17 16:23:10.962889416 (214h56m51.694157046s) [noise=true , address=193.149.164.143:4701 , piece_id=6HIZGX5HE4PQBRBIEWUR5S35TG22MLNRISWGT3QXKPTWTLBHBZDQ, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18gM2HhdK2fn7tQo7WowTWCBhjxF4t7RztaF8h9S5SccA4ALcz): protocol: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:26326->193.149.164.143:4701: use of closed network connection
Aug 17 16:23:10.962930644 (214h56m51.694198284s) [noise=true , address=66.23.193.175:4555 , piece_id=U2NSB2W7BU7BVODFU2URF34KOH6ESZMU5LNOOIMGWLZ2FJOZKYHA, seg_pos={0 0}, upload=223637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24324->66.23.193.175:4555: use of closed network connection
Aug 17 16:23:10.962965690 (214h56m51.69423333s) [seg_pos={0 0}, upload=223637]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 16:23:10.963033427 (214h56m51.694301057s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 16:23:10.963037855 (214h56m51.694305485s) [upload=223637]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 16:23:11.198020659 (214h56m51.92928828s) [upload=223637]: Done uploading segments...
Aug 17 16:23:11.198034796 (214h56m51.929302426s) [upload=223637]: Upload finished. err: <nil>
Duration: 685.684673ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|