Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
555.466232ms
FAIL (2025-08-13 17:37:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 555.489516ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
1.048298988s
FAIL (2025-08-13 17:37:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 1.048330988s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
275.774571ms
FAIL (2025-08-13 17:36:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 275.794417ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
720.685428ms
FAIL (2025-08-13 17:36:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 720.710173ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
201.659741ms
FAIL (2025-08-13 17:36:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 201.685047ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
921.546478ms
FAIL (2025-08-13 17:35:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 921.57421ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.579063916s
FAIL (2025-08-13 17:35:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 1.579083093s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
355.158086ms
FAIL (2025-08-13 17:34:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 355.193914ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
318.000697ms
FAIL (2025-08-13 17:34:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 318.03944ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.126245489s
FAIL (2025-08-13 17:34:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 1.126281528s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
944.341803ms
FAIL (2025-08-13 17:33:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 944.365467ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
209.59317ms
FAIL (2025-08-13 17:33:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 209.613738ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
752.447532ms
FAIL (2025-08-13 17:32:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 752.476076ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
453.538139ms
FAIL (2025-08-13 17:32:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 453.561264ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
744.257532ms
FAIL (2025-08-13 17:32:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 744.282659ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
191.00082ms
FAIL (2025-08-13 17:31:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 191.035556ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
1.07980307s
FAIL (2025-08-13 17:31:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 1.07984529s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
1.035666937s
FAIL (2025-08-13 17:31:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 1.035693627s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
909.068439ms
FAIL (2025-08-13 17:31:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 909.089489ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
1.986585781s
FAIL (2025-08-13 17:30:31 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 1.986645211s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
393.026409ms
FAIL (2025-08-13 17:30:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 393.046927ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
490.54706ms
FAIL (2025-08-13 17:29:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 490.572778ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
666.117481ms
FAIL (2025-08-13 17:28:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 666.148809ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
726.688586ms
FAIL (2025-08-13 17:28:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 726.71253ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
668.338742ms
FAIL (2025-08-13 17:28:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 668.361986ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
646.179074ms
FAIL (2025-08-13 17:28:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 646.203489ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
547.028269ms
FAIL (2025-08-13 17:27:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 547.056081ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
421.937468ms
FAIL (2025-08-13 17:27:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 421.956876ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
923.682495ms
FAIL (2025-08-13 17:27:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 923.713383ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
435.522994ms
FAIL (2025-08-13 17:26:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 435.549163ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.685518914s
FAIL (2025-08-13 17:26:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 1.685536928s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
1.088497793s
FAIL (2025-08-13 17:26:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 1.08851768s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.582251849s
FAIL (2025-08-13 17:26:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 1.582271235s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
547.26387ms
FAIL (2025-08-13 17:25:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 547.393424ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
746.217587ms
FAIL (2025-08-13 17:25:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 746.243766ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
675.196459ms
FAIL (2025-08-13 17:24:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 675.21352ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.17713113s
FAIL (2025-08-13 17:24:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 1.177155156s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
1.152648685s
FAIL (2025-08-13 17:24:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 1.152668803s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
988.538002ms
FAIL (2025-08-13 17:23:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 988.560965ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
847.061094ms
FAIL (2025-08-13 17:23:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 847.08521ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
1.495370529s
FAIL (2025-08-13 17:22:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 1.495394244s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
736.146315ms
FAIL (2025-08-13 17:22:45 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 736.165981ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
171.145742ms
FAIL (2025-08-13 17:22:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 171.170088ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
415.672888ms
FAIL (2025-08-13 17:21:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 17:21:46.871470048 (119h55m27.602737669s) [upload=124882]: Starting upload
Aug 13 17:21:46.871519511 (119h55m27.602787141s) [upload=124882]: Done starting upload
Aug 13 17:21:46.871607998 (119h55m27.602875618s) [upload=124882]: Uploading segments...
Aug 13 17:21:46.871836508 (119h55m27.603104129s) [upload=124882]: Got next segment. Inline: false
Aug 13 17:21:46.871875211 (119h55m27.603142831s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 17:21:46.871879549 (119h55m27.603147179s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 17:21:46.901915096 (119h55m27.633182716s) [seg_pos={0 0}, upload=124882]: Begin upload segment...
Aug 13 17:21:46.901955412 (119h55m27.633223031s) [seg_pos={0 0}, upload=124882]: Done begin upload segment.
Aug 13 17:21:46.901983665 (119h55m27.633251295s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.901992122 (119h55m27.633259741s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902026245 (119h55m27.633293875s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902295191 (119h55m27.633562821s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902304960 (119h55m27.63357259s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902511688 (119h55m27.633779319s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902526166 (119h55m27.633793796s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902741921 (119h55m27.634009551s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902867248 (119h55m27.634134878s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.902942059 (119h55m27.634209689s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903089116 (119h55m27.634356736s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903169467 (119h55m27.634437097s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903315521 (119h55m27.634583151s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903525155 (119h55m27.634792775s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.903764967 (119h55m27.635032597s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904040817 (119h55m27.635308447s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904320544 (119h55m27.635588163s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.904751583 (119h55m27.636019213s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Uploading piece...
Aug 13 17:21:46.997209497 (119h55m27.728477127s) [upload=124882]: Next returned nil segment
Aug 13 17:21:46.997222022 (119h55m27.728489652s) [upload=124882]: Waiting for error group managing segments...
Aug 13 17:21:47.010225775 (119h55m27.741493434s) [noise=true , address=104.36.82.8:4995 , piece_id=X7CFKDERSV2RF4BHAAZZOU6CSFZUGHY32OQN7DLL3GAV4GWENT7A, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.010817248 (119h55m27.742084878s) [noise=true , address=104.36.82.17:4338 , piece_id=EQ47AI453WRUVHDWHRHFFOFMV53RSI5TMPVF53JIIGZAK2U2UMQQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.014588084 (119h55m27.745855734s) [noise=true , address=104.36.82.18:4371 , piece_id=IGVZRC4RCGN6A5AOXAXDX4NEG2Y7KNDTIQYAVOLUGVTFNFFJ53TQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.024361468 (119h55m27.755629098s) [noise=true , address=77.90.31.11:4569 , piece_id=3ZBRP2O3LVDHE5GF54VIWGGWVD2VGHB2WS4467RI4JR6OYAFRDTQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025533964 (119h55m27.756801584s) [noise=true , address=104.36.82.39:4755 , piece_id=G5CEQDRYAIWLQVEQ6MOFCCVV67EFPJUDOSUB23CJAHOQRU3TNFQA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.025588858 (119h55m27.756856528s) [noise=true , address=104.36.82.44:4902 , piece_id=PK274UEI5CKYILNQQFTEK5KU4DRD5TRDJJ62IS2DLV43IJ4QZBXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.028261657 (119h55m27.759529278s) [noise=true , address=104.36.82.23:4446 , piece_id=H35S4K2L6HZVK65NDZ6LYX7ADRXRWX74WW2BLQV6TNZPHAKL25VA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.031755773 (119h55m27.763023393s) [noise=true , address=104.36.82.47:4546 , piece_id=GMHIPXDK7TUF66IYUT2N4IFERKNLWR5ZQ7V67GASTWSD2XI4W7YA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.038570427 (119h55m27.769838068s) [noise=true , address=104.36.82.2:4747 , piece_id=2HJE7S4YKPNZPQI3CD57SJVARNBXV4FVSEUJB7R6Z5M7ENFK7GNQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.041684328 (119h55m27.772951949s) [noise=true , address=77.90.31.19:4858 , piece_id=IOVQH4UKF5BZKGC6Y6MTJZV6XRBA546GBQXI2OJ5DI75G52OKRBA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.042079562 (119h55m27.773347212s) [noise=true , address=104.36.82.40:4960 , piece_id=JCHAX7PHMISRL2LAMFIT4Q25WEWAEHV6CY54AR4HQ6HUTRMZYSOQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.043734947 (119h55m27.775002568s) [noise=true , address=104.36.82.59:4323 , piece_id=SQZPJV2EL2EOBLW3G4JWLY3PH7AASIPCSBD4ED7RDJZLQ7RQ35KA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.048548146 (119h55m27.779815796s) [noise=true , address=77.90.31.21:4894 , piece_id=WFF3NX6GHWHGBKBWXNVQGAVPJIWFLU255AM76IVQYT77ZUA5SLKA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050765479 (119h55m27.782033128s) [noise=true , address=104.36.82.14:4255 , piece_id=KPMXQF3LB7257AMCSY4MULQG7AULEIUFYPDFRLQFLQEEIH4NXMXQ, seg_pos={0 0}, upload=124882]: Done uploading piece. err: <nil>
Aug 13 17:21:47.050799433 (119h55m27.782067063s) [seg_pos={0 0}, upload=124882]: Segment reached optimal threshold of 14 pieces.
Aug 13 17:21:47.050972679 (119h55m27.782240329s) [noise=true , address=104.36.82.59:4318 , piece_id=XDFYVIDAQLJFABROBZUU2OO24YF3ULXTQHLTZLTZVDVBKNUMMVEA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051078900 (119h55m27.78234653s) [noise=true , address=77.90.31.18:4809 , piece_id=JLQMII5QFVYGNHRB7VGOI4ERRQROOLARDUJX43JHUEOWE7IOIG3Q, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz): protocol: expected piece hash; context canceled; EOF
Aug 13 17:21:47.051240974 (119h55m27.782508614s) [noise=true , address=156.146.43.225:4445 , piece_id=B3YF3NA3QOOC2NIOKXTJTHZEEE2PGM44QIAFUW5CIZY7U56NFGMA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hbBnn4nfspCtJnPYNJNExzpmpfExcZhx5g8rFbBJjmfSKA1NB): protocol: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:11200->156.146.43.225:4445: use of closed network connection
Aug 13 17:21:47.051349197 (119h55m27.782616867s) [noise=true , address=64.49.13.155:4923 , piece_id=AOI3RAN63OXFB62GAEUSREDGY4TVUJQZA4674UZ3D4VTR6WCKDCA, seg_pos={0 0}, upload=124882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CJVCqcpsnRfG6zJwpd4Bkm4dKX7DV5AFEesUcRs38VUPuxS3z): protocol: read tcp 5.161.89.252:26348->64.49.13.155:4923: use of closed network connection; context canceled
Aug 13 17:21:47.051381588 (119h55m27.782649218s) [seg_pos={0 0}, upload=124882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 17:21:47.051455778 (119h55m27.782723408s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 17:21:47.051461669 (119h55m27.782729339s) [upload=124882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 17:21:47.186736062 (119h55m27.918003712s) [upload=124882]: Done uploading segments...
Aug 13 17:21:47.186754247 (119h55m27.918021897s) [upload=124882]: Upload finished. err: <nil>
Duration: 415.737349ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
360.74175ms
FAIL (2025-08-13 17:21:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 360.76871ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.207786152s
FAIL (2025-08-13 17:21:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 16:32:56.710075511 (119h6m37.44134316s) [upload=124064]: Starting upload Aug 13 16:32:56.710137808 (119h6m37.441405459s) [upload=124064]: Done starting upload Aug 13 16:32:56.710208861 (119h6m37.441476512s) [upload=124064]: Uploading segments... Aug 13 16:32:56.710633350 (119h6m37.441901011s) [upload=124064]: Got next segment. Inline: false Aug 13 16:32:56.710675670 (119h6m37.44194332s) [upload=124064]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:32:56.710681611 (119h6m37.441949261s) [upload=124064]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 16:32:56.713310792 (119h6m37.444578442s) [upload=124064]: Next segment err: metaclient: Too Many Requests Aug 13 16:32:56.713324818 (119h6m37.444592469s) [upload=124064]: Done uploading segments... Aug 13 16:32:56.713337382 (119h6m37.444605042s) [upload=124064]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.207810399s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
347.717669ms
FAIL (2025-08-13 17:20:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 347.745852ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
593.798677ms
FAIL (2025-08-13 17:19:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 16:32:56.710075511 (119h6m37.44134316s) [upload=124064]: Starting upload Aug 13 16:32:56.710137808 (119h6m37.441405459s) [upload=124064]: Done starting upload Aug 13 16:32:56.710208861 (119h6m37.441476512s) [upload=124064]: Uploading segments... Aug 13 16:32:56.710633350 (119h6m37.441901011s) [upload=124064]: Got next segment. Inline: false Aug 13 16:32:56.710675670 (119h6m37.44194332s) [upload=124064]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:32:56.710681611 (119h6m37.441949261s) [upload=124064]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 16:32:56.713310792 (119h6m37.444578442s) [upload=124064]: Next segment err: metaclient: Too Many Requests Aug 13 16:32:56.713324818 (119h6m37.444592469s) [upload=124064]: Done uploading segments... Aug 13 16:32:56.713337382 (119h6m37.444605042s) [upload=124064]: Upload finished. err: metaclient: Too Many Requests
Duration: 593.820418ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
365.876867ms
FAIL (2025-08-13 17:19:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 9c0f9fdd83aa4dc48c862a9ba2ec7f3b0145ad26ee74dc1495ed078655314df4 != before 086fb7dace7a6c5e85b899602a062b10cde668e0a428f58a4e269db80689279f ======LOGS====== Aug 13 16:59:19.892065489 (119h33m0.623333139s) [upload=124501]: Starting upload Aug 13 16:59:19.892112618 (119h33m0.623380267s) [upload=124501]: Done starting upload Aug 13 16:59:19.892165888 (119h33m0.623433538s) [upload=124501]: Uploading segments... Aug 13 16:59:19.892207386 (119h33m0.623475026s) [upload=124501]: Got next segment. Inline: true Aug 13 16:59:19.892212465 (119h33m0.623480116s) [upload=124501]: Waiting for error group managing segments... Aug 13 16:59:19.892251168 (119h33m0.623518818s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:59:19.892255877 (119h33m0.623523527s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 16:59:19.892259143 (119h33m0.623526793s) [upload=124501]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 16:59:27.114833285 (119h33m7.846100935s) [upload=124501]: Done uploading segments... Aug 13 16:59:27.114851760 (119h33m7.84611941s) [upload=124501]: Upload finished. err: <nil>
Duration: 365.901492ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
821.010599ms
FAIL (2025-08-13 17:19:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 16:32:56.710075511 (119h6m37.44134316s) [upload=124064]: Starting upload Aug 13 16:32:56.710137808 (119h6m37.441405459s) [upload=124064]: Done starting upload Aug 13 16:32:56.710208861 (119h6m37.441476512s) [upload=124064]: Uploading segments... Aug 13 16:32:56.710633350 (119h6m37.441901011s) [upload=124064]: Got next segment. Inline: false Aug 13 16:32:56.710675670 (119h6m37.44194332s) [upload=124064]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 16:32:56.710681611 (119h6m37.441949261s) [upload=124064]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 16:32:56.713310792 (119h6m37.444578442s) [upload=124064]: Next segment err: metaclient: Too Many Requests Aug 13 16:32:56.713324818 (119h6m37.444592469s) [upload=124064]: Done uploading segments... Aug 13 16:32:56.713337382 (119h6m37.444605042s) [upload=124064]: Upload finished. err: metaclient: Too Many Requests
Duration: 821.039713ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|