Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X................................................X....] duration:
363.620495ms
FAIL (2025-08-20 01:30:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 77bbb6cb22b08585db3966e1cb2e0eb4009b1f4fce90ccfa201d03dae39c559d != before b2e2e76751b1139f6044ffa2042800b96e7287f565418770a9df69829a793b3f
======LOGS======
Aug 20 01:27:46.872279426 (272h1m27.603547085s) [upload=282885]: Starting upload
Aug 20 01:27:46.872357763 (272h1m27.603625423s) [upload=282885]: Done starting upload
Aug 20 01:27:46.872431772 (272h1m27.603699422s) [upload=282885]: Uploading segments...
Aug 20 01:27:46.872792200 (272h1m27.60405985s) [upload=282885]: Got next segment. Inline: false
Aug 20 01:27:46.872837185 (272h1m27.604104835s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:27:46.872843186 (272h1m27.604110837s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:27:46.903543858 (272h1m27.634811518s) [seg_pos={0 0}, upload=282885]: Begin upload segment...
Aug 20 01:27:46.903600915 (272h1m27.634868575s) [seg_pos={0 0}, upload=282885]: Done begin upload segment.
Aug 20 01:27:46.903632023 (272h1m27.634899673s) [noise=true , address=104.36.82.13:4197 , piece_id=NIFLJVBOH6HZKIENRCE2WDXYHDBJY2PWQ3IFOAUGIAUUYBHWUEJA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.903680414 (272h1m27.634948124s) [noise=true , address=104.36.82.5:4857 , piece_id=NHZ3YRT7HDWGCZ4AAF5IQU2YUO2KY5TWKGDZ5CPCYP5D5IICODSQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.904164585 (272h1m27.635432245s) [noise=true , address=104.36.82.51:4064 , piece_id=XKAGAAHLNJVQ2LKZNSISNNXBYVSGBLUAAYT62NSZF3Q7UGFVXB7Q, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.904525374 (272h1m27.635793023s) [noise=true , address=77.90.31.17:4792 , piece_id=WL6HTNNJHEIKZCQFLHLQR3IXL25YSVK3C5UIKISU63OMKSHPEQHA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.904606506 (272h1m27.635874167s) [noise=true , address=45.91.116.6:4985 , piece_id=XGLVDSX25V2EU5YRGHMPKMOTSKK3ZPYQ7FYLIQ5QTMVNEBV2LETA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905035373 (272h1m27.636303023s) [noise=true , address=77.90.31.11:4584 , piece_id=Q5XLX3WLA6HNGDM4HMJXE4PDUDC7KS7ECPJ7C2SR7DVZQBIN2I7A, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905210382 (272h1m27.636478032s) [noise=true , address=77.90.31.18:4839 , piece_id=IQ24EFIPFZXQBSWXM27E4O7YYXO7R47UJ6H4IZNOMCOP3YRWEWVQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905455353 (272h1m27.636723003s) [noise=true , address=79.127.220.98:4425 , piece_id=QZVZPB3GLU3D6ZH7PGMZUCNB6EEDQEI5INJO4GGIKUQYKAGVY3JQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905804479 (272h1m27.637072139s) [noise=true , address=104.36.82.2:4759 , piece_id=DJWNSNCLJSGGSJ3BP4O2AHVL6ZTC4BSZDTBJIC5VNTWQDHTREDEA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905871236 (272h1m27.637138886s) [noise=true , address=45.91.116.7:4039 , piece_id=IITKMFJUGXZ6H6UVFWGOVJX7H6EDLXUDMYOC3IXTIHRZ7RR53X5Q, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906141914 (272h1m27.637409544s) [noise=true , address=45.91.116.8:4067 , piece_id=LKFQAU4N4MVI7CWBWEI7JABKFK4Z5UJCBJ746GL7GGZDPKUNBRUA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906181729 (272h1m27.637449359s) [noise=true , address=79.127.201.215:4349 , piece_id=EH5UC6MB2VCYOZBWXQQ6XBBI6V23BWAUI62PIQU42ESNZUWBJZIA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906382797 (272h1m27.637650427s) [noise=true , address=77.90.31.21:4911 , piece_id=OYOV4JH2REXRKWUKP5RTU7WQKA5A6KUYTA2ZEW3MLGM3ZYBCBCBA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906446718 (272h1m27.637714338s) [noise=true , address=104.36.82.14:4230 , piece_id=UYQZ4STKS7EOP4IMUDU3L5Z2CYUXGDG6Y2YSM3ABFR2DHC3XGAWA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906587123 (272h1m27.637854753s) [noise=true , address=104.36.82.22:4536 , piece_id=TGACXGDNMWYCD4YRQO2B5QRAPUXQUCGTC5OYDDRN6LIRXUGB7KBA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906794051 (272h1m27.638061681s) [noise=true , address=104.36.82.15:4292 , piece_id=PF63QCS5ICM3O5IA6GXK3R6QBIMGSLVOXE375MN7XUDTFLVGROTQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906803839 (272h1m27.638071469s) [noise=true , address=77.90.31.19:4849 , piece_id=SUAIYTQ77PONMJVPDP52TKJROTA2SU2J743ILG3G65AYM5OJ5E3Q, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.907070631 (272h1m27.638338251s) [noise=true , address=45.91.116.11:4143 , piece_id=Y6DQR7UXXGVMQCVD6SOBY5V567B3YBOQDOL2XP3YL7RYNRMNJ2BQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:47.039278378 (272h1m27.770546038s) [upload=282885]: Next returned nil segment
Aug 20 01:27:47.039318363 (272h1m27.770586022s) [upload=282885]: Waiting for error group managing segments...
Aug 20 01:27:47.049707395 (272h1m27.780975056s) [noise=true , address=45.91.116.11:4143 , piece_id=Y6DQR7UXXGVMQCVD6SOBY5V567B3YBOQDOL2XP3YL7RYNRMNJ2BQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.050730830 (272h1m27.78199849s) [noise=true , address=45.91.116.8:4067 , piece_id=LKFQAU4N4MVI7CWBWEI7JABKFK4Z5UJCBJ746GL7GGZDPKUNBRUA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.051496781 (272h1m27.782764432s) [noise=true , address=45.91.116.6:4985 , piece_id=XGLVDSX25V2EU5YRGHMPKMOTSKK3ZPYQ7FYLIQ5QTMVNEBV2LETA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.052107159 (272h1m27.783374809s) [noise=true , address=104.36.82.2:4759 , piece_id=DJWNSNCLJSGGSJ3BP4O2AHVL6ZTC4BSZDTBJIC5VNTWQDHTREDEA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.052658857 (272h1m27.783926517s) [noise=true , address=104.36.82.14:4230 , piece_id=UYQZ4STKS7EOP4IMUDU3L5Z2CYUXGDG6Y2YSM3ABFR2DHC3XGAWA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.052788401 (272h1m27.784056051s) [noise=true , address=104.36.82.15:4292 , piece_id=PF63QCS5ICM3O5IA6GXK3R6QBIMGSLVOXE375MN7XUDTFLVGROTQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.053500891 (272h1m27.784768541s) [noise=true , address=104.36.82.22:4536 , piece_id=TGACXGDNMWYCD4YRQO2B5QRAPUXQUCGTC5OYDDRN6LIRXUGB7KBA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.054848305 (272h1m27.786115955s) [noise=true , address=104.36.82.13:4197 , piece_id=NIFLJVBOH6HZKIENRCE2WDXYHDBJY2PWQ3IFOAUGIAUUYBHWUEJA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.056351233 (272h1m27.787618883s) [noise=true , address=104.36.82.51:4064 , piece_id=XKAGAAHLNJVQ2LKZNSISNNXBYVSGBLUAAYT62NSZF3Q7UGFVXB7Q, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.060553377 (272h1m27.791821027s) [noise=true , address=77.90.31.11:4584 , piece_id=Q5XLX3WLA6HNGDM4HMJXE4PDUDC7KS7ECPJ7C2SR7DVZQBIN2I7A, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.064482758 (272h1m27.795750409s) [noise=true , address=45.91.116.7:4039 , piece_id=IITKMFJUGXZ6H6UVFWGOVJX7H6EDLXUDMYOC3IXTIHRZ7RR53X5Q, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.064533585 (272h1m27.795801235s) [noise=true , address=77.90.31.18:4839 , piece_id=IQ24EFIPFZXQBSWXM27E4O7YYXO7R47UJ6H4IZNOMCOP3YRWEWVQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.071065051 (272h1m27.802332671s) [noise=true , address=77.90.31.19:4849 , piece_id=SUAIYTQ77PONMJVPDP52TKJROTA2SU2J743ILG3G65AYM5OJ5E3Q, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.080368170 (272h1m27.811635821s) [noise=true , address=79.127.220.98:4425 , piece_id=QZVZPB3GLU3D6ZH7PGMZUCNB6EEDQEI5INJO4GGIKUQYKAGVY3JQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.080403708 (272h1m27.811671368s) [seg_pos={0 0}, upload=282885]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:27:47.080620135 (272h1m27.811887785s) [noise=true , address=77.90.31.21:4911 , piece_id=OYOV4JH2REXRKWUKP5RTU7WQKA5A6KUYTA2ZEW3MLGM3ZYBCBCBA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF
Aug 20 01:27:47.080741352 (272h1m27.812009013s) [noise=true , address=77.90.31.17:4792 , piece_id=WL6HTNNJHEIKZCQFLHLQR3IXL25YSVK3C5UIKISU63OMKSHPEQHA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SPFgYZnbwjEupjaghfs61qwFM678KNPwpDmRNqV1j2opNgZCN): protocol: expected piece hash; context canceled; EOF
Aug 20 01:27:47.080903698 (272h1m27.812171348s) [noise=true , address=104.36.82.5:4857 , piece_id=NHZ3YRT7HDWGCZ4AAF5IQU2YUO2KY5TWKGDZ5CPCYP5D5IICODSQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 20 01:27:47.081032120 (272h1m27.81229977s) [noise=true , address=79.127.201.215:4349 , piece_id=EH5UC6MB2VCYOZBWXQQ6XBBI6V23BWAUI62PIQU42ESNZUWBJZIA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: write tcp 5.161.89.252:44672->79.127.201.215:4349: use of closed network connection; write tcp 5.161.89.252:44672->79.127.201.215:4349: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44672->79.127.201.215:4349: use of closed network connection
Aug 20 01:27:47.081085640 (272h1m27.81235329s) [seg_pos={0 0}, upload=282885]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:27:47.081205857 (272h1m27.812473517s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:27:47.081215625 (272h1m27.812483285s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:27:47.195587649 (272h1m27.926855279s) [upload=282885]: Done uploading segments...
Aug 20 01:27:47.195601846 (272h1m27.926869476s) [upload=282885]: Upload finished. err: <nil>
Duration: 363.643507ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X................................................X...] duration:
393.361669ms
FAIL (2025-08-20 01:30:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 77bbb6cb22b08585db3966e1cb2e0eb4009b1f4fce90ccfa201d03dae39c559d != before b2e2e76751b1139f6044ffa2042800b96e7287f565418770a9df69829a793b3f
======LOGS======
Aug 20 01:27:46.872279426 (272h1m27.603547085s) [upload=282885]: Starting upload
Aug 20 01:27:46.872357763 (272h1m27.603625423s) [upload=282885]: Done starting upload
Aug 20 01:27:46.872431772 (272h1m27.603699422s) [upload=282885]: Uploading segments...
Aug 20 01:27:46.872792200 (272h1m27.60405985s) [upload=282885]: Got next segment. Inline: false
Aug 20 01:27:46.872837185 (272h1m27.604104835s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:27:46.872843186 (272h1m27.604110837s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:27:46.903543858 (272h1m27.634811518s) [seg_pos={0 0}, upload=282885]: Begin upload segment...
Aug 20 01:27:46.903600915 (272h1m27.634868575s) [seg_pos={0 0}, upload=282885]: Done begin upload segment.
Aug 20 01:27:46.903632023 (272h1m27.634899673s) [noise=true , address=104.36.82.13:4197 , piece_id=NIFLJVBOH6HZKIENRCE2WDXYHDBJY2PWQ3IFOAUGIAUUYBHWUEJA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.903680414 (272h1m27.634948124s) [noise=true , address=104.36.82.5:4857 , piece_id=NHZ3YRT7HDWGCZ4AAF5IQU2YUO2KY5TWKGDZ5CPCYP5D5IICODSQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.904164585 (272h1m27.635432245s) [noise=true , address=104.36.82.51:4064 , piece_id=XKAGAAHLNJVQ2LKZNSISNNXBYVSGBLUAAYT62NSZF3Q7UGFVXB7Q, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.904525374 (272h1m27.635793023s) [noise=true , address=77.90.31.17:4792 , piece_id=WL6HTNNJHEIKZCQFLHLQR3IXL25YSVK3C5UIKISU63OMKSHPEQHA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.904606506 (272h1m27.635874167s) [noise=true , address=45.91.116.6:4985 , piece_id=XGLVDSX25V2EU5YRGHMPKMOTSKK3ZPYQ7FYLIQ5QTMVNEBV2LETA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905035373 (272h1m27.636303023s) [noise=true , address=77.90.31.11:4584 , piece_id=Q5XLX3WLA6HNGDM4HMJXE4PDUDC7KS7ECPJ7C2SR7DVZQBIN2I7A, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905210382 (272h1m27.636478032s) [noise=true , address=77.90.31.18:4839 , piece_id=IQ24EFIPFZXQBSWXM27E4O7YYXO7R47UJ6H4IZNOMCOP3YRWEWVQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905455353 (272h1m27.636723003s) [noise=true , address=79.127.220.98:4425 , piece_id=QZVZPB3GLU3D6ZH7PGMZUCNB6EEDQEI5INJO4GGIKUQYKAGVY3JQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905804479 (272h1m27.637072139s) [noise=true , address=104.36.82.2:4759 , piece_id=DJWNSNCLJSGGSJ3BP4O2AHVL6ZTC4BSZDTBJIC5VNTWQDHTREDEA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905871236 (272h1m27.637138886s) [noise=true , address=45.91.116.7:4039 , piece_id=IITKMFJUGXZ6H6UVFWGOVJX7H6EDLXUDMYOC3IXTIHRZ7RR53X5Q, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906141914 (272h1m27.637409544s) [noise=true , address=45.91.116.8:4067 , piece_id=LKFQAU4N4MVI7CWBWEI7JABKFK4Z5UJCBJ746GL7GGZDPKUNBRUA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906181729 (272h1m27.637449359s) [noise=true , address=79.127.201.215:4349 , piece_id=EH5UC6MB2VCYOZBWXQQ6XBBI6V23BWAUI62PIQU42ESNZUWBJZIA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906382797 (272h1m27.637650427s) [noise=true , address=77.90.31.21:4911 , piece_id=OYOV4JH2REXRKWUKP5RTU7WQKA5A6KUYTA2ZEW3MLGM3ZYBCBCBA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906446718 (272h1m27.637714338s) [noise=true , address=104.36.82.14:4230 , piece_id=UYQZ4STKS7EOP4IMUDU3L5Z2CYUXGDG6Y2YSM3ABFR2DHC3XGAWA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906587123 (272h1m27.637854753s) [noise=true , address=104.36.82.22:4536 , piece_id=TGACXGDNMWYCD4YRQO2B5QRAPUXQUCGTC5OYDDRN6LIRXUGB7KBA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906794051 (272h1m27.638061681s) [noise=true , address=104.36.82.15:4292 , piece_id=PF63QCS5ICM3O5IA6GXK3R6QBIMGSLVOXE375MN7XUDTFLVGROTQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906803839 (272h1m27.638071469s) [noise=true , address=77.90.31.19:4849 , piece_id=SUAIYTQ77PONMJVPDP52TKJROTA2SU2J743ILG3G65AYM5OJ5E3Q, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.907070631 (272h1m27.638338251s) [noise=true , address=45.91.116.11:4143 , piece_id=Y6DQR7UXXGVMQCVD6SOBY5V567B3YBOQDOL2XP3YL7RYNRMNJ2BQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:47.039278378 (272h1m27.770546038s) [upload=282885]: Next returned nil segment
Aug 20 01:27:47.039318363 (272h1m27.770586022s) [upload=282885]: Waiting for error group managing segments...
Aug 20 01:27:47.049707395 (272h1m27.780975056s) [noise=true , address=45.91.116.11:4143 , piece_id=Y6DQR7UXXGVMQCVD6SOBY5V567B3YBOQDOL2XP3YL7RYNRMNJ2BQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.050730830 (272h1m27.78199849s) [noise=true , address=45.91.116.8:4067 , piece_id=LKFQAU4N4MVI7CWBWEI7JABKFK4Z5UJCBJ746GL7GGZDPKUNBRUA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.051496781 (272h1m27.782764432s) [noise=true , address=45.91.116.6:4985 , piece_id=XGLVDSX25V2EU5YRGHMPKMOTSKK3ZPYQ7FYLIQ5QTMVNEBV2LETA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.052107159 (272h1m27.783374809s) [noise=true , address=104.36.82.2:4759 , piece_id=DJWNSNCLJSGGSJ3BP4O2AHVL6ZTC4BSZDTBJIC5VNTWQDHTREDEA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.052658857 (272h1m27.783926517s) [noise=true , address=104.36.82.14:4230 , piece_id=UYQZ4STKS7EOP4IMUDU3L5Z2CYUXGDG6Y2YSM3ABFR2DHC3XGAWA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.052788401 (272h1m27.784056051s) [noise=true , address=104.36.82.15:4292 , piece_id=PF63QCS5ICM3O5IA6GXK3R6QBIMGSLVOXE375MN7XUDTFLVGROTQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.053500891 (272h1m27.784768541s) [noise=true , address=104.36.82.22:4536 , piece_id=TGACXGDNMWYCD4YRQO2B5QRAPUXQUCGTC5OYDDRN6LIRXUGB7KBA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.054848305 (272h1m27.786115955s) [noise=true , address=104.36.82.13:4197 , piece_id=NIFLJVBOH6HZKIENRCE2WDXYHDBJY2PWQ3IFOAUGIAUUYBHWUEJA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.056351233 (272h1m27.787618883s) [noise=true , address=104.36.82.51:4064 , piece_id=XKAGAAHLNJVQ2LKZNSISNNXBYVSGBLUAAYT62NSZF3Q7UGFVXB7Q, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.060553377 (272h1m27.791821027s) [noise=true , address=77.90.31.11:4584 , piece_id=Q5XLX3WLA6HNGDM4HMJXE4PDUDC7KS7ECPJ7C2SR7DVZQBIN2I7A, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.064482758 (272h1m27.795750409s) [noise=true , address=45.91.116.7:4039 , piece_id=IITKMFJUGXZ6H6UVFWGOVJX7H6EDLXUDMYOC3IXTIHRZ7RR53X5Q, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.064533585 (272h1m27.795801235s) [noise=true , address=77.90.31.18:4839 , piece_id=IQ24EFIPFZXQBSWXM27E4O7YYXO7R47UJ6H4IZNOMCOP3YRWEWVQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.071065051 (272h1m27.802332671s) [noise=true , address=77.90.31.19:4849 , piece_id=SUAIYTQ77PONMJVPDP52TKJROTA2SU2J743ILG3G65AYM5OJ5E3Q, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.080368170 (272h1m27.811635821s) [noise=true , address=79.127.220.98:4425 , piece_id=QZVZPB3GLU3D6ZH7PGMZUCNB6EEDQEI5INJO4GGIKUQYKAGVY3JQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.080403708 (272h1m27.811671368s) [seg_pos={0 0}, upload=282885]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:27:47.080620135 (272h1m27.811887785s) [noise=true , address=77.90.31.21:4911 , piece_id=OYOV4JH2REXRKWUKP5RTU7WQKA5A6KUYTA2ZEW3MLGM3ZYBCBCBA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF
Aug 20 01:27:47.080741352 (272h1m27.812009013s) [noise=true , address=77.90.31.17:4792 , piece_id=WL6HTNNJHEIKZCQFLHLQR3IXL25YSVK3C5UIKISU63OMKSHPEQHA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SPFgYZnbwjEupjaghfs61qwFM678KNPwpDmRNqV1j2opNgZCN): protocol: expected piece hash; context canceled; EOF
Aug 20 01:27:47.080903698 (272h1m27.812171348s) [noise=true , address=104.36.82.5:4857 , piece_id=NHZ3YRT7HDWGCZ4AAF5IQU2YUO2KY5TWKGDZ5CPCYP5D5IICODSQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 20 01:27:47.081032120 (272h1m27.81229977s) [noise=true , address=79.127.201.215:4349 , piece_id=EH5UC6MB2VCYOZBWXQQ6XBBI6V23BWAUI62PIQU42ESNZUWBJZIA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: write tcp 5.161.89.252:44672->79.127.201.215:4349: use of closed network connection; write tcp 5.161.89.252:44672->79.127.201.215:4349: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44672->79.127.201.215:4349: use of closed network connection
Aug 20 01:27:47.081085640 (272h1m27.81235329s) [seg_pos={0 0}, upload=282885]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:27:47.081205857 (272h1m27.812473517s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:27:47.081215625 (272h1m27.812483285s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:27:47.195587649 (272h1m27.926855279s) [upload=282885]: Done uploading segments...
Aug 20 01:27:47.195601846 (272h1m27.926869476s) [upload=282885]: Upload finished. err: <nil>
Duration: 393.381556ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X................................................X..] duration:
358.682656ms
FAIL (2025-08-20 01:29:24 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 77bbb6cb22b08585db3966e1cb2e0eb4009b1f4fce90ccfa201d03dae39c559d != before b2e2e76751b1139f6044ffa2042800b96e7287f565418770a9df69829a793b3f
======LOGS======
Aug 20 01:27:46.872279426 (272h1m27.603547085s) [upload=282885]: Starting upload
Aug 20 01:27:46.872357763 (272h1m27.603625423s) [upload=282885]: Done starting upload
Aug 20 01:27:46.872431772 (272h1m27.603699422s) [upload=282885]: Uploading segments...
Aug 20 01:27:46.872792200 (272h1m27.60405985s) [upload=282885]: Got next segment. Inline: false
Aug 20 01:27:46.872837185 (272h1m27.604104835s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:27:46.872843186 (272h1m27.604110837s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:27:46.903543858 (272h1m27.634811518s) [seg_pos={0 0}, upload=282885]: Begin upload segment...
Aug 20 01:27:46.903600915 (272h1m27.634868575s) [seg_pos={0 0}, upload=282885]: Done begin upload segment.
Aug 20 01:27:46.903632023 (272h1m27.634899673s) [noise=true , address=104.36.82.13:4197 , piece_id=NIFLJVBOH6HZKIENRCE2WDXYHDBJY2PWQ3IFOAUGIAUUYBHWUEJA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.903680414 (272h1m27.634948124s) [noise=true , address=104.36.82.5:4857 , piece_id=NHZ3YRT7HDWGCZ4AAF5IQU2YUO2KY5TWKGDZ5CPCYP5D5IICODSQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.904164585 (272h1m27.635432245s) [noise=true , address=104.36.82.51:4064 , piece_id=XKAGAAHLNJVQ2LKZNSISNNXBYVSGBLUAAYT62NSZF3Q7UGFVXB7Q, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.904525374 (272h1m27.635793023s) [noise=true , address=77.90.31.17:4792 , piece_id=WL6HTNNJHEIKZCQFLHLQR3IXL25YSVK3C5UIKISU63OMKSHPEQHA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.904606506 (272h1m27.635874167s) [noise=true , address=45.91.116.6:4985 , piece_id=XGLVDSX25V2EU5YRGHMPKMOTSKK3ZPYQ7FYLIQ5QTMVNEBV2LETA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905035373 (272h1m27.636303023s) [noise=true , address=77.90.31.11:4584 , piece_id=Q5XLX3WLA6HNGDM4HMJXE4PDUDC7KS7ECPJ7C2SR7DVZQBIN2I7A, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905210382 (272h1m27.636478032s) [noise=true , address=77.90.31.18:4839 , piece_id=IQ24EFIPFZXQBSWXM27E4O7YYXO7R47UJ6H4IZNOMCOP3YRWEWVQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905455353 (272h1m27.636723003s) [noise=true , address=79.127.220.98:4425 , piece_id=QZVZPB3GLU3D6ZH7PGMZUCNB6EEDQEI5INJO4GGIKUQYKAGVY3JQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905804479 (272h1m27.637072139s) [noise=true , address=104.36.82.2:4759 , piece_id=DJWNSNCLJSGGSJ3BP4O2AHVL6ZTC4BSZDTBJIC5VNTWQDHTREDEA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905871236 (272h1m27.637138886s) [noise=true , address=45.91.116.7:4039 , piece_id=IITKMFJUGXZ6H6UVFWGOVJX7H6EDLXUDMYOC3IXTIHRZ7RR53X5Q, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906141914 (272h1m27.637409544s) [noise=true , address=45.91.116.8:4067 , piece_id=LKFQAU4N4MVI7CWBWEI7JABKFK4Z5UJCBJ746GL7GGZDPKUNBRUA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906181729 (272h1m27.637449359s) [noise=true , address=79.127.201.215:4349 , piece_id=EH5UC6MB2VCYOZBWXQQ6XBBI6V23BWAUI62PIQU42ESNZUWBJZIA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906382797 (272h1m27.637650427s) [noise=true , address=77.90.31.21:4911 , piece_id=OYOV4JH2REXRKWUKP5RTU7WQKA5A6KUYTA2ZEW3MLGM3ZYBCBCBA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906446718 (272h1m27.637714338s) [noise=true , address=104.36.82.14:4230 , piece_id=UYQZ4STKS7EOP4IMUDU3L5Z2CYUXGDG6Y2YSM3ABFR2DHC3XGAWA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906587123 (272h1m27.637854753s) [noise=true , address=104.36.82.22:4536 , piece_id=TGACXGDNMWYCD4YRQO2B5QRAPUXQUCGTC5OYDDRN6LIRXUGB7KBA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906794051 (272h1m27.638061681s) [noise=true , address=104.36.82.15:4292 , piece_id=PF63QCS5ICM3O5IA6GXK3R6QBIMGSLVOXE375MN7XUDTFLVGROTQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906803839 (272h1m27.638071469s) [noise=true , address=77.90.31.19:4849 , piece_id=SUAIYTQ77PONMJVPDP52TKJROTA2SU2J743ILG3G65AYM5OJ5E3Q, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.907070631 (272h1m27.638338251s) [noise=true , address=45.91.116.11:4143 , piece_id=Y6DQR7UXXGVMQCVD6SOBY5V567B3YBOQDOL2XP3YL7RYNRMNJ2BQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:47.039278378 (272h1m27.770546038s) [upload=282885]: Next returned nil segment
Aug 20 01:27:47.039318363 (272h1m27.770586022s) [upload=282885]: Waiting for error group managing segments...
Aug 20 01:27:47.049707395 (272h1m27.780975056s) [noise=true , address=45.91.116.11:4143 , piece_id=Y6DQR7UXXGVMQCVD6SOBY5V567B3YBOQDOL2XP3YL7RYNRMNJ2BQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.050730830 (272h1m27.78199849s) [noise=true , address=45.91.116.8:4067 , piece_id=LKFQAU4N4MVI7CWBWEI7JABKFK4Z5UJCBJ746GL7GGZDPKUNBRUA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.051496781 (272h1m27.782764432s) [noise=true , address=45.91.116.6:4985 , piece_id=XGLVDSX25V2EU5YRGHMPKMOTSKK3ZPYQ7FYLIQ5QTMVNEBV2LETA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.052107159 (272h1m27.783374809s) [noise=true , address=104.36.82.2:4759 , piece_id=DJWNSNCLJSGGSJ3BP4O2AHVL6ZTC4BSZDTBJIC5VNTWQDHTREDEA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.052658857 (272h1m27.783926517s) [noise=true , address=104.36.82.14:4230 , piece_id=UYQZ4STKS7EOP4IMUDU3L5Z2CYUXGDG6Y2YSM3ABFR2DHC3XGAWA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.052788401 (272h1m27.784056051s) [noise=true , address=104.36.82.15:4292 , piece_id=PF63QCS5ICM3O5IA6GXK3R6QBIMGSLVOXE375MN7XUDTFLVGROTQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.053500891 (272h1m27.784768541s) [noise=true , address=104.36.82.22:4536 , piece_id=TGACXGDNMWYCD4YRQO2B5QRAPUXQUCGTC5OYDDRN6LIRXUGB7KBA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.054848305 (272h1m27.786115955s) [noise=true , address=104.36.82.13:4197 , piece_id=NIFLJVBOH6HZKIENRCE2WDXYHDBJY2PWQ3IFOAUGIAUUYBHWUEJA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.056351233 (272h1m27.787618883s) [noise=true , address=104.36.82.51:4064 , piece_id=XKAGAAHLNJVQ2LKZNSISNNXBYVSGBLUAAYT62NSZF3Q7UGFVXB7Q, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.060553377 (272h1m27.791821027s) [noise=true , address=77.90.31.11:4584 , piece_id=Q5XLX3WLA6HNGDM4HMJXE4PDUDC7KS7ECPJ7C2SR7DVZQBIN2I7A, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.064482758 (272h1m27.795750409s) [noise=true , address=45.91.116.7:4039 , piece_id=IITKMFJUGXZ6H6UVFWGOVJX7H6EDLXUDMYOC3IXTIHRZ7RR53X5Q, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.064533585 (272h1m27.795801235s) [noise=true , address=77.90.31.18:4839 , piece_id=IQ24EFIPFZXQBSWXM27E4O7YYXO7R47UJ6H4IZNOMCOP3YRWEWVQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.071065051 (272h1m27.802332671s) [noise=true , address=77.90.31.19:4849 , piece_id=SUAIYTQ77PONMJVPDP52TKJROTA2SU2J743ILG3G65AYM5OJ5E3Q, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.080368170 (272h1m27.811635821s) [noise=true , address=79.127.220.98:4425 , piece_id=QZVZPB3GLU3D6ZH7PGMZUCNB6EEDQEI5INJO4GGIKUQYKAGVY3JQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.080403708 (272h1m27.811671368s) [seg_pos={0 0}, upload=282885]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:27:47.080620135 (272h1m27.811887785s) [noise=true , address=77.90.31.21:4911 , piece_id=OYOV4JH2REXRKWUKP5RTU7WQKA5A6KUYTA2ZEW3MLGM3ZYBCBCBA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF
Aug 20 01:27:47.080741352 (272h1m27.812009013s) [noise=true , address=77.90.31.17:4792 , piece_id=WL6HTNNJHEIKZCQFLHLQR3IXL25YSVK3C5UIKISU63OMKSHPEQHA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SPFgYZnbwjEupjaghfs61qwFM678KNPwpDmRNqV1j2opNgZCN): protocol: expected piece hash; context canceled; EOF
Aug 20 01:27:47.080903698 (272h1m27.812171348s) [noise=true , address=104.36.82.5:4857 , piece_id=NHZ3YRT7HDWGCZ4AAF5IQU2YUO2KY5TWKGDZ5CPCYP5D5IICODSQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 20 01:27:47.081032120 (272h1m27.81229977s) [noise=true , address=79.127.201.215:4349 , piece_id=EH5UC6MB2VCYOZBWXQQ6XBBI6V23BWAUI62PIQU42ESNZUWBJZIA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: write tcp 5.161.89.252:44672->79.127.201.215:4349: use of closed network connection; write tcp 5.161.89.252:44672->79.127.201.215:4349: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44672->79.127.201.215:4349: use of closed network connection
Aug 20 01:27:47.081085640 (272h1m27.81235329s) [seg_pos={0 0}, upload=282885]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:27:47.081205857 (272h1m27.812473517s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:27:47.081215625 (272h1m27.812483285s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:27:47.195587649 (272h1m27.926855279s) [upload=282885]: Done uploading segments...
Aug 20 01:27:47.195601846 (272h1m27.926869476s) [upload=282885]: Upload finished. err: <nil>
Duration: 358.710598ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X................................................X.] duration:
419.841229ms
FAIL (2025-08-20 01:28:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 77bbb6cb22b08585db3966e1cb2e0eb4009b1f4fce90ccfa201d03dae39c559d != before b2e2e76751b1139f6044ffa2042800b96e7287f565418770a9df69829a793b3f
======LOGS======
Aug 20 01:27:46.872279426 (272h1m27.603547085s) [upload=282885]: Starting upload
Aug 20 01:27:46.872357763 (272h1m27.603625423s) [upload=282885]: Done starting upload
Aug 20 01:27:46.872431772 (272h1m27.603699422s) [upload=282885]: Uploading segments...
Aug 20 01:27:46.872792200 (272h1m27.60405985s) [upload=282885]: Got next segment. Inline: false
Aug 20 01:27:46.872837185 (272h1m27.604104835s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:27:46.872843186 (272h1m27.604110837s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:27:46.903543858 (272h1m27.634811518s) [seg_pos={0 0}, upload=282885]: Begin upload segment...
Aug 20 01:27:46.903600915 (272h1m27.634868575s) [seg_pos={0 0}, upload=282885]: Done begin upload segment.
Aug 20 01:27:46.903632023 (272h1m27.634899673s) [noise=true , address=104.36.82.13:4197 , piece_id=NIFLJVBOH6HZKIENRCE2WDXYHDBJY2PWQ3IFOAUGIAUUYBHWUEJA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.903680414 (272h1m27.634948124s) [noise=true , address=104.36.82.5:4857 , piece_id=NHZ3YRT7HDWGCZ4AAF5IQU2YUO2KY5TWKGDZ5CPCYP5D5IICODSQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.904164585 (272h1m27.635432245s) [noise=true , address=104.36.82.51:4064 , piece_id=XKAGAAHLNJVQ2LKZNSISNNXBYVSGBLUAAYT62NSZF3Q7UGFVXB7Q, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.904525374 (272h1m27.635793023s) [noise=true , address=77.90.31.17:4792 , piece_id=WL6HTNNJHEIKZCQFLHLQR3IXL25YSVK3C5UIKISU63OMKSHPEQHA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.904606506 (272h1m27.635874167s) [noise=true , address=45.91.116.6:4985 , piece_id=XGLVDSX25V2EU5YRGHMPKMOTSKK3ZPYQ7FYLIQ5QTMVNEBV2LETA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905035373 (272h1m27.636303023s) [noise=true , address=77.90.31.11:4584 , piece_id=Q5XLX3WLA6HNGDM4HMJXE4PDUDC7KS7ECPJ7C2SR7DVZQBIN2I7A, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905210382 (272h1m27.636478032s) [noise=true , address=77.90.31.18:4839 , piece_id=IQ24EFIPFZXQBSWXM27E4O7YYXO7R47UJ6H4IZNOMCOP3YRWEWVQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905455353 (272h1m27.636723003s) [noise=true , address=79.127.220.98:4425 , piece_id=QZVZPB3GLU3D6ZH7PGMZUCNB6EEDQEI5INJO4GGIKUQYKAGVY3JQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905804479 (272h1m27.637072139s) [noise=true , address=104.36.82.2:4759 , piece_id=DJWNSNCLJSGGSJ3BP4O2AHVL6ZTC4BSZDTBJIC5VNTWQDHTREDEA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905871236 (272h1m27.637138886s) [noise=true , address=45.91.116.7:4039 , piece_id=IITKMFJUGXZ6H6UVFWGOVJX7H6EDLXUDMYOC3IXTIHRZ7RR53X5Q, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906141914 (272h1m27.637409544s) [noise=true , address=45.91.116.8:4067 , piece_id=LKFQAU4N4MVI7CWBWEI7JABKFK4Z5UJCBJ746GL7GGZDPKUNBRUA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906181729 (272h1m27.637449359s) [noise=true , address=79.127.201.215:4349 , piece_id=EH5UC6MB2VCYOZBWXQQ6XBBI6V23BWAUI62PIQU42ESNZUWBJZIA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906382797 (272h1m27.637650427s) [noise=true , address=77.90.31.21:4911 , piece_id=OYOV4JH2REXRKWUKP5RTU7WQKA5A6KUYTA2ZEW3MLGM3ZYBCBCBA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906446718 (272h1m27.637714338s) [noise=true , address=104.36.82.14:4230 , piece_id=UYQZ4STKS7EOP4IMUDU3L5Z2CYUXGDG6Y2YSM3ABFR2DHC3XGAWA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906587123 (272h1m27.637854753s) [noise=true , address=104.36.82.22:4536 , piece_id=TGACXGDNMWYCD4YRQO2B5QRAPUXQUCGTC5OYDDRN6LIRXUGB7KBA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906794051 (272h1m27.638061681s) [noise=true , address=104.36.82.15:4292 , piece_id=PF63QCS5ICM3O5IA6GXK3R6QBIMGSLVOXE375MN7XUDTFLVGROTQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906803839 (272h1m27.638071469s) [noise=true , address=77.90.31.19:4849 , piece_id=SUAIYTQ77PONMJVPDP52TKJROTA2SU2J743ILG3G65AYM5OJ5E3Q, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.907070631 (272h1m27.638338251s) [noise=true , address=45.91.116.11:4143 , piece_id=Y6DQR7UXXGVMQCVD6SOBY5V567B3YBOQDOL2XP3YL7RYNRMNJ2BQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:47.039278378 (272h1m27.770546038s) [upload=282885]: Next returned nil segment
Aug 20 01:27:47.039318363 (272h1m27.770586022s) [upload=282885]: Waiting for error group managing segments...
Aug 20 01:27:47.049707395 (272h1m27.780975056s) [noise=true , address=45.91.116.11:4143 , piece_id=Y6DQR7UXXGVMQCVD6SOBY5V567B3YBOQDOL2XP3YL7RYNRMNJ2BQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.050730830 (272h1m27.78199849s) [noise=true , address=45.91.116.8:4067 , piece_id=LKFQAU4N4MVI7CWBWEI7JABKFK4Z5UJCBJ746GL7GGZDPKUNBRUA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.051496781 (272h1m27.782764432s) [noise=true , address=45.91.116.6:4985 , piece_id=XGLVDSX25V2EU5YRGHMPKMOTSKK3ZPYQ7FYLIQ5QTMVNEBV2LETA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.052107159 (272h1m27.783374809s) [noise=true , address=104.36.82.2:4759 , piece_id=DJWNSNCLJSGGSJ3BP4O2AHVL6ZTC4BSZDTBJIC5VNTWQDHTREDEA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.052658857 (272h1m27.783926517s) [noise=true , address=104.36.82.14:4230 , piece_id=UYQZ4STKS7EOP4IMUDU3L5Z2CYUXGDG6Y2YSM3ABFR2DHC3XGAWA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.052788401 (272h1m27.784056051s) [noise=true , address=104.36.82.15:4292 , piece_id=PF63QCS5ICM3O5IA6GXK3R6QBIMGSLVOXE375MN7XUDTFLVGROTQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.053500891 (272h1m27.784768541s) [noise=true , address=104.36.82.22:4536 , piece_id=TGACXGDNMWYCD4YRQO2B5QRAPUXQUCGTC5OYDDRN6LIRXUGB7KBA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.054848305 (272h1m27.786115955s) [noise=true , address=104.36.82.13:4197 , piece_id=NIFLJVBOH6HZKIENRCE2WDXYHDBJY2PWQ3IFOAUGIAUUYBHWUEJA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.056351233 (272h1m27.787618883s) [noise=true , address=104.36.82.51:4064 , piece_id=XKAGAAHLNJVQ2LKZNSISNNXBYVSGBLUAAYT62NSZF3Q7UGFVXB7Q, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.060553377 (272h1m27.791821027s) [noise=true , address=77.90.31.11:4584 , piece_id=Q5XLX3WLA6HNGDM4HMJXE4PDUDC7KS7ECPJ7C2SR7DVZQBIN2I7A, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.064482758 (272h1m27.795750409s) [noise=true , address=45.91.116.7:4039 , piece_id=IITKMFJUGXZ6H6UVFWGOVJX7H6EDLXUDMYOC3IXTIHRZ7RR53X5Q, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.064533585 (272h1m27.795801235s) [noise=true , address=77.90.31.18:4839 , piece_id=IQ24EFIPFZXQBSWXM27E4O7YYXO7R47UJ6H4IZNOMCOP3YRWEWVQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.071065051 (272h1m27.802332671s) [noise=true , address=77.90.31.19:4849 , piece_id=SUAIYTQ77PONMJVPDP52TKJROTA2SU2J743ILG3G65AYM5OJ5E3Q, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.080368170 (272h1m27.811635821s) [noise=true , address=79.127.220.98:4425 , piece_id=QZVZPB3GLU3D6ZH7PGMZUCNB6EEDQEI5INJO4GGIKUQYKAGVY3JQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.080403708 (272h1m27.811671368s) [seg_pos={0 0}, upload=282885]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:27:47.080620135 (272h1m27.811887785s) [noise=true , address=77.90.31.21:4911 , piece_id=OYOV4JH2REXRKWUKP5RTU7WQKA5A6KUYTA2ZEW3MLGM3ZYBCBCBA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF
Aug 20 01:27:47.080741352 (272h1m27.812009013s) [noise=true , address=77.90.31.17:4792 , piece_id=WL6HTNNJHEIKZCQFLHLQR3IXL25YSVK3C5UIKISU63OMKSHPEQHA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SPFgYZnbwjEupjaghfs61qwFM678KNPwpDmRNqV1j2opNgZCN): protocol: expected piece hash; context canceled; EOF
Aug 20 01:27:47.080903698 (272h1m27.812171348s) [noise=true , address=104.36.82.5:4857 , piece_id=NHZ3YRT7HDWGCZ4AAF5IQU2YUO2KY5TWKGDZ5CPCYP5D5IICODSQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 20 01:27:47.081032120 (272h1m27.81229977s) [noise=true , address=79.127.201.215:4349 , piece_id=EH5UC6MB2VCYOZBWXQQ6XBBI6V23BWAUI62PIQU42ESNZUWBJZIA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: write tcp 5.161.89.252:44672->79.127.201.215:4349: use of closed network connection; write tcp 5.161.89.252:44672->79.127.201.215:4349: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44672->79.127.201.215:4349: use of closed network connection
Aug 20 01:27:47.081085640 (272h1m27.81235329s) [seg_pos={0 0}, upload=282885]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:27:47.081205857 (272h1m27.812473517s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:27:47.081215625 (272h1m27.812483285s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:27:47.195587649 (272h1m27.926855279s) [upload=282885]: Done uploading segments...
Aug 20 01:27:47.195601846 (272h1m27.926869476s) [upload=282885]: Upload finished. err: <nil>
Duration: 419.858652ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X................................................X] duration:
511.884173ms
FAIL (2025-08-20 01:27:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 77bbb6cb22b08585db3966e1cb2e0eb4009b1f4fce90ccfa201d03dae39c559d != before b2e2e76751b1139f6044ffa2042800b96e7287f565418770a9df69829a793b3f
======LOGS======
Aug 20 01:27:46.872279426 (272h1m27.603547085s) [upload=282885]: Starting upload
Aug 20 01:27:46.872357763 (272h1m27.603625423s) [upload=282885]: Done starting upload
Aug 20 01:27:46.872431772 (272h1m27.603699422s) [upload=282885]: Uploading segments...
Aug 20 01:27:46.872792200 (272h1m27.60405985s) [upload=282885]: Got next segment. Inline: false
Aug 20 01:27:46.872837185 (272h1m27.604104835s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 01:27:46.872843186 (272h1m27.604110837s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 01:27:46.903543858 (272h1m27.634811518s) [seg_pos={0 0}, upload=282885]: Begin upload segment...
Aug 20 01:27:46.903600915 (272h1m27.634868575s) [seg_pos={0 0}, upload=282885]: Done begin upload segment.
Aug 20 01:27:46.903632023 (272h1m27.634899673s) [noise=true , address=104.36.82.13:4197 , piece_id=NIFLJVBOH6HZKIENRCE2WDXYHDBJY2PWQ3IFOAUGIAUUYBHWUEJA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.903680414 (272h1m27.634948124s) [noise=true , address=104.36.82.5:4857 , piece_id=NHZ3YRT7HDWGCZ4AAF5IQU2YUO2KY5TWKGDZ5CPCYP5D5IICODSQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.904164585 (272h1m27.635432245s) [noise=true , address=104.36.82.51:4064 , piece_id=XKAGAAHLNJVQ2LKZNSISNNXBYVSGBLUAAYT62NSZF3Q7UGFVXB7Q, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.904525374 (272h1m27.635793023s) [noise=true , address=77.90.31.17:4792 , piece_id=WL6HTNNJHEIKZCQFLHLQR3IXL25YSVK3C5UIKISU63OMKSHPEQHA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.904606506 (272h1m27.635874167s) [noise=true , address=45.91.116.6:4985 , piece_id=XGLVDSX25V2EU5YRGHMPKMOTSKK3ZPYQ7FYLIQ5QTMVNEBV2LETA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905035373 (272h1m27.636303023s) [noise=true , address=77.90.31.11:4584 , piece_id=Q5XLX3WLA6HNGDM4HMJXE4PDUDC7KS7ECPJ7C2SR7DVZQBIN2I7A, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905210382 (272h1m27.636478032s) [noise=true , address=77.90.31.18:4839 , piece_id=IQ24EFIPFZXQBSWXM27E4O7YYXO7R47UJ6H4IZNOMCOP3YRWEWVQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905455353 (272h1m27.636723003s) [noise=true , address=79.127.220.98:4425 , piece_id=QZVZPB3GLU3D6ZH7PGMZUCNB6EEDQEI5INJO4GGIKUQYKAGVY3JQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905804479 (272h1m27.637072139s) [noise=true , address=104.36.82.2:4759 , piece_id=DJWNSNCLJSGGSJ3BP4O2AHVL6ZTC4BSZDTBJIC5VNTWQDHTREDEA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.905871236 (272h1m27.637138886s) [noise=true , address=45.91.116.7:4039 , piece_id=IITKMFJUGXZ6H6UVFWGOVJX7H6EDLXUDMYOC3IXTIHRZ7RR53X5Q, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906141914 (272h1m27.637409544s) [noise=true , address=45.91.116.8:4067 , piece_id=LKFQAU4N4MVI7CWBWEI7JABKFK4Z5UJCBJ746GL7GGZDPKUNBRUA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906181729 (272h1m27.637449359s) [noise=true , address=79.127.201.215:4349 , piece_id=EH5UC6MB2VCYOZBWXQQ6XBBI6V23BWAUI62PIQU42ESNZUWBJZIA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906382797 (272h1m27.637650427s) [noise=true , address=77.90.31.21:4911 , piece_id=OYOV4JH2REXRKWUKP5RTU7WQKA5A6KUYTA2ZEW3MLGM3ZYBCBCBA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906446718 (272h1m27.637714338s) [noise=true , address=104.36.82.14:4230 , piece_id=UYQZ4STKS7EOP4IMUDU3L5Z2CYUXGDG6Y2YSM3ABFR2DHC3XGAWA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906587123 (272h1m27.637854753s) [noise=true , address=104.36.82.22:4536 , piece_id=TGACXGDNMWYCD4YRQO2B5QRAPUXQUCGTC5OYDDRN6LIRXUGB7KBA, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906794051 (272h1m27.638061681s) [noise=true , address=104.36.82.15:4292 , piece_id=PF63QCS5ICM3O5IA6GXK3R6QBIMGSLVOXE375MN7XUDTFLVGROTQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.906803839 (272h1m27.638071469s) [noise=true , address=77.90.31.19:4849 , piece_id=SUAIYTQ77PONMJVPDP52TKJROTA2SU2J743ILG3G65AYM5OJ5E3Q, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:46.907070631 (272h1m27.638338251s) [noise=true , address=45.91.116.11:4143 , piece_id=Y6DQR7UXXGVMQCVD6SOBY5V567B3YBOQDOL2XP3YL7RYNRMNJ2BQ, seg_pos={0 0}, upload=282885]: Uploading piece...
Aug 20 01:27:47.039278378 (272h1m27.770546038s) [upload=282885]: Next returned nil segment
Aug 20 01:27:47.039318363 (272h1m27.770586022s) [upload=282885]: Waiting for error group managing segments...
Aug 20 01:27:47.049707395 (272h1m27.780975056s) [noise=true , address=45.91.116.11:4143 , piece_id=Y6DQR7UXXGVMQCVD6SOBY5V567B3YBOQDOL2XP3YL7RYNRMNJ2BQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.050730830 (272h1m27.78199849s) [noise=true , address=45.91.116.8:4067 , piece_id=LKFQAU4N4MVI7CWBWEI7JABKFK4Z5UJCBJ746GL7GGZDPKUNBRUA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.051496781 (272h1m27.782764432s) [noise=true , address=45.91.116.6:4985 , piece_id=XGLVDSX25V2EU5YRGHMPKMOTSKK3ZPYQ7FYLIQ5QTMVNEBV2LETA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.052107159 (272h1m27.783374809s) [noise=true , address=104.36.82.2:4759 , piece_id=DJWNSNCLJSGGSJ3BP4O2AHVL6ZTC4BSZDTBJIC5VNTWQDHTREDEA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.052658857 (272h1m27.783926517s) [noise=true , address=104.36.82.14:4230 , piece_id=UYQZ4STKS7EOP4IMUDU3L5Z2CYUXGDG6Y2YSM3ABFR2DHC3XGAWA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.052788401 (272h1m27.784056051s) [noise=true , address=104.36.82.15:4292 , piece_id=PF63QCS5ICM3O5IA6GXK3R6QBIMGSLVOXE375MN7XUDTFLVGROTQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.053500891 (272h1m27.784768541s) [noise=true , address=104.36.82.22:4536 , piece_id=TGACXGDNMWYCD4YRQO2B5QRAPUXQUCGTC5OYDDRN6LIRXUGB7KBA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.054848305 (272h1m27.786115955s) [noise=true , address=104.36.82.13:4197 , piece_id=NIFLJVBOH6HZKIENRCE2WDXYHDBJY2PWQ3IFOAUGIAUUYBHWUEJA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.056351233 (272h1m27.787618883s) [noise=true , address=104.36.82.51:4064 , piece_id=XKAGAAHLNJVQ2LKZNSISNNXBYVSGBLUAAYT62NSZF3Q7UGFVXB7Q, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.060553377 (272h1m27.791821027s) [noise=true , address=77.90.31.11:4584 , piece_id=Q5XLX3WLA6HNGDM4HMJXE4PDUDC7KS7ECPJ7C2SR7DVZQBIN2I7A, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.064482758 (272h1m27.795750409s) [noise=true , address=45.91.116.7:4039 , piece_id=IITKMFJUGXZ6H6UVFWGOVJX7H6EDLXUDMYOC3IXTIHRZ7RR53X5Q, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.064533585 (272h1m27.795801235s) [noise=true , address=77.90.31.18:4839 , piece_id=IQ24EFIPFZXQBSWXM27E4O7YYXO7R47UJ6H4IZNOMCOP3YRWEWVQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.071065051 (272h1m27.802332671s) [noise=true , address=77.90.31.19:4849 , piece_id=SUAIYTQ77PONMJVPDP52TKJROTA2SU2J743ILG3G65AYM5OJ5E3Q, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.080368170 (272h1m27.811635821s) [noise=true , address=79.127.220.98:4425 , piece_id=QZVZPB3GLU3D6ZH7PGMZUCNB6EEDQEI5INJO4GGIKUQYKAGVY3JQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: <nil>
Aug 20 01:27:47.080403708 (272h1m27.811671368s) [seg_pos={0 0}, upload=282885]: Segment reached optimal threshold of 14 pieces.
Aug 20 01:27:47.080620135 (272h1m27.811887785s) [noise=true , address=77.90.31.21:4911 , piece_id=OYOV4JH2REXRKWUKP5RTU7WQKA5A6KUYTA2ZEW3MLGM3ZYBCBCBA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf): protocol: expected piece hash; context canceled; EOF
Aug 20 01:27:47.080741352 (272h1m27.812009013s) [noise=true , address=77.90.31.17:4792 , piece_id=WL6HTNNJHEIKZCQFLHLQR3IXL25YSVK3C5UIKISU63OMKSHPEQHA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SPFgYZnbwjEupjaghfs61qwFM678KNPwpDmRNqV1j2opNgZCN): protocol: expected piece hash; context canceled; EOF
Aug 20 01:27:47.080903698 (272h1m27.812171348s) [noise=true , address=104.36.82.5:4857 , piece_id=NHZ3YRT7HDWGCZ4AAF5IQU2YUO2KY5TWKGDZ5CPCYP5D5IICODSQ, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 20 01:27:47.081032120 (272h1m27.81229977s) [noise=true , address=79.127.201.215:4349 , piece_id=EH5UC6MB2VCYOZBWXQQ6XBBI6V23BWAUI62PIQU42ESNZUWBJZIA, seg_pos={0 0}, upload=282885]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1y1KYQJsvbNxfySU7mXySUmJtEDVAE7fst1XVRHU5N8Txmjn5T): protocol: write tcp 5.161.89.252:44672->79.127.201.215:4349: use of closed network connection; write tcp 5.161.89.252:44672->79.127.201.215:4349: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44672->79.127.201.215:4349: use of closed network connection
Aug 20 01:27:47.081085640 (272h1m27.81235329s) [seg_pos={0 0}, upload=282885]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 01:27:47.081205857 (272h1m27.812473517s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 01:27:47.081215625 (272h1m27.812483285s) [upload=282885]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 01:27:47.195587649 (272h1m27.926855279s) [upload=282885]: Done uploading segments...
Aug 20 01:27:47.195601846 (272h1m27.926869476s) [upload=282885]: Upload finished. err: <nil>
Duration: 511.910233ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
357.061418ms
FAIL (2025-08-20 01:27:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 357.108576ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
460.63008ms
FAIL (2025-08-20 01:26:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 460.649336ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
350.304989ms
FAIL (2025-08-20 01:25:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 350.326539ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
388.864332ms
FAIL (2025-08-20 01:24:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 388.888628ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
342.82106ms
FAIL (2025-08-20 01:24:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 342.845666ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
496.378746ms
FAIL (2025-08-20 01:23:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 496.403352ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
247.53083ms
FAIL (2025-08-20 01:23:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 247.558543ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
159.179061ms
FAIL (2025-08-20 01:23:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 159.295049ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
603.278738ms
FAIL (2025-08-20 01:23:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 603.297963ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
338.059273ms
FAIL (2025-08-20 01:22:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 338.087366ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
134.367417ms
FAIL (2025-08-20 01:22:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 134.391373ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
308.4158ms
FAIL (2025-08-20 01:22:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 308.438554ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
186.232783ms
FAIL (2025-08-20 01:22:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 186.249144ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
429.451772ms
FAIL (2025-08-20 01:21:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 429.490545ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
407.621116ms
FAIL (2025-08-20 01:21:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 407.647495ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
157.119428ms
FAIL (2025-08-20 01:21:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 157.140328ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
444.423323ms
FAIL (2025-08-20 01:21:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 444.44786ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
132.861104ms
FAIL (2025-08-20 01:20:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 132.883105ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
435.070291ms
FAIL (2025-08-20 01:19:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 435.101851ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
157.997579ms
FAIL (2025-08-20 01:19:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 158.020491ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
425.238858ms
FAIL (2025-08-20 01:18:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 425.262703ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
241.199299ms
FAIL (2025-08-20 01:18:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 241.227242ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
393.808813ms
FAIL (2025-08-20 01:18:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 393.837848ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
183.670773ms
FAIL (2025-08-20 01:18:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 183.691671ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
433.426368ms
FAIL (2025-08-20 01:17:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 433.445754ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
164.657026ms
FAIL (2025-08-20 01:16:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 164.679179ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.224555335s
FAIL (2025-08-20 01:16:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.224585894s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
299.588947ms
FAIL (2025-08-20 01:16:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 300.118442ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
415.869493ms
FAIL (2025-08-20 01:15:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 415.924287ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
350.945824ms
FAIL (2025-08-20 01:15:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 350.966512ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
164.065686ms
FAIL (2025-08-20 01:15:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 164.091974ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
325.40089ms
FAIL (2025-08-20 01:14:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 325.424855ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X..............X............................................] duration:
200.495922ms
FAIL (2025-08-20 01:14:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 200.523153ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
342.795091ms
FAIL (2025-08-20 01:13:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 342.821462ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X..............X...........................................] duration:
157.90281ms
FAIL (2025-08-20 01:13:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 157.927226ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X..............X..........................................] duration:
317.833037ms
FAIL (2025-08-20 01:12:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 317.851811ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
342.571651ms
FAIL (2025-08-20 01:12:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 342.597269ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X..............X.........................................] duration:
289.507561ms
FAIL (2025-08-20 01:12:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 289.527839ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
651.509603ms
FAIL (2025-08-20 01:12:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 651.532626ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
342.428263ms
FAIL (2025-08-20 01:11:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 342.459772ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X..............X........................................] duration:
343.801469ms
FAIL (2025-08-20 01:11:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 343.820435ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X..............X.......................................] duration:
145.238048ms
FAIL (2025-08-20 01:10:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 145.264487ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
387.492785ms
FAIL (2025-08-20 01:10:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 387.51703ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
548.290201ms
FAIL (2025-08-20 01:10:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 548.336708ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X..............X......................................] duration:
463.508037ms
FAIL (2025-08-20 01:09:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 463.526722ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|