Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................................X.................X.......X.] duration:
730.52154ms
FAIL (2025-08-08 21:23:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 8 21:22:38.516901984 (3h56m19.248169614s) [upload=4068]: Starting upload
Aug 8 21:22:38.516951748 (3h56m19.248219368s) [upload=4068]: Done starting upload
Aug 8 21:22:38.517040233 (3h56m19.248307863s) [upload=4068]: Uploading segments...
Aug 8 21:22:38.517278869 (3h56m19.248546488s) [upload=4068]: Got next segment. Inline: false
Aug 8 21:22:38.517363546 (3h56m19.248631166s) [upload=4068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 21:22:38.517369407 (3h56m19.248637027s) [upload=4068]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 21:22:38.556721712 (3h56m19.287989332s) [seg_pos={0 0}, upload=4068]: Begin upload segment...
Aug 8 21:22:38.556771475 (3h56m19.288039095s) [seg_pos={0 0}, upload=4068]: Done begin upload segment.
Aug 8 21:22:38.556792364 (3h56m19.288059994s) [noise=true , address=64.49.13.170:4718 , piece_id=CBZ67QFTKMAZ7DBVEVTKESTKUUZT7TMZ5ZGRPUW2WGNV6HAX26KQ, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.556820517 (3h56m19.288088147s) [noise=true , address=77.90.31.18:4834 , piece_id=D34ZTAJE3TALILKKB55KJVBZBFE64HE77ANG5LHCS3DB4IRSMOVA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.557159750 (3h56m19.28842737s) [noise=true , address=104.36.82.12:4165 , piece_id=EACDWFNND3BSYVW5VZFTAMM7GN4NRI2FXOC6D3VSE2YH6A3BK6KQ, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.557238757 (3h56m19.288506377s) [noise=true , address=104.36.82.8:4981 , piece_id=HFQNV5Z23LHCQMTZGIO5CQLB633MRKSF3XYE62HE62UK3GWIFE7Q, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.557402203 (3h56m19.288669822s) [noise=true , address=104.36.82.4:4813 , piece_id=PZJVF6UZCBH6GR5L25ZE5EY6R7G2STLX5Y4PY7HKRHQII7DRVTGA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.557479747 (3h56m19.288747377s) [noise=true , address=45.91.116.14:4218 , piece_id=QGSWH26BSNTI26KWANLYXYWFF4LLTGY7IYLQ3ZTF2PWT2JTLUITQ, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.557622554 (3h56m19.288890174s) [noise=true , address=104.36.82.14:4229 , piece_id=KYHWFVKDKVMXFDN7J3S2L5DWWJLA43JZ5DLPWYBQAOZLQFRXQYKA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.557703695 (3h56m19.288971315s) [noise=true , address=104.36.82.43:4836 , piece_id=BE5VNX5N3LSHZWO5AXVR4AVWCDJDPIQNIVMSB4MSB4FU3FP2YFSA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.557835882 (3h56m19.289103512s) [noise=true , address=104.36.82.17:4352 , piece_id=S3ZK7M5TQX26DUHZX3VJCWNBQEDFA2MYVYEZW4WM44YDMIOYGPDQ, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.557915220 (3h56m19.28918285s) [noise=true , address=104.36.82.58:4298 , piece_id=L23UFZ4B2F2R5TPVMTMNMSBXSO6FHBJ4A5THHSA4TPXUAJGGEV2Q, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.558099024 (3h56m19.289366643s) [noise=true , address=45.91.116.13:4168 , piece_id=YDB3XZ4PRIFEHMJTAM4LDO2VD4PTH3UM436LGXLBD4W6VL5E4R5A, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.558205823 (3h56m19.289473453s) [noise=true , address=104.36.82.60:4338 , piece_id=FETAFGG4FJURTVWBQ6IJ2F4FZDP7VFFUJDTESIBY62ME2SOBYEOA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.558323603 (3h56m19.289591222s) [noise=true , address=45.91.116.12:4234 , piece_id=2CW2NIQHHUSA6XTIHEJGHFHMOBPGB3PPQV23IOXDDDCUSHJQCDXA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.558552430 (3h56m19.28982005s) [noise=true , address=104.36.82.5:4847 , piece_id=UGVZPH3NE4ZGM4M653W2ND2T4TL4J463NAZADEAAVEZTS3QFJIIA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.558826651 (3h56m19.290094271s) [noise=true , address=104.36.82.59:4304 , piece_id=VF6F7JH6O7NPKSC7FOGVJ5SHPHNYMT6ZFYQEEVFK4QOKC7RR4MUA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.559038457 (3h56m19.290306087s) [noise=true , address=104.36.82.53:4148 , piece_id=27RCPALJGVBTBI2RIIHIJMQED2ITI4KCTAHCYA62FVOINZYWPRXQ, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.559307058 (3h56m19.290574688s) [noise=true , address=104.36.82.45:4931 , piece_id=PAIVXEI4WR4ZT47PAVHDDUL2PKJD5I4HUU4YTVUMCLDFCWNS3NCA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.559522791 (3h56m19.290790411s) [noise=true , address=104.36.82.16:4305 , piece_id=5I2PZPCEPLKZWM54JW7BSRCNZQASQSBXVNJHCOBCWYFETO3VU3GA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.650687071 (3h56m19.381954701s) [upload=4068]: Next returned nil segment
Aug 8 21:22:38.650698713 (3h56m19.381966332s) [upload=4068]: Waiting for error group managing segments...
Aug 8 21:22:38.664106440 (3h56m19.39537407s) [noise=true , address=104.36.82.16:4305 , piece_id=5I2PZPCEPLKZWM54JW7BSRCNZQASQSBXVNJHCOBCWYFETO3VU3GA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.664643463 (3h56m19.395911093s) [noise=true , address=104.36.82.14:4229 , piece_id=KYHWFVKDKVMXFDN7J3S2L5DWWJLA43JZ5DLPWYBQAOZLQFRXQYKA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.670400870 (3h56m19.4016685s) [noise=true , address=45.91.116.14:4218 , piece_id=QGSWH26BSNTI26KWANLYXYWFF4LLTGY7IYLQ3ZTF2PWT2JTLUITQ, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.671872646 (3h56m19.403140266s) [noise=true , address=104.36.82.4:4813 , piece_id=PZJVF6UZCBH6GR5L25ZE5EY6R7G2STLX5Y4PY7HKRHQII7DRVTGA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.674452232 (3h56m19.405719862s) [noise=true , address=104.36.82.17:4352 , piece_id=S3ZK7M5TQX26DUHZX3VJCWNBQEDFA2MYVYEZW4WM44YDMIOYGPDQ, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.675036542 (3h56m19.406304172s) [noise=true , address=104.36.82.59:4304 , piece_id=VF6F7JH6O7NPKSC7FOGVJ5SHPHNYMT6ZFYQEEVFK4QOKC7RR4MUA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.682074480 (3h56m19.4133421s) [noise=true , address=104.36.82.53:4148 , piece_id=27RCPALJGVBTBI2RIIHIJMQED2ITI4KCTAHCYA62FVOINZYWPRXQ, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.693930480 (3h56m19.42519811s) [noise=true , address=104.36.82.60:4338 , piece_id=FETAFGG4FJURTVWBQ6IJ2F4FZDP7VFFUJDTESIBY62ME2SOBYEOA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.695171216 (3h56m19.426438836s) [noise=true , address=45.91.116.13:4168 , piece_id=YDB3XZ4PRIFEHMJTAM4LDO2VD4PTH3UM436LGXLBD4W6VL5E4R5A, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.697299559 (3h56m19.428567189s) [noise=true , address=45.91.116.12:4234 , piece_id=2CW2NIQHHUSA6XTIHEJGHFHMOBPGB3PPQV23IOXDDDCUSHJQCDXA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.707699652 (3h56m19.438967282s) [noise=true , address=104.36.82.12:4165 , piece_id=EACDWFNND3BSYVW5VZFTAMM7GN4NRI2FXOC6D3VSE2YH6A3BK6KQ, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.720948873 (3h56m19.452216524s) [noise=true , address=104.36.82.8:4981 , piece_id=HFQNV5Z23LHCQMTZGIO5CQLB633MRKSF3XYE62HE62UK3GWIFE7Q, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.724178793 (3h56m19.455446423s) [noise=true , address=77.90.31.18:4834 , piece_id=D34ZTAJE3TALILKKB55KJVBZBFE64HE77ANG5LHCS3DB4IRSMOVA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.805734857 (3h56m19.537002507s) [noise=true , address=104.36.82.58:4298 , piece_id=L23UFZ4B2F2R5TPVMTMNMSBXSO6FHBJ4A5THHSA4TPXUAJGGEV2Q, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.805776806 (3h56m19.537044456s) [seg_pos={0 0}, upload=4068]: Segment reached optimal threshold of 14 pieces.
Aug 8 21:22:38.805979223 (3h56m19.537246874s) [noise=true , address=104.36.82.5:4847 , piece_id=UGVZPH3NE4ZGM4M653W2ND2T4TL4J463NAZADEAAVEZTS3QFJIIA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i): protocol: expected piece hash; context canceled; EOF
Aug 8 21:22:38.806105409 (3h56m19.537373039s) [noise=true , address=104.36.82.45:4931 , piece_id=PAIVXEI4WR4ZT47PAVHDDUL2PKJD5I4HUU4YTVUMCLDFCWNS3NCA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pCgoSfxjtXPw5jpbz9RJaxRiGoYPdPFdoMPtD19F1ZWY8UwPu): protocol: read tcp 5.161.89.252:23260->104.36.82.45:4931: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 8 21:22:38.806340719 (3h56m19.537608349s) [noise=true , address=104.36.82.43:4836 , piece_id=BE5VNX5N3LSHZWO5AXVR4AVWCDJDPIQNIVMSB4MSB4FU3FP2YFSA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR): protocol: read tcp 5.161.89.252:38568->104.36.82.43:4836: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 8 21:22:38.806425847 (3h56m19.537693508s) [noise=true , address=64.49.13.170:4718 , piece_id=CBZ67QFTKMAZ7DBVEVTKESTKUUZT7TMZ5ZGRPUW2WGNV6HAX26KQ, seg_pos={0 0}, upload=4068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AcLsSmVz9sRtuDLs47WoWYC66YSbr2aXBjzBdjayg22daQ2Hp): protocol: read tcp 5.161.89.252:22306->64.49.13.170:4718: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 8 21:22:38.806466142 (3h56m19.537733813s) [seg_pos={0 0}, upload=4068]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 21:22:38.806633053 (3h56m19.537900714s) [upload=4068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 21:22:38.806643103 (3h56m19.537910753s) [upload=4068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 21:22:38.897079143 (3h56m19.628346783s) [upload=4068]: Done uploading segments...
Aug 8 21:22:38.897095393 (3h56m19.628363034s) [upload=4068]: Upload finished. err: <nil>
Duration: 730.53785ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
160.572199ms
FAIL (2025-08-08 21:23:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:12:57.906843879 (3h46m38.638111529s) [upload=3897]: Starting upload Aug 8 21:12:57.906905814 (3h46m38.638173464s) [upload=3897]: Done starting upload Aug 8 21:12:57.906985183 (3h46m38.638252833s) [upload=3897]: Uploading segments... Aug 8 21:12:57.907053260 (3h46m38.63832091s) [upload=3897]: Got next segment. Inline: true Aug 8 21:12:57.907059221 (3h46m38.638326871s) [upload=3897]: Waiting for error group managing segments... Aug 8 21:12:57.907103575 (3h46m38.638371224s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:12:57.907109035 (3h46m38.638376684s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 21:12:57.907112630 (3h46m38.63838028s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 21:12:57.909562895 (3h46m38.640830545s) [upload=3897]: Done uploading segments... Aug 8 21:12:57.909575448 (3h46m38.640843099s) [upload=3897]: Upload finished. err: metaclient: Too Many Requests
Duration: 160.606471ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................................X.................X.......X] duration:
459.709697ms
FAIL (2025-08-08 21:22:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 8 21:22:38.516901984 (3h56m19.248169614s) [upload=4068]: Starting upload
Aug 8 21:22:38.516951748 (3h56m19.248219368s) [upload=4068]: Done starting upload
Aug 8 21:22:38.517040233 (3h56m19.248307863s) [upload=4068]: Uploading segments...
Aug 8 21:22:38.517278869 (3h56m19.248546488s) [upload=4068]: Got next segment. Inline: false
Aug 8 21:22:38.517363546 (3h56m19.248631166s) [upload=4068]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 21:22:38.517369407 (3h56m19.248637027s) [upload=4068]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 21:22:38.556721712 (3h56m19.287989332s) [seg_pos={0 0}, upload=4068]: Begin upload segment...
Aug 8 21:22:38.556771475 (3h56m19.288039095s) [seg_pos={0 0}, upload=4068]: Done begin upload segment.
Aug 8 21:22:38.556792364 (3h56m19.288059994s) [noise=true , address=64.49.13.170:4718 , piece_id=CBZ67QFTKMAZ7DBVEVTKESTKUUZT7TMZ5ZGRPUW2WGNV6HAX26KQ, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.556820517 (3h56m19.288088147s) [noise=true , address=77.90.31.18:4834 , piece_id=D34ZTAJE3TALILKKB55KJVBZBFE64HE77ANG5LHCS3DB4IRSMOVA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.557159750 (3h56m19.28842737s) [noise=true , address=104.36.82.12:4165 , piece_id=EACDWFNND3BSYVW5VZFTAMM7GN4NRI2FXOC6D3VSE2YH6A3BK6KQ, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.557238757 (3h56m19.288506377s) [noise=true , address=104.36.82.8:4981 , piece_id=HFQNV5Z23LHCQMTZGIO5CQLB633MRKSF3XYE62HE62UK3GWIFE7Q, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.557402203 (3h56m19.288669822s) [noise=true , address=104.36.82.4:4813 , piece_id=PZJVF6UZCBH6GR5L25ZE5EY6R7G2STLX5Y4PY7HKRHQII7DRVTGA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.557479747 (3h56m19.288747377s) [noise=true , address=45.91.116.14:4218 , piece_id=QGSWH26BSNTI26KWANLYXYWFF4LLTGY7IYLQ3ZTF2PWT2JTLUITQ, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.557622554 (3h56m19.288890174s) [noise=true , address=104.36.82.14:4229 , piece_id=KYHWFVKDKVMXFDN7J3S2L5DWWJLA43JZ5DLPWYBQAOZLQFRXQYKA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.557703695 (3h56m19.288971315s) [noise=true , address=104.36.82.43:4836 , piece_id=BE5VNX5N3LSHZWO5AXVR4AVWCDJDPIQNIVMSB4MSB4FU3FP2YFSA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.557835882 (3h56m19.289103512s) [noise=true , address=104.36.82.17:4352 , piece_id=S3ZK7M5TQX26DUHZX3VJCWNBQEDFA2MYVYEZW4WM44YDMIOYGPDQ, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.557915220 (3h56m19.28918285s) [noise=true , address=104.36.82.58:4298 , piece_id=L23UFZ4B2F2R5TPVMTMNMSBXSO6FHBJ4A5THHSA4TPXUAJGGEV2Q, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.558099024 (3h56m19.289366643s) [noise=true , address=45.91.116.13:4168 , piece_id=YDB3XZ4PRIFEHMJTAM4LDO2VD4PTH3UM436LGXLBD4W6VL5E4R5A, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.558205823 (3h56m19.289473453s) [noise=true , address=104.36.82.60:4338 , piece_id=FETAFGG4FJURTVWBQ6IJ2F4FZDP7VFFUJDTESIBY62ME2SOBYEOA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.558323603 (3h56m19.289591222s) [noise=true , address=45.91.116.12:4234 , piece_id=2CW2NIQHHUSA6XTIHEJGHFHMOBPGB3PPQV23IOXDDDCUSHJQCDXA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.558552430 (3h56m19.28982005s) [noise=true , address=104.36.82.5:4847 , piece_id=UGVZPH3NE4ZGM4M653W2ND2T4TL4J463NAZADEAAVEZTS3QFJIIA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.558826651 (3h56m19.290094271s) [noise=true , address=104.36.82.59:4304 , piece_id=VF6F7JH6O7NPKSC7FOGVJ5SHPHNYMT6ZFYQEEVFK4QOKC7RR4MUA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.559038457 (3h56m19.290306087s) [noise=true , address=104.36.82.53:4148 , piece_id=27RCPALJGVBTBI2RIIHIJMQED2ITI4KCTAHCYA62FVOINZYWPRXQ, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.559307058 (3h56m19.290574688s) [noise=true , address=104.36.82.45:4931 , piece_id=PAIVXEI4WR4ZT47PAVHDDUL2PKJD5I4HUU4YTVUMCLDFCWNS3NCA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.559522791 (3h56m19.290790411s) [noise=true , address=104.36.82.16:4305 , piece_id=5I2PZPCEPLKZWM54JW7BSRCNZQASQSBXVNJHCOBCWYFETO3VU3GA, seg_pos={0 0}, upload=4068]: Uploading piece...
Aug 8 21:22:38.650687071 (3h56m19.381954701s) [upload=4068]: Next returned nil segment
Aug 8 21:22:38.650698713 (3h56m19.381966332s) [upload=4068]: Waiting for error group managing segments...
Aug 8 21:22:38.664106440 (3h56m19.39537407s) [noise=true , address=104.36.82.16:4305 , piece_id=5I2PZPCEPLKZWM54JW7BSRCNZQASQSBXVNJHCOBCWYFETO3VU3GA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.664643463 (3h56m19.395911093s) [noise=true , address=104.36.82.14:4229 , piece_id=KYHWFVKDKVMXFDN7J3S2L5DWWJLA43JZ5DLPWYBQAOZLQFRXQYKA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.670400870 (3h56m19.4016685s) [noise=true , address=45.91.116.14:4218 , piece_id=QGSWH26BSNTI26KWANLYXYWFF4LLTGY7IYLQ3ZTF2PWT2JTLUITQ, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.671872646 (3h56m19.403140266s) [noise=true , address=104.36.82.4:4813 , piece_id=PZJVF6UZCBH6GR5L25ZE5EY6R7G2STLX5Y4PY7HKRHQII7DRVTGA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.674452232 (3h56m19.405719862s) [noise=true , address=104.36.82.17:4352 , piece_id=S3ZK7M5TQX26DUHZX3VJCWNBQEDFA2MYVYEZW4WM44YDMIOYGPDQ, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.675036542 (3h56m19.406304172s) [noise=true , address=104.36.82.59:4304 , piece_id=VF6F7JH6O7NPKSC7FOGVJ5SHPHNYMT6ZFYQEEVFK4QOKC7RR4MUA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.682074480 (3h56m19.4133421s) [noise=true , address=104.36.82.53:4148 , piece_id=27RCPALJGVBTBI2RIIHIJMQED2ITI4KCTAHCYA62FVOINZYWPRXQ, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.693930480 (3h56m19.42519811s) [noise=true , address=104.36.82.60:4338 , piece_id=FETAFGG4FJURTVWBQ6IJ2F4FZDP7VFFUJDTESIBY62ME2SOBYEOA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.695171216 (3h56m19.426438836s) [noise=true , address=45.91.116.13:4168 , piece_id=YDB3XZ4PRIFEHMJTAM4LDO2VD4PTH3UM436LGXLBD4W6VL5E4R5A, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.697299559 (3h56m19.428567189s) [noise=true , address=45.91.116.12:4234 , piece_id=2CW2NIQHHUSA6XTIHEJGHFHMOBPGB3PPQV23IOXDDDCUSHJQCDXA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.707699652 (3h56m19.438967282s) [noise=true , address=104.36.82.12:4165 , piece_id=EACDWFNND3BSYVW5VZFTAMM7GN4NRI2FXOC6D3VSE2YH6A3BK6KQ, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.720948873 (3h56m19.452216524s) [noise=true , address=104.36.82.8:4981 , piece_id=HFQNV5Z23LHCQMTZGIO5CQLB633MRKSF3XYE62HE62UK3GWIFE7Q, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.724178793 (3h56m19.455446423s) [noise=true , address=77.90.31.18:4834 , piece_id=D34ZTAJE3TALILKKB55KJVBZBFE64HE77ANG5LHCS3DB4IRSMOVA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.805734857 (3h56m19.537002507s) [noise=true , address=104.36.82.58:4298 , piece_id=L23UFZ4B2F2R5TPVMTMNMSBXSO6FHBJ4A5THHSA4TPXUAJGGEV2Q, seg_pos={0 0}, upload=4068]: Done uploading piece. err: <nil>
Aug 8 21:22:38.805776806 (3h56m19.537044456s) [seg_pos={0 0}, upload=4068]: Segment reached optimal threshold of 14 pieces.
Aug 8 21:22:38.805979223 (3h56m19.537246874s) [noise=true , address=104.36.82.5:4847 , piece_id=UGVZPH3NE4ZGM4M653W2ND2T4TL4J463NAZADEAAVEZTS3QFJIIA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aAq1Axcts5JgFR2ve4AmPACyCprGsyzM1PERjTYeNM4xeBH1i): protocol: expected piece hash; context canceled; EOF
Aug 8 21:22:38.806105409 (3h56m19.537373039s) [noise=true , address=104.36.82.45:4931 , piece_id=PAIVXEI4WR4ZT47PAVHDDUL2PKJD5I4HUU4YTVUMCLDFCWNS3NCA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pCgoSfxjtXPw5jpbz9RJaxRiGoYPdPFdoMPtD19F1ZWY8UwPu): protocol: read tcp 5.161.89.252:23260->104.36.82.45:4931: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 8 21:22:38.806340719 (3h56m19.537608349s) [noise=true , address=104.36.82.43:4836 , piece_id=BE5VNX5N3LSHZWO5AXVR4AVWCDJDPIQNIVMSB4MSB4FU3FP2YFSA, seg_pos={0 0}, upload=4068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR): protocol: read tcp 5.161.89.252:38568->104.36.82.43:4836: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 8 21:22:38.806425847 (3h56m19.537693508s) [noise=true , address=64.49.13.170:4718 , piece_id=CBZ67QFTKMAZ7DBVEVTKESTKUUZT7TMZ5ZGRPUW2WGNV6HAX26KQ, seg_pos={0 0}, upload=4068]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AcLsSmVz9sRtuDLs47WoWYC66YSbr2aXBjzBdjayg22daQ2Hp): protocol: read tcp 5.161.89.252:22306->64.49.13.170:4718: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 8 21:22:38.806466142 (3h56m19.537733813s) [seg_pos={0 0}, upload=4068]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 21:22:38.806633053 (3h56m19.537900714s) [upload=4068]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 21:22:38.806643103 (3h56m19.537910753s) [upload=4068]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 21:22:38.897079143 (3h56m19.628346783s) [upload=4068]: Done uploading segments...
Aug 8 21:22:38.897095393 (3h56m19.628363034s) [upload=4068]: Upload finished. err: <nil>
Duration: 459.731797ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
135.653374ms
FAIL (2025-08-08 21:22:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:12:57.906843879 (3h46m38.638111529s) [upload=3897]: Starting upload Aug 8 21:12:57.906905814 (3h46m38.638173464s) [upload=3897]: Done starting upload Aug 8 21:12:57.906985183 (3h46m38.638252833s) [upload=3897]: Uploading segments... Aug 8 21:12:57.907053260 (3h46m38.63832091s) [upload=3897]: Got next segment. Inline: true Aug 8 21:12:57.907059221 (3h46m38.638326871s) [upload=3897]: Waiting for error group managing segments... Aug 8 21:12:57.907103575 (3h46m38.638371224s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:12:57.907109035 (3h46m38.638376684s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 21:12:57.907112630 (3h46m38.63838028s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 21:12:57.909562895 (3h46m38.640830545s) [upload=3897]: Done uploading segments... Aug 8 21:12:57.909575448 (3h46m38.640843099s) [upload=3897]: Upload finished. err: metaclient: Too Many Requests
Duration: 135.675194ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
469.148334ms
FAIL (2025-08-08 21:22:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:12:57.906843879 (3h46m38.638111529s) [upload=3897]: Starting upload Aug 8 21:12:57.906905814 (3h46m38.638173464s) [upload=3897]: Done starting upload Aug 8 21:12:57.906985183 (3h46m38.638252833s) [upload=3897]: Uploading segments... Aug 8 21:12:57.907053260 (3h46m38.63832091s) [upload=3897]: Got next segment. Inline: true Aug 8 21:12:57.907059221 (3h46m38.638326871s) [upload=3897]: Waiting for error group managing segments... Aug 8 21:12:57.907103575 (3h46m38.638371224s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:12:57.907109035 (3h46m38.638376684s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 21:12:57.907112630 (3h46m38.63838028s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 21:12:57.909562895 (3h46m38.640830545s) [upload=3897]: Done uploading segments... Aug 8 21:12:57.909575448 (3h46m38.640843099s) [upload=3897]: Upload finished. err: metaclient: Too Many Requests
Duration: 469.173752ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
232.892635ms
FAIL (2025-08-08 21:21:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:12:57.906843879 (3h46m38.638111529s) [upload=3897]: Starting upload Aug 8 21:12:57.906905814 (3h46m38.638173464s) [upload=3897]: Done starting upload Aug 8 21:12:57.906985183 (3h46m38.638252833s) [upload=3897]: Uploading segments... Aug 8 21:12:57.907053260 (3h46m38.63832091s) [upload=3897]: Got next segment. Inline: true Aug 8 21:12:57.907059221 (3h46m38.638326871s) [upload=3897]: Waiting for error group managing segments... Aug 8 21:12:57.907103575 (3h46m38.638371224s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:12:57.907109035 (3h46m38.638376684s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 21:12:57.907112630 (3h46m38.63838028s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 21:12:57.909562895 (3h46m38.640830545s) [upload=3897]: Done uploading segments... Aug 8 21:12:57.909575448 (3h46m38.640843099s) [upload=3897]: Upload finished. err: metaclient: Too Many Requests
Duration: 232.914024ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X.................X.......] duration:
1.194900912s
FAIL (2025-08-08 21:21:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:16:45.642924847 (3h50m26.374192507s) [upload=3969]: Starting upload Aug 8 21:16:45.642990669 (3h50m26.37425832s) [upload=3969]: Done starting upload Aug 8 21:16:45.643154686 (3h50m26.374422336s) [upload=3969]: Uploading segments... Aug 8 21:16:45.643424549 (3h50m26.374692199s) [upload=3969]: Got next segment. Inline: false Aug 8 21:16:45.643496755 (3h50m26.374764415s) [upload=3969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:16:45.643505611 (3h50m26.37477326s) [upload=3969]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:16:45.646581021 (3h50m26.377848672s) [upload=3969]: Next segment err: metaclient: Too Many Requests Aug 8 21:16:45.646595990 (3h50m26.377863639s) [upload=3969]: Done uploading segments... Aug 8 21:16:45.646614735 (3h50m26.377882385s) [upload=3969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.194918265s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
191.570962ms
FAIL (2025-08-08 21:21:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:12:57.906843879 (3h46m38.638111529s) [upload=3897]: Starting upload Aug 8 21:12:57.906905814 (3h46m38.638173464s) [upload=3897]: Done starting upload Aug 8 21:12:57.906985183 (3h46m38.638252833s) [upload=3897]: Uploading segments... Aug 8 21:12:57.907053260 (3h46m38.63832091s) [upload=3897]: Got next segment. Inline: true Aug 8 21:12:57.907059221 (3h46m38.638326871s) [upload=3897]: Waiting for error group managing segments... Aug 8 21:12:57.907103575 (3h46m38.638371224s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:12:57.907109035 (3h46m38.638376684s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 21:12:57.907112630 (3h46m38.63838028s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 21:12:57.909562895 (3h46m38.640830545s) [upload=3897]: Done uploading segments... Aug 8 21:12:57.909575448 (3h46m38.640843099s) [upload=3897]: Upload finished. err: metaclient: Too Many Requests
Duration: 191.592461ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
209.999843ms
FAIL (2025-08-08 21:20:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:12:57.906843879 (3h46m38.638111529s) [upload=3897]: Starting upload Aug 8 21:12:57.906905814 (3h46m38.638173464s) [upload=3897]: Done starting upload Aug 8 21:12:57.906985183 (3h46m38.638252833s) [upload=3897]: Uploading segments... Aug 8 21:12:57.907053260 (3h46m38.63832091s) [upload=3897]: Got next segment. Inline: true Aug 8 21:12:57.907059221 (3h46m38.638326871s) [upload=3897]: Waiting for error group managing segments... Aug 8 21:12:57.907103575 (3h46m38.638371224s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:12:57.907109035 (3h46m38.638376684s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 21:12:57.907112630 (3h46m38.63838028s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 21:12:57.909562895 (3h46m38.640830545s) [upload=3897]: Done uploading segments... Aug 8 21:12:57.909575448 (3h46m38.640843099s) [upload=3897]: Upload finished. err: metaclient: Too Many Requests
Duration: 210.028256ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X.................X......] duration:
1.010686333s
FAIL (2025-08-08 21:20:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:16:45.642924847 (3h50m26.374192507s) [upload=3969]: Starting upload Aug 8 21:16:45.642990669 (3h50m26.37425832s) [upload=3969]: Done starting upload Aug 8 21:16:45.643154686 (3h50m26.374422336s) [upload=3969]: Uploading segments... Aug 8 21:16:45.643424549 (3h50m26.374692199s) [upload=3969]: Got next segment. Inline: false Aug 8 21:16:45.643496755 (3h50m26.374764415s) [upload=3969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:16:45.643505611 (3h50m26.37477326s) [upload=3969]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:16:45.646581021 (3h50m26.377848672s) [upload=3969]: Next segment err: metaclient: Too Many Requests Aug 8 21:16:45.646595990 (3h50m26.377863639s) [upload=3969]: Done uploading segments... Aug 8 21:16:45.646614735 (3h50m26.377882385s) [upload=3969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.010713443s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X.................X.....] duration:
1.805834027s
FAIL (2025-08-08 21:20:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:16:45.642924847 (3h50m26.374192507s) [upload=3969]: Starting upload Aug 8 21:16:45.642990669 (3h50m26.37425832s) [upload=3969]: Done starting upload Aug 8 21:16:45.643154686 (3h50m26.374422336s) [upload=3969]: Uploading segments... Aug 8 21:16:45.643424549 (3h50m26.374692199s) [upload=3969]: Got next segment. Inline: false Aug 8 21:16:45.643496755 (3h50m26.374764415s) [upload=3969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:16:45.643505611 (3h50m26.37477326s) [upload=3969]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:16:45.646581021 (3h50m26.377848672s) [upload=3969]: Next segment err: metaclient: Too Many Requests Aug 8 21:16:45.646595990 (3h50m26.377863639s) [upload=3969]: Done uploading segments... Aug 8 21:16:45.646614735 (3h50m26.377882385s) [upload=3969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.805854085s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
205.514377ms
FAIL (2025-08-08 21:19:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:12:57.906843879 (3h46m38.638111529s) [upload=3897]: Starting upload Aug 8 21:12:57.906905814 (3h46m38.638173464s) [upload=3897]: Done starting upload Aug 8 21:12:57.906985183 (3h46m38.638252833s) [upload=3897]: Uploading segments... Aug 8 21:12:57.907053260 (3h46m38.63832091s) [upload=3897]: Got next segment. Inline: true Aug 8 21:12:57.907059221 (3h46m38.638326871s) [upload=3897]: Waiting for error group managing segments... Aug 8 21:12:57.907103575 (3h46m38.638371224s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:12:57.907109035 (3h46m38.638376684s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 21:12:57.907112630 (3h46m38.63838028s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 21:12:57.909562895 (3h46m38.640830545s) [upload=3897]: Done uploading segments... Aug 8 21:12:57.909575448 (3h46m38.640843099s) [upload=3897]: Upload finished. err: metaclient: Too Many Requests
Duration: 205.542491ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
149.916849ms
FAIL (2025-08-08 21:19:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:12:57.906843879 (3h46m38.638111529s) [upload=3897]: Starting upload Aug 8 21:12:57.906905814 (3h46m38.638173464s) [upload=3897]: Done starting upload Aug 8 21:12:57.906985183 (3h46m38.638252833s) [upload=3897]: Uploading segments... Aug 8 21:12:57.907053260 (3h46m38.63832091s) [upload=3897]: Got next segment. Inline: true Aug 8 21:12:57.907059221 (3h46m38.638326871s) [upload=3897]: Waiting for error group managing segments... Aug 8 21:12:57.907103575 (3h46m38.638371224s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:12:57.907109035 (3h46m38.638376684s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 21:12:57.907112630 (3h46m38.63838028s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 21:12:57.909562895 (3h46m38.640830545s) [upload=3897]: Done uploading segments... Aug 8 21:12:57.909575448 (3h46m38.640843099s) [upload=3897]: Upload finished. err: metaclient: Too Many Requests
Duration: 149.939882ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X.................X....] duration:
588.084672ms
FAIL (2025-08-08 21:19:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:16:45.642924847 (3h50m26.374192507s) [upload=3969]: Starting upload Aug 8 21:16:45.642990669 (3h50m26.37425832s) [upload=3969]: Done starting upload Aug 8 21:16:45.643154686 (3h50m26.374422336s) [upload=3969]: Uploading segments... Aug 8 21:16:45.643424549 (3h50m26.374692199s) [upload=3969]: Got next segment. Inline: false Aug 8 21:16:45.643496755 (3h50m26.374764415s) [upload=3969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:16:45.643505611 (3h50m26.37477326s) [upload=3969]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:16:45.646581021 (3h50m26.377848672s) [upload=3969]: Next segment err: metaclient: Too Many Requests Aug 8 21:16:45.646595990 (3h50m26.377863639s) [upload=3969]: Done uploading segments... Aug 8 21:16:45.646614735 (3h50m26.377882385s) [upload=3969]: Upload finished. err: metaclient: Too Many Requests
Duration: 588.103207ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
235.611067ms
FAIL (2025-08-08 21:18:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:12:57.906843879 (3h46m38.638111529s) [upload=3897]: Starting upload Aug 8 21:12:57.906905814 (3h46m38.638173464s) [upload=3897]: Done starting upload Aug 8 21:12:57.906985183 (3h46m38.638252833s) [upload=3897]: Uploading segments... Aug 8 21:12:57.907053260 (3h46m38.63832091s) [upload=3897]: Got next segment. Inline: true Aug 8 21:12:57.907059221 (3h46m38.638326871s) [upload=3897]: Waiting for error group managing segments... Aug 8 21:12:57.907103575 (3h46m38.638371224s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:12:57.907109035 (3h46m38.638376684s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 21:12:57.907112630 (3h46m38.63838028s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 21:12:57.909562895 (3h46m38.640830545s) [upload=3897]: Done uploading segments... Aug 8 21:12:57.909575448 (3h46m38.640843099s) [upload=3897]: Upload finished. err: metaclient: Too Many Requests
Duration: 235.635713ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X.................X...] duration:
1.18556671s
FAIL (2025-08-08 21:18:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:16:45.642924847 (3h50m26.374192507s) [upload=3969]: Starting upload Aug 8 21:16:45.642990669 (3h50m26.37425832s) [upload=3969]: Done starting upload Aug 8 21:16:45.643154686 (3h50m26.374422336s) [upload=3969]: Uploading segments... Aug 8 21:16:45.643424549 (3h50m26.374692199s) [upload=3969]: Got next segment. Inline: false Aug 8 21:16:45.643496755 (3h50m26.374764415s) [upload=3969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:16:45.643505611 (3h50m26.37477326s) [upload=3969]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:16:45.646581021 (3h50m26.377848672s) [upload=3969]: Next segment err: metaclient: Too Many Requests Aug 8 21:16:45.646595990 (3h50m26.377863639s) [upload=3969]: Done uploading segments... Aug 8 21:16:45.646614735 (3h50m26.377882385s) [upload=3969]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.185589782s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X....................................................X......] duration:
245.480964ms
FAIL (2025-08-08 21:18:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:12:57.906843879 (3h46m38.638111529s) [upload=3897]: Starting upload Aug 8 21:12:57.906905814 (3h46m38.638173464s) [upload=3897]: Done starting upload Aug 8 21:12:57.906985183 (3h46m38.638252833s) [upload=3897]: Uploading segments... Aug 8 21:12:57.907053260 (3h46m38.63832091s) [upload=3897]: Got next segment. Inline: true Aug 8 21:12:57.907059221 (3h46m38.638326871s) [upload=3897]: Waiting for error group managing segments... Aug 8 21:12:57.907103575 (3h46m38.638371224s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:12:57.907109035 (3h46m38.638376684s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 21:12:57.907112630 (3h46m38.63838028s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 21:12:57.909562895 (3h46m38.640830545s) [upload=3897]: Done uploading segments... Aug 8 21:12:57.909575448 (3h46m38.640843099s) [upload=3897]: Upload finished. err: metaclient: Too Many Requests
Duration: 245.500791ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X.................X..] duration:
821.368268ms
FAIL (2025-08-08 21:17:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:16:45.642924847 (3h50m26.374192507s) [upload=3969]: Starting upload Aug 8 21:16:45.642990669 (3h50m26.37425832s) [upload=3969]: Done starting upload Aug 8 21:16:45.643154686 (3h50m26.374422336s) [upload=3969]: Uploading segments... Aug 8 21:16:45.643424549 (3h50m26.374692199s) [upload=3969]: Got next segment. Inline: false Aug 8 21:16:45.643496755 (3h50m26.374764415s) [upload=3969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:16:45.643505611 (3h50m26.37477326s) [upload=3969]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:16:45.646581021 (3h50m26.377848672s) [upload=3969]: Next segment err: metaclient: Too Many Requests Aug 8 21:16:45.646595990 (3h50m26.377863639s) [upload=3969]: Done uploading segments... Aug 8 21:16:45.646614735 (3h50m26.377882385s) [upload=3969]: Upload finished. err: metaclient: Too Many Requests
Duration: 821.394337ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X....................................................X.....] duration:
157.542011ms
FAIL (2025-08-08 21:17:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:12:57.906843879 (3h46m38.638111529s) [upload=3897]: Starting upload Aug 8 21:12:57.906905814 (3h46m38.638173464s) [upload=3897]: Done starting upload Aug 8 21:12:57.906985183 (3h46m38.638252833s) [upload=3897]: Uploading segments... Aug 8 21:12:57.907053260 (3h46m38.63832091s) [upload=3897]: Got next segment. Inline: true Aug 8 21:12:57.907059221 (3h46m38.638326871s) [upload=3897]: Waiting for error group managing segments... Aug 8 21:12:57.907103575 (3h46m38.638371224s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:12:57.907109035 (3h46m38.638376684s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 21:12:57.907112630 (3h46m38.63838028s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 21:12:57.909562895 (3h46m38.640830545s) [upload=3897]: Done uploading segments... Aug 8 21:12:57.909575448 (3h46m38.640843099s) [upload=3897]: Upload finished. err: metaclient: Too Many Requests
Duration: 157.564323ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................X.................X.] duration:
425.93359ms
FAIL (2025-08-08 21:17:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:16:45.642924847 (3h50m26.374192507s) [upload=3969]: Starting upload Aug 8 21:16:45.642990669 (3h50m26.37425832s) [upload=3969]: Done starting upload Aug 8 21:16:45.643154686 (3h50m26.374422336s) [upload=3969]: Uploading segments... Aug 8 21:16:45.643424549 (3h50m26.374692199s) [upload=3969]: Got next segment. Inline: false Aug 8 21:16:45.643496755 (3h50m26.374764415s) [upload=3969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:16:45.643505611 (3h50m26.37477326s) [upload=3969]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:16:45.646581021 (3h50m26.377848672s) [upload=3969]: Next segment err: metaclient: Too Many Requests Aug 8 21:16:45.646595990 (3h50m26.377863639s) [upload=3969]: Done uploading segments... Aug 8 21:16:45.646614735 (3h50m26.377882385s) [upload=3969]: Upload finished. err: metaclient: Too Many Requests
Duration: 425.959689ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X.................X] duration:
23.350307ms
FAIL (2025-08-08 21:16:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:16:45.642924847 (3h50m26.374192507s) [upload=3969]: Starting upload Aug 8 21:16:45.642990669 (3h50m26.37425832s) [upload=3969]: Done starting upload Aug 8 21:16:45.643154686 (3h50m26.374422336s) [upload=3969]: Uploading segments... Aug 8 21:16:45.643424549 (3h50m26.374692199s) [upload=3969]: Got next segment. Inline: false Aug 8 21:16:45.643496755 (3h50m26.374764415s) [upload=3969]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:16:45.643505611 (3h50m26.37477326s) [upload=3969]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:16:45.646581021 (3h50m26.377848672s) [upload=3969]: Next segment err: metaclient: Too Many Requests Aug 8 21:16:45.646595990 (3h50m26.377863639s) [upload=3969]: Done uploading segments... Aug 8 21:16:45.646614735 (3h50m26.377882385s) [upload=3969]: Upload finished. err: metaclient: Too Many Requests
Duration: 23.372438ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X....................................................X....] duration:
172.333582ms
FAIL (2025-08-08 21:16:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:12:57.906843879 (3h46m38.638111529s) [upload=3897]: Starting upload Aug 8 21:12:57.906905814 (3h46m38.638173464s) [upload=3897]: Done starting upload Aug 8 21:12:57.906985183 (3h46m38.638252833s) [upload=3897]: Uploading segments... Aug 8 21:12:57.907053260 (3h46m38.63832091s) [upload=3897]: Got next segment. Inline: true Aug 8 21:12:57.907059221 (3h46m38.638326871s) [upload=3897]: Waiting for error group managing segments... Aug 8 21:12:57.907103575 (3h46m38.638371224s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:12:57.907109035 (3h46m38.638376684s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 21:12:57.907112630 (3h46m38.63838028s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 21:12:57.909562895 (3h46m38.640830545s) [upload=3897]: Done uploading segments... Aug 8 21:12:57.909575448 (3h46m38.640843099s) [upload=3897]: Upload finished. err: metaclient: Too Many Requests
Duration: 172.355924ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
575.749741ms
FAIL (2025-08-08 21:16:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:04:40.565875713 (3h38m21.297143343s) [upload=3760]: Starting upload Aug 8 21:04:40.565934193 (3h38m21.297201823s) [upload=3760]: Done starting upload Aug 8 21:04:40.566016366 (3h38m21.297284016s) [upload=3760]: Uploading segments... Aug 8 21:04:40.566183999 (3h38m21.29745162s) [upload=3760]: Got next segment. Inline: false Aug 8 21:04:40.566219354 (3h38m21.297486975s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:04:40.566224224 (3h38m21.297491854s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:04:40.569293724 (3h38m21.300561374s) [upload=3760]: Next segment err: metaclient: Too Many Requests Aug 8 21:04:40.569327376 (3h38m21.300595036s) [upload=3760]: Done uploading segments... Aug 8 21:04:40.569345921 (3h38m21.300613571s) [upload=3760]: Upload finished. err: metaclient: Too Many Requests
Duration: 575.767032ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X....................................................X...] duration:
201.660742ms
FAIL (2025-08-08 21:15:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:12:57.906843879 (3h46m38.638111529s) [upload=3897]: Starting upload Aug 8 21:12:57.906905814 (3h46m38.638173464s) [upload=3897]: Done starting upload Aug 8 21:12:57.906985183 (3h46m38.638252833s) [upload=3897]: Uploading segments... Aug 8 21:12:57.907053260 (3h46m38.63832091s) [upload=3897]: Got next segment. Inline: true Aug 8 21:12:57.907059221 (3h46m38.638326871s) [upload=3897]: Waiting for error group managing segments... Aug 8 21:12:57.907103575 (3h46m38.638371224s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:12:57.907109035 (3h46m38.638376684s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 21:12:57.907112630 (3h46m38.63838028s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 21:12:57.909562895 (3h46m38.640830545s) [upload=3897]: Done uploading segments... Aug 8 21:12:57.909575448 (3h46m38.640843099s) [upload=3897]: Upload finished. err: metaclient: Too Many Requests
Duration: 201.678806ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.903310793s
FAIL (2025-08-08 21:15:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:04:40.565875713 (3h38m21.297143343s) [upload=3760]: Starting upload Aug 8 21:04:40.565934193 (3h38m21.297201823s) [upload=3760]: Done starting upload Aug 8 21:04:40.566016366 (3h38m21.297284016s) [upload=3760]: Uploading segments... Aug 8 21:04:40.566183999 (3h38m21.29745162s) [upload=3760]: Got next segment. Inline: false Aug 8 21:04:40.566219354 (3h38m21.297486975s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:04:40.566224224 (3h38m21.297491854s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:04:40.569293724 (3h38m21.300561374s) [upload=3760]: Next segment err: metaclient: Too Many Requests Aug 8 21:04:40.569327376 (3h38m21.300595036s) [upload=3760]: Done uploading segments... Aug 8 21:04:40.569345921 (3h38m21.300613571s) [upload=3760]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.903334096s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X....................................................X..] duration:
741.226463ms
FAIL (2025-08-08 21:15:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:12:57.906843879 (3h46m38.638111529s) [upload=3897]: Starting upload Aug 8 21:12:57.906905814 (3h46m38.638173464s) [upload=3897]: Done starting upload Aug 8 21:12:57.906985183 (3h46m38.638252833s) [upload=3897]: Uploading segments... Aug 8 21:12:57.907053260 (3h46m38.63832091s) [upload=3897]: Got next segment. Inline: true Aug 8 21:12:57.907059221 (3h46m38.638326871s) [upload=3897]: Waiting for error group managing segments... Aug 8 21:12:57.907103575 (3h46m38.638371224s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:12:57.907109035 (3h46m38.638376684s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 21:12:57.907112630 (3h46m38.63838028s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 21:12:57.909562895 (3h46m38.640830545s) [upload=3897]: Done uploading segments... Aug 8 21:12:57.909575448 (3h46m38.640843099s) [upload=3897]: Upload finished. err: metaclient: Too Many Requests
Duration: 741.253532ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
344.91172ms
FAIL (2025-08-08 21:14:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:04:40.565875713 (3h38m21.297143343s) [upload=3760]: Starting upload Aug 8 21:04:40.565934193 (3h38m21.297201823s) [upload=3760]: Done starting upload Aug 8 21:04:40.566016366 (3h38m21.297284016s) [upload=3760]: Uploading segments... Aug 8 21:04:40.566183999 (3h38m21.29745162s) [upload=3760]: Got next segment. Inline: false Aug 8 21:04:40.566219354 (3h38m21.297486975s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:04:40.566224224 (3h38m21.297491854s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:04:40.569293724 (3h38m21.300561374s) [upload=3760]: Next segment err: metaclient: Too Many Requests Aug 8 21:04:40.569327376 (3h38m21.300595036s) [upload=3760]: Done uploading segments... Aug 8 21:04:40.569345921 (3h38m21.300613571s) [upload=3760]: Upload finished. err: metaclient: Too Many Requests
Duration: 344.95964ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
975.477788ms
FAIL (2025-08-08 21:14:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:04:40.565875713 (3h38m21.297143343s) [upload=3760]: Starting upload Aug 8 21:04:40.565934193 (3h38m21.297201823s) [upload=3760]: Done starting upload Aug 8 21:04:40.566016366 (3h38m21.297284016s) [upload=3760]: Uploading segments... Aug 8 21:04:40.566183999 (3h38m21.29745162s) [upload=3760]: Got next segment. Inline: false Aug 8 21:04:40.566219354 (3h38m21.297486975s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:04:40.566224224 (3h38m21.297491854s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:04:40.569293724 (3h38m21.300561374s) [upload=3760]: Next segment err: metaclient: Too Many Requests Aug 8 21:04:40.569327376 (3h38m21.300595036s) [upload=3760]: Done uploading segments... Aug 8 21:04:40.569345921 (3h38m21.300613571s) [upload=3760]: Upload finished. err: metaclient: Too Many Requests
Duration: 975.504419ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X....................................................X.] duration:
183.062919ms
FAIL (2025-08-08 21:14:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:12:57.906843879 (3h46m38.638111529s) [upload=3897]: Starting upload Aug 8 21:12:57.906905814 (3h46m38.638173464s) [upload=3897]: Done starting upload Aug 8 21:12:57.906985183 (3h46m38.638252833s) [upload=3897]: Uploading segments... Aug 8 21:12:57.907053260 (3h46m38.63832091s) [upload=3897]: Got next segment. Inline: true Aug 8 21:12:57.907059221 (3h46m38.638326871s) [upload=3897]: Waiting for error group managing segments... Aug 8 21:12:57.907103575 (3h46m38.638371224s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:12:57.907109035 (3h46m38.638376684s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 21:12:57.907112630 (3h46m38.63838028s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 21:12:57.909562895 (3h46m38.640830545s) [upload=3897]: Done uploading segments... Aug 8 21:12:57.909575448 (3h46m38.640843099s) [upload=3897]: Upload finished. err: metaclient: Too Many Requests
Duration: 183.096272ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
1.257598957s
FAIL (2025-08-08 21:13:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:04:40.565875713 (3h38m21.297143343s) [upload=3760]: Starting upload Aug 8 21:04:40.565934193 (3h38m21.297201823s) [upload=3760]: Done starting upload Aug 8 21:04:40.566016366 (3h38m21.297284016s) [upload=3760]: Uploading segments... Aug 8 21:04:40.566183999 (3h38m21.29745162s) [upload=3760]: Got next segment. Inline: false Aug 8 21:04:40.566219354 (3h38m21.297486975s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:04:40.566224224 (3h38m21.297491854s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:04:40.569293724 (3h38m21.300561374s) [upload=3760]: Next segment err: metaclient: Too Many Requests Aug 8 21:04:40.569327376 (3h38m21.300595036s) [upload=3760]: Done uploading segments... Aug 8 21:04:40.569345921 (3h38m21.300613571s) [upload=3760]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.257625685s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
1.101087455s
FAIL (2025-08-08 21:13:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:04:40.565875713 (3h38m21.297143343s) [upload=3760]: Starting upload Aug 8 21:04:40.565934193 (3h38m21.297201823s) [upload=3760]: Done starting upload Aug 8 21:04:40.566016366 (3h38m21.297284016s) [upload=3760]: Uploading segments... Aug 8 21:04:40.566183999 (3h38m21.29745162s) [upload=3760]: Got next segment. Inline: false Aug 8 21:04:40.566219354 (3h38m21.297486975s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:04:40.566224224 (3h38m21.297491854s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:04:40.569293724 (3h38m21.300561374s) [upload=3760]: Next segment err: metaclient: Too Many Requests Aug 8 21:04:40.569327376 (3h38m21.300595036s) [upload=3760]: Done uploading segments... Aug 8 21:04:40.569345921 (3h38m21.300613571s) [upload=3760]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.101107444s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
1.018236617s
FAIL (2025-08-08 21:13:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:04:40.565875713 (3h38m21.297143343s) [upload=3760]: Starting upload Aug 8 21:04:40.565934193 (3h38m21.297201823s) [upload=3760]: Done starting upload Aug 8 21:04:40.566016366 (3h38m21.297284016s) [upload=3760]: Uploading segments... Aug 8 21:04:40.566183999 (3h38m21.29745162s) [upload=3760]: Got next segment. Inline: false Aug 8 21:04:40.566219354 (3h38m21.297486975s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:04:40.566224224 (3h38m21.297491854s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:04:40.569293724 (3h38m21.300561374s) [upload=3760]: Next segment err: metaclient: Too Many Requests Aug 8 21:04:40.569327376 (3h38m21.300595036s) [upload=3760]: Done uploading segments... Aug 8 21:04:40.569345921 (3h38m21.300613571s) [upload=3760]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.018260621s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X....................................................X] duration:
15.280673ms
FAIL (2025-08-08 21:12:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:12:57.906843879 (3h46m38.638111529s) [upload=3897]: Starting upload Aug 8 21:12:57.906905814 (3h46m38.638173464s) [upload=3897]: Done starting upload Aug 8 21:12:57.906985183 (3h46m38.638252833s) [upload=3897]: Uploading segments... Aug 8 21:12:57.907053260 (3h46m38.63832091s) [upload=3897]: Got next segment. Inline: true Aug 8 21:12:57.907059221 (3h46m38.638326871s) [upload=3897]: Waiting for error group managing segments... Aug 8 21:12:57.907103575 (3h46m38.638371224s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:12:57.907109035 (3h46m38.638376684s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 21:12:57.907112630 (3h46m38.63838028s) [upload=3897]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 21:12:57.909562895 (3h46m38.640830545s) [upload=3897]: Done uploading segments... Aug 8 21:12:57.909575448 (3h46m38.640843099s) [upload=3897]: Upload finished. err: metaclient: Too Many Requests
Duration: 15.299008ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.478037952s
FAIL (2025-08-08 21:12:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:04:40.565875713 (3h38m21.297143343s) [upload=3760]: Starting upload Aug 8 21:04:40.565934193 (3h38m21.297201823s) [upload=3760]: Done starting upload Aug 8 21:04:40.566016366 (3h38m21.297284016s) [upload=3760]: Uploading segments... Aug 8 21:04:40.566183999 (3h38m21.29745162s) [upload=3760]: Got next segment. Inline: false Aug 8 21:04:40.566219354 (3h38m21.297486975s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:04:40.566224224 (3h38m21.297491854s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:04:40.569293724 (3h38m21.300561374s) [upload=3760]: Next segment err: metaclient: Too Many Requests Aug 8 21:04:40.569327376 (3h38m21.300595036s) [upload=3760]: Done uploading segments... Aug 8 21:04:40.569345921 (3h38m21.300613571s) [upload=3760]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.478068801s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
1.01451921s
FAIL (2025-08-08 21:11:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:04:40.565875713 (3h38m21.297143343s) [upload=3760]: Starting upload Aug 8 21:04:40.565934193 (3h38m21.297201823s) [upload=3760]: Done starting upload Aug 8 21:04:40.566016366 (3h38m21.297284016s) [upload=3760]: Uploading segments... Aug 8 21:04:40.566183999 (3h38m21.29745162s) [upload=3760]: Got next segment. Inline: false Aug 8 21:04:40.566219354 (3h38m21.297486975s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:04:40.566224224 (3h38m21.297491854s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:04:40.569293724 (3h38m21.300561374s) [upload=3760]: Next segment err: metaclient: Too Many Requests Aug 8 21:04:40.569327376 (3h38m21.300595036s) [upload=3760]: Done uploading segments... Aug 8 21:04:40.569345921 (3h38m21.300613571s) [upload=3760]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.014539608s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
166.552266ms
FAIL (2025-08-08 21:11:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 20:32:50.353296974 (3h6m31.084564634s) [upload=3219]: Starting upload Aug 8 20:32:50.353392392 (3h6m31.084660042s) [upload=3219]: Done starting upload Aug 8 20:32:50.353476198 (3h6m31.084743858s) [upload=3219]: Uploading segments... Aug 8 20:32:50.353533436 (3h6m31.084801086s) [upload=3219]: Got next segment. Inline: true Aug 8 20:32:50.353538916 (3h6m31.084806576s) [upload=3219]: Waiting for error group managing segments... Aug 8 20:32:50.353592556 (3h6m31.084860205s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 20:32:50.353598186 (3h6m31.084865846s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 20:32:50.353602254 (3h6m31.084869903s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 20:32:50.424691082 (3h6m31.155958732s) [upload=3219]: Done uploading segments... Aug 8 20:32:50.424710197 (3h6m31.155977848s) [upload=3219]: Upload finished. err: metaclient: Too Many Requests
Duration: 166.574648ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.082348363s
FAIL (2025-08-08 21:11:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:04:40.565875713 (3h38m21.297143343s) [upload=3760]: Starting upload Aug 8 21:04:40.565934193 (3h38m21.297201823s) [upload=3760]: Done starting upload Aug 8 21:04:40.566016366 (3h38m21.297284016s) [upload=3760]: Uploading segments... Aug 8 21:04:40.566183999 (3h38m21.29745162s) [upload=3760]: Got next segment. Inline: false Aug 8 21:04:40.566219354 (3h38m21.297486975s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:04:40.566224224 (3h38m21.297491854s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:04:40.569293724 (3h38m21.300561374s) [upload=3760]: Next segment err: metaclient: Too Many Requests Aug 8 21:04:40.569327376 (3h38m21.300595036s) [upload=3760]: Done uploading segments... Aug 8 21:04:40.569345921 (3h38m21.300613571s) [upload=3760]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.082373619s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
162.908536ms
FAIL (2025-08-08 21:10:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 20:32:50.353296974 (3h6m31.084564634s) [upload=3219]: Starting upload Aug 8 20:32:50.353392392 (3h6m31.084660042s) [upload=3219]: Done starting upload Aug 8 20:32:50.353476198 (3h6m31.084743858s) [upload=3219]: Uploading segments... Aug 8 20:32:50.353533436 (3h6m31.084801086s) [upload=3219]: Got next segment. Inline: true Aug 8 20:32:50.353538916 (3h6m31.084806576s) [upload=3219]: Waiting for error group managing segments... Aug 8 20:32:50.353592556 (3h6m31.084860205s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 20:32:50.353598186 (3h6m31.084865846s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 20:32:50.353602254 (3h6m31.084869903s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 20:32:50.424691082 (3h6m31.155958732s) [upload=3219]: Done uploading segments... Aug 8 20:32:50.424710197 (3h6m31.155977848s) [upload=3219]: Upload finished. err: metaclient: Too Many Requests
Duration: 162.930296ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.152709818s
FAIL (2025-08-08 21:10:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:04:40.565875713 (3h38m21.297143343s) [upload=3760]: Starting upload Aug 8 21:04:40.565934193 (3h38m21.297201823s) [upload=3760]: Done starting upload Aug 8 21:04:40.566016366 (3h38m21.297284016s) [upload=3760]: Uploading segments... Aug 8 21:04:40.566183999 (3h38m21.29745162s) [upload=3760]: Got next segment. Inline: false Aug 8 21:04:40.566219354 (3h38m21.297486975s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:04:40.566224224 (3h38m21.297491854s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:04:40.569293724 (3h38m21.300561374s) [upload=3760]: Next segment err: metaclient: Too Many Requests Aug 8 21:04:40.569327376 (3h38m21.300595036s) [upload=3760]: Done uploading segments... Aug 8 21:04:40.569345921 (3h38m21.300613571s) [upload=3760]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.152732862s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
249.647736ms
FAIL (2025-08-08 21:09:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 20:32:50.353296974 (3h6m31.084564634s) [upload=3219]: Starting upload Aug 8 20:32:50.353392392 (3h6m31.084660042s) [upload=3219]: Done starting upload Aug 8 20:32:50.353476198 (3h6m31.084743858s) [upload=3219]: Uploading segments... Aug 8 20:32:50.353533436 (3h6m31.084801086s) [upload=3219]: Got next segment. Inline: true Aug 8 20:32:50.353538916 (3h6m31.084806576s) [upload=3219]: Waiting for error group managing segments... Aug 8 20:32:50.353592556 (3h6m31.084860205s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 20:32:50.353598186 (3h6m31.084865846s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 20:32:50.353602254 (3h6m31.084869903s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 20:32:50.424691082 (3h6m31.155958732s) [upload=3219]: Done uploading segments... Aug 8 20:32:50.424710197 (3h6m31.155977848s) [upload=3219]: Upload finished. err: metaclient: Too Many Requests
Duration: 249.674333ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.053253192s
FAIL (2025-08-08 21:09:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:04:40.565875713 (3h38m21.297143343s) [upload=3760]: Starting upload Aug 8 21:04:40.565934193 (3h38m21.297201823s) [upload=3760]: Done starting upload Aug 8 21:04:40.566016366 (3h38m21.297284016s) [upload=3760]: Uploading segments... Aug 8 21:04:40.566183999 (3h38m21.29745162s) [upload=3760]: Got next segment. Inline: false Aug 8 21:04:40.566219354 (3h38m21.297486975s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:04:40.566224224 (3h38m21.297491854s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:04:40.569293724 (3h38m21.300561374s) [upload=3760]: Next segment err: metaclient: Too Many Requests Aug 8 21:04:40.569327376 (3h38m21.300595036s) [upload=3760]: Done uploading segments... Aug 8 21:04:40.569345921 (3h38m21.300613571s) [upload=3760]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.05327775s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
205.672758ms
FAIL (2025-08-08 21:09:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 20:32:50.353296974 (3h6m31.084564634s) [upload=3219]: Starting upload Aug 8 20:32:50.353392392 (3h6m31.084660042s) [upload=3219]: Done starting upload Aug 8 20:32:50.353476198 (3h6m31.084743858s) [upload=3219]: Uploading segments... Aug 8 20:32:50.353533436 (3h6m31.084801086s) [upload=3219]: Got next segment. Inline: true Aug 8 20:32:50.353538916 (3h6m31.084806576s) [upload=3219]: Waiting for error group managing segments... Aug 8 20:32:50.353592556 (3h6m31.084860205s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 20:32:50.353598186 (3h6m31.084865846s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 20:32:50.353602254 (3h6m31.084869903s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 20:32:50.424691082 (3h6m31.155958732s) [upload=3219]: Done uploading segments... Aug 8 20:32:50.424710197 (3h6m31.155977848s) [upload=3219]: Upload finished. err: metaclient: Too Many Requests
Duration: 205.686134ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.31648855s
FAIL (2025-08-08 21:08:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:04:40.565875713 (3h38m21.297143343s) [upload=3760]: Starting upload Aug 8 21:04:40.565934193 (3h38m21.297201823s) [upload=3760]: Done starting upload Aug 8 21:04:40.566016366 (3h38m21.297284016s) [upload=3760]: Uploading segments... Aug 8 21:04:40.566183999 (3h38m21.29745162s) [upload=3760]: Got next segment. Inline: false Aug 8 21:04:40.566219354 (3h38m21.297486975s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:04:40.566224224 (3h38m21.297491854s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:04:40.569293724 (3h38m21.300561374s) [upload=3760]: Next segment err: metaclient: Too Many Requests Aug 8 21:04:40.569327376 (3h38m21.300595036s) [upload=3760]: Done uploading segments... Aug 8 21:04:40.569345921 (3h38m21.300613571s) [upload=3760]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.316506503s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
290.782773ms
FAIL (2025-08-08 21:08:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 20:32:50.353296974 (3h6m31.084564634s) [upload=3219]: Starting upload Aug 8 20:32:50.353392392 (3h6m31.084660042s) [upload=3219]: Done starting upload Aug 8 20:32:50.353476198 (3h6m31.084743858s) [upload=3219]: Uploading segments... Aug 8 20:32:50.353533436 (3h6m31.084801086s) [upload=3219]: Got next segment. Inline: true Aug 8 20:32:50.353538916 (3h6m31.084806576s) [upload=3219]: Waiting for error group managing segments... Aug 8 20:32:50.353592556 (3h6m31.084860205s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 20:32:50.353598186 (3h6m31.084865846s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 20:32:50.353602254 (3h6m31.084869903s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 20:32:50.424691082 (3h6m31.155958732s) [upload=3219]: Done uploading segments... Aug 8 20:32:50.424710197 (3h6m31.155977848s) [upload=3219]: Upload finished. err: metaclient: Too Many Requests
Duration: 290.804723ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.007850877s
FAIL (2025-08-08 21:07:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:04:40.565875713 (3h38m21.297143343s) [upload=3760]: Starting upload Aug 8 21:04:40.565934193 (3h38m21.297201823s) [upload=3760]: Done starting upload Aug 8 21:04:40.566016366 (3h38m21.297284016s) [upload=3760]: Uploading segments... Aug 8 21:04:40.566183999 (3h38m21.29745162s) [upload=3760]: Got next segment. Inline: false Aug 8 21:04:40.566219354 (3h38m21.297486975s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:04:40.566224224 (3h38m21.297491854s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:04:40.569293724 (3h38m21.300561374s) [upload=3760]: Next segment err: metaclient: Too Many Requests Aug 8 21:04:40.569327376 (3h38m21.300595036s) [upload=3760]: Done uploading segments... Aug 8 21:04:40.569345921 (3h38m21.300613571s) [upload=3760]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.007871946s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
187.60321ms
FAIL (2025-08-08 21:07:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 20:32:50.353296974 (3h6m31.084564634s) [upload=3219]: Starting upload Aug 8 20:32:50.353392392 (3h6m31.084660042s) [upload=3219]: Done starting upload Aug 8 20:32:50.353476198 (3h6m31.084743858s) [upload=3219]: Uploading segments... Aug 8 20:32:50.353533436 (3h6m31.084801086s) [upload=3219]: Got next segment. Inline: true Aug 8 20:32:50.353538916 (3h6m31.084806576s) [upload=3219]: Waiting for error group managing segments... Aug 8 20:32:50.353592556 (3h6m31.084860205s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 20:32:50.353598186 (3h6m31.084865846s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 20:32:50.353602254 (3h6m31.084869903s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 20:32:50.424691082 (3h6m31.155958732s) [upload=3219]: Done uploading segments... Aug 8 20:32:50.424710197 (3h6m31.155977848s) [upload=3219]: Upload finished. err: metaclient: Too Many Requests
Duration: 187.628068ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.086830881s
FAIL (2025-08-08 21:06:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:04:40.565875713 (3h38m21.297143343s) [upload=3760]: Starting upload Aug 8 21:04:40.565934193 (3h38m21.297201823s) [upload=3760]: Done starting upload Aug 8 21:04:40.566016366 (3h38m21.297284016s) [upload=3760]: Uploading segments... Aug 8 21:04:40.566183999 (3h38m21.29745162s) [upload=3760]: Got next segment. Inline: false Aug 8 21:04:40.566219354 (3h38m21.297486975s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:04:40.566224224 (3h38m21.297491854s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:04:40.569293724 (3h38m21.300561374s) [upload=3760]: Next segment err: metaclient: Too Many Requests Aug 8 21:04:40.569327376 (3h38m21.300595036s) [upload=3760]: Done uploading segments... Aug 8 21:04:40.569345921 (3h38m21.300613571s) [upload=3760]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.08686172s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
209.555547ms
FAIL (2025-08-08 21:06:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 20:32:50.353296974 (3h6m31.084564634s) [upload=3219]: Starting upload Aug 8 20:32:50.353392392 (3h6m31.084660042s) [upload=3219]: Done starting upload Aug 8 20:32:50.353476198 (3h6m31.084743858s) [upload=3219]: Uploading segments... Aug 8 20:32:50.353533436 (3h6m31.084801086s) [upload=3219]: Got next segment. Inline: true Aug 8 20:32:50.353538916 (3h6m31.084806576s) [upload=3219]: Waiting for error group managing segments... Aug 8 20:32:50.353592556 (3h6m31.084860205s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 20:32:50.353598186 (3h6m31.084865846s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 20:32:50.353602254 (3h6m31.084869903s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 20:32:50.424691082 (3h6m31.155958732s) [upload=3219]: Done uploading segments... Aug 8 20:32:50.424710197 (3h6m31.155977848s) [upload=3219]: Upload finished. err: metaclient: Too Many Requests
Duration: 209.57376ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
1.491300334s
FAIL (2025-08-08 21:05:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 21:04:40.565875713 (3h38m21.297143343s) [upload=3760]: Starting upload Aug 8 21:04:40.565934193 (3h38m21.297201823s) [upload=3760]: Done starting upload Aug 8 21:04:40.566016366 (3h38m21.297284016s) [upload=3760]: Uploading segments... Aug 8 21:04:40.566183999 (3h38m21.29745162s) [upload=3760]: Got next segment. Inline: false Aug 8 21:04:40.566219354 (3h38m21.297486975s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 21:04:40.566224224 (3h38m21.297491854s) [upload=3760]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 8 21:04:40.569293724 (3h38m21.300561374s) [upload=3760]: Next segment err: metaclient: Too Many Requests Aug 8 21:04:40.569327376 (3h38m21.300595036s) [upload=3760]: Done uploading segments... Aug 8 21:04:40.569345921 (3h38m21.300613571s) [upload=3760]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.491329409s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
220.106011ms
FAIL (2025-08-08 21:05:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 8 20:32:50.353296974 (3h6m31.084564634s) [upload=3219]: Starting upload Aug 8 20:32:50.353392392 (3h6m31.084660042s) [upload=3219]: Done starting upload Aug 8 20:32:50.353476198 (3h6m31.084743858s) [upload=3219]: Uploading segments... Aug 8 20:32:50.353533436 (3h6m31.084801086s) [upload=3219]: Got next segment. Inline: true Aug 8 20:32:50.353538916 (3h6m31.084806576s) [upload=3219]: Waiting for error group managing segments... Aug 8 20:32:50.353592556 (3h6m31.084860205s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 20:32:50.353598186 (3h6m31.084865846s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 20:32:50.353602254 (3h6m31.084869903s) [upload=3219]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 20:32:50.424691082 (3h6m31.155958732s) [upload=3219]: Done uploading segments... Aug 8 20:32:50.424710197 (3h6m31.155977848s) [upload=3219]: Upload finished. err: metaclient: Too Many Requests
Duration: 220.161645ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|