Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X...................................X..........X..........] duration:
666.705932ms
FAIL (2025-08-19 11:48:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 11:39:38.991988114 (258h13m19.723255775s) [upload=268564]: Starting upload
Aug 19 11:39:38.992053357 (258h13m19.723321006s) [upload=268564]: Done starting upload
Aug 19 11:39:38.992117387 (258h13m19.723385037s) [upload=268564]: Uploading segments...
Aug 19 11:39:38.992415498 (258h13m19.723683148s) [upload=268564]: Got next segment. Inline: false
Aug 19 11:39:38.992455713 (258h13m19.723723374s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:39:38.992461204 (258h13m19.723728853s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:39:39.059798511 (258h13m19.791066172s) [seg_pos={0 0}, upload=268564]: Begin upload segment...
Aug 19 11:39:39.059886276 (258h13m19.791153927s) [seg_pos={0 0}, upload=268564]: Done begin upload segment.
Aug 19 11:39:39.060021702 (258h13m19.791289422s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060041829 (258h13m19.79130949s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060141256 (258h13m19.791408905s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060628392 (258h13m19.791896102s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060638952 (258h13m19.791906602s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061178888 (258h13m19.792446548s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061189698 (258h13m19.792457358s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061249731 (258h13m19.79251738s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061703224 (258h13m19.792970874s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061711229 (258h13m19.792978879s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062150034 (258h13m19.793417684s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062259760 (258h13m19.79352741s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062637480 (258h13m19.793905131s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062844229 (258h13m19.794111879s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063166776 (258h13m19.794434436s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063395746 (258h13m19.794663407s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064038376 (258h13m19.795306035s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064068442 (258h13m19.795336092s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.166563111 (258h13m19.897830732s) [upload=268564]: Next returned nil segment
Aug 19 11:39:39.166576928 (258h13m19.897844558s) [upload=268564]: Waiting for error group managing segments...
Aug 19 11:39:39.199001020 (258h13m19.93026865s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.227088116 (258h13m19.958355746s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.271643054 (258h13m20.002910705s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281503510 (258h13m20.012771159s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281825695 (258h13m20.013093356s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.288750830 (258h13m20.02001849s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.289185497 (258h13m20.020453147s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.292401636 (258h13m20.023669296s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.293023375 (258h13m20.024291025s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297325406 (258h13m20.028593057s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297861284 (258h13m20.029128945s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.303036738 (258h13m20.034304398s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.307338669 (258h13m20.03860632s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308244783 (258h13m20.039512444s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308279669 (258h13m20.03954733s) [seg_pos={0 0}, upload=268564]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:39:39.308497629 (258h13m20.039765279s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308549596 (258h13m20.039817247s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1q5ZaXkQ2kzSdKoqNhFzyNuYbWZ2uQern3umD3HtDYgTCSkGAa): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308680694 (258h13m20.039948343s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308898162 (258h13m20.040165813s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: context canceled; context canceled
Aug 19 11:39:39.308921366 (258h13m20.040189016s) [seg_pos={0 0}, upload=268564]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:39:39.309012417 (258h13m20.040280068s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:39:39.309017808 (258h13m20.040285458s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:39:39.462661567 (258h13m20.193929187s) [upload=268564]: Done uploading segments...
Aug 19 11:39:39.462675814 (258h13m20.193943444s) [upload=268564]: Upload finished. err: <nil>
Duration: 666.728534ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
191.360586ms
FAIL (2025-08-19 11:47:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 191.381646ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X...................................X..........X.........] duration:
906.118214ms
FAIL (2025-08-19 11:47:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 11:39:38.991988114 (258h13m19.723255775s) [upload=268564]: Starting upload
Aug 19 11:39:38.992053357 (258h13m19.723321006s) [upload=268564]: Done starting upload
Aug 19 11:39:38.992117387 (258h13m19.723385037s) [upload=268564]: Uploading segments...
Aug 19 11:39:38.992415498 (258h13m19.723683148s) [upload=268564]: Got next segment. Inline: false
Aug 19 11:39:38.992455713 (258h13m19.723723374s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:39:38.992461204 (258h13m19.723728853s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:39:39.059798511 (258h13m19.791066172s) [seg_pos={0 0}, upload=268564]: Begin upload segment...
Aug 19 11:39:39.059886276 (258h13m19.791153927s) [seg_pos={0 0}, upload=268564]: Done begin upload segment.
Aug 19 11:39:39.060021702 (258h13m19.791289422s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060041829 (258h13m19.79130949s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060141256 (258h13m19.791408905s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060628392 (258h13m19.791896102s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060638952 (258h13m19.791906602s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061178888 (258h13m19.792446548s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061189698 (258h13m19.792457358s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061249731 (258h13m19.79251738s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061703224 (258h13m19.792970874s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061711229 (258h13m19.792978879s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062150034 (258h13m19.793417684s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062259760 (258h13m19.79352741s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062637480 (258h13m19.793905131s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062844229 (258h13m19.794111879s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063166776 (258h13m19.794434436s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063395746 (258h13m19.794663407s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064038376 (258h13m19.795306035s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064068442 (258h13m19.795336092s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.166563111 (258h13m19.897830732s) [upload=268564]: Next returned nil segment
Aug 19 11:39:39.166576928 (258h13m19.897844558s) [upload=268564]: Waiting for error group managing segments...
Aug 19 11:39:39.199001020 (258h13m19.93026865s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.227088116 (258h13m19.958355746s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.271643054 (258h13m20.002910705s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281503510 (258h13m20.012771159s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281825695 (258h13m20.013093356s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.288750830 (258h13m20.02001849s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.289185497 (258h13m20.020453147s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.292401636 (258h13m20.023669296s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.293023375 (258h13m20.024291025s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297325406 (258h13m20.028593057s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297861284 (258h13m20.029128945s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.303036738 (258h13m20.034304398s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.307338669 (258h13m20.03860632s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308244783 (258h13m20.039512444s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308279669 (258h13m20.03954733s) [seg_pos={0 0}, upload=268564]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:39:39.308497629 (258h13m20.039765279s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308549596 (258h13m20.039817247s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1q5ZaXkQ2kzSdKoqNhFzyNuYbWZ2uQern3umD3HtDYgTCSkGAa): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308680694 (258h13m20.039948343s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308898162 (258h13m20.040165813s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: context canceled; context canceled
Aug 19 11:39:39.308921366 (258h13m20.040189016s) [seg_pos={0 0}, upload=268564]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:39:39.309012417 (258h13m20.040280068s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:39:39.309017808 (258h13m20.040285458s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:39:39.462661567 (258h13m20.193929187s) [upload=268564]: Done uploading segments...
Aug 19 11:39:39.462675814 (258h13m20.193943444s) [upload=268564]: Upload finished. err: <nil>
Duration: 906.145496ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
248.357916ms
FAIL (2025-08-19 11:47:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 248.376973ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
543.47975ms
FAIL (2025-08-19 11:46:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 543.503094ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X...................................X..........X........] duration:
580.353087ms
FAIL (2025-08-19 11:46:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 11:39:38.991988114 (258h13m19.723255775s) [upload=268564]: Starting upload
Aug 19 11:39:38.992053357 (258h13m19.723321006s) [upload=268564]: Done starting upload
Aug 19 11:39:38.992117387 (258h13m19.723385037s) [upload=268564]: Uploading segments...
Aug 19 11:39:38.992415498 (258h13m19.723683148s) [upload=268564]: Got next segment. Inline: false
Aug 19 11:39:38.992455713 (258h13m19.723723374s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:39:38.992461204 (258h13m19.723728853s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:39:39.059798511 (258h13m19.791066172s) [seg_pos={0 0}, upload=268564]: Begin upload segment...
Aug 19 11:39:39.059886276 (258h13m19.791153927s) [seg_pos={0 0}, upload=268564]: Done begin upload segment.
Aug 19 11:39:39.060021702 (258h13m19.791289422s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060041829 (258h13m19.79130949s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060141256 (258h13m19.791408905s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060628392 (258h13m19.791896102s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060638952 (258h13m19.791906602s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061178888 (258h13m19.792446548s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061189698 (258h13m19.792457358s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061249731 (258h13m19.79251738s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061703224 (258h13m19.792970874s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061711229 (258h13m19.792978879s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062150034 (258h13m19.793417684s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062259760 (258h13m19.79352741s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062637480 (258h13m19.793905131s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062844229 (258h13m19.794111879s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063166776 (258h13m19.794434436s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063395746 (258h13m19.794663407s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064038376 (258h13m19.795306035s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064068442 (258h13m19.795336092s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.166563111 (258h13m19.897830732s) [upload=268564]: Next returned nil segment
Aug 19 11:39:39.166576928 (258h13m19.897844558s) [upload=268564]: Waiting for error group managing segments...
Aug 19 11:39:39.199001020 (258h13m19.93026865s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.227088116 (258h13m19.958355746s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.271643054 (258h13m20.002910705s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281503510 (258h13m20.012771159s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281825695 (258h13m20.013093356s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.288750830 (258h13m20.02001849s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.289185497 (258h13m20.020453147s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.292401636 (258h13m20.023669296s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.293023375 (258h13m20.024291025s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297325406 (258h13m20.028593057s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297861284 (258h13m20.029128945s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.303036738 (258h13m20.034304398s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.307338669 (258h13m20.03860632s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308244783 (258h13m20.039512444s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308279669 (258h13m20.03954733s) [seg_pos={0 0}, upload=268564]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:39:39.308497629 (258h13m20.039765279s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308549596 (258h13m20.039817247s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1q5ZaXkQ2kzSdKoqNhFzyNuYbWZ2uQern3umD3HtDYgTCSkGAa): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308680694 (258h13m20.039948343s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308898162 (258h13m20.040165813s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: context canceled; context canceled
Aug 19 11:39:39.308921366 (258h13m20.040189016s) [seg_pos={0 0}, upload=268564]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:39:39.309012417 (258h13m20.040280068s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:39:39.309017808 (258h13m20.040285458s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:39:39.462661567 (258h13m20.193929187s) [upload=268564]: Done uploading segments...
Aug 19 11:39:39.462675814 (258h13m20.193943444s) [upload=268564]: Upload finished. err: <nil>
Duration: 580.37568ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
342.988313ms
FAIL (2025-08-19 11:45:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 343.014633ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X...................................X..........X.......] duration:
538.037065ms
FAIL (2025-08-19 11:45:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 11:39:38.991988114 (258h13m19.723255775s) [upload=268564]: Starting upload
Aug 19 11:39:38.992053357 (258h13m19.723321006s) [upload=268564]: Done starting upload
Aug 19 11:39:38.992117387 (258h13m19.723385037s) [upload=268564]: Uploading segments...
Aug 19 11:39:38.992415498 (258h13m19.723683148s) [upload=268564]: Got next segment. Inline: false
Aug 19 11:39:38.992455713 (258h13m19.723723374s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:39:38.992461204 (258h13m19.723728853s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:39:39.059798511 (258h13m19.791066172s) [seg_pos={0 0}, upload=268564]: Begin upload segment...
Aug 19 11:39:39.059886276 (258h13m19.791153927s) [seg_pos={0 0}, upload=268564]: Done begin upload segment.
Aug 19 11:39:39.060021702 (258h13m19.791289422s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060041829 (258h13m19.79130949s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060141256 (258h13m19.791408905s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060628392 (258h13m19.791896102s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060638952 (258h13m19.791906602s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061178888 (258h13m19.792446548s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061189698 (258h13m19.792457358s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061249731 (258h13m19.79251738s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061703224 (258h13m19.792970874s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061711229 (258h13m19.792978879s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062150034 (258h13m19.793417684s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062259760 (258h13m19.79352741s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062637480 (258h13m19.793905131s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062844229 (258h13m19.794111879s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063166776 (258h13m19.794434436s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063395746 (258h13m19.794663407s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064038376 (258h13m19.795306035s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064068442 (258h13m19.795336092s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.166563111 (258h13m19.897830732s) [upload=268564]: Next returned nil segment
Aug 19 11:39:39.166576928 (258h13m19.897844558s) [upload=268564]: Waiting for error group managing segments...
Aug 19 11:39:39.199001020 (258h13m19.93026865s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.227088116 (258h13m19.958355746s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.271643054 (258h13m20.002910705s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281503510 (258h13m20.012771159s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281825695 (258h13m20.013093356s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.288750830 (258h13m20.02001849s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.289185497 (258h13m20.020453147s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.292401636 (258h13m20.023669296s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.293023375 (258h13m20.024291025s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297325406 (258h13m20.028593057s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297861284 (258h13m20.029128945s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.303036738 (258h13m20.034304398s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.307338669 (258h13m20.03860632s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308244783 (258h13m20.039512444s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308279669 (258h13m20.03954733s) [seg_pos={0 0}, upload=268564]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:39:39.308497629 (258h13m20.039765279s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308549596 (258h13m20.039817247s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1q5ZaXkQ2kzSdKoqNhFzyNuYbWZ2uQern3umD3HtDYgTCSkGAa): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308680694 (258h13m20.039948343s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308898162 (258h13m20.040165813s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: context canceled; context canceled
Aug 19 11:39:39.308921366 (258h13m20.040189016s) [seg_pos={0 0}, upload=268564]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:39:39.309012417 (258h13m20.040280068s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:39:39.309017808 (258h13m20.040285458s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:39:39.462661567 (258h13m20.193929187s) [upload=268564]: Done uploading segments...
Aug 19 11:39:39.462675814 (258h13m20.193943444s) [upload=268564]: Upload finished. err: <nil>
Duration: 538.062554ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
420.436684ms
FAIL (2025-08-19 11:45:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 420.459307ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X...................................X..........X......] duration:
991.749032ms
FAIL (2025-08-19 11:44:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 11:39:38.991988114 (258h13m19.723255775s) [upload=268564]: Starting upload
Aug 19 11:39:38.992053357 (258h13m19.723321006s) [upload=268564]: Done starting upload
Aug 19 11:39:38.992117387 (258h13m19.723385037s) [upload=268564]: Uploading segments...
Aug 19 11:39:38.992415498 (258h13m19.723683148s) [upload=268564]: Got next segment. Inline: false
Aug 19 11:39:38.992455713 (258h13m19.723723374s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:39:38.992461204 (258h13m19.723728853s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:39:39.059798511 (258h13m19.791066172s) [seg_pos={0 0}, upload=268564]: Begin upload segment...
Aug 19 11:39:39.059886276 (258h13m19.791153927s) [seg_pos={0 0}, upload=268564]: Done begin upload segment.
Aug 19 11:39:39.060021702 (258h13m19.791289422s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060041829 (258h13m19.79130949s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060141256 (258h13m19.791408905s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060628392 (258h13m19.791896102s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060638952 (258h13m19.791906602s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061178888 (258h13m19.792446548s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061189698 (258h13m19.792457358s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061249731 (258h13m19.79251738s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061703224 (258h13m19.792970874s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061711229 (258h13m19.792978879s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062150034 (258h13m19.793417684s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062259760 (258h13m19.79352741s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062637480 (258h13m19.793905131s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062844229 (258h13m19.794111879s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063166776 (258h13m19.794434436s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063395746 (258h13m19.794663407s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064038376 (258h13m19.795306035s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064068442 (258h13m19.795336092s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.166563111 (258h13m19.897830732s) [upload=268564]: Next returned nil segment
Aug 19 11:39:39.166576928 (258h13m19.897844558s) [upload=268564]: Waiting for error group managing segments...
Aug 19 11:39:39.199001020 (258h13m19.93026865s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.227088116 (258h13m19.958355746s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.271643054 (258h13m20.002910705s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281503510 (258h13m20.012771159s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281825695 (258h13m20.013093356s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.288750830 (258h13m20.02001849s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.289185497 (258h13m20.020453147s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.292401636 (258h13m20.023669296s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.293023375 (258h13m20.024291025s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297325406 (258h13m20.028593057s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297861284 (258h13m20.029128945s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.303036738 (258h13m20.034304398s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.307338669 (258h13m20.03860632s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308244783 (258h13m20.039512444s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308279669 (258h13m20.03954733s) [seg_pos={0 0}, upload=268564]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:39:39.308497629 (258h13m20.039765279s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308549596 (258h13m20.039817247s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1q5ZaXkQ2kzSdKoqNhFzyNuYbWZ2uQern3umD3HtDYgTCSkGAa): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308680694 (258h13m20.039948343s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308898162 (258h13m20.040165813s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: context canceled; context canceled
Aug 19 11:39:39.308921366 (258h13m20.040189016s) [seg_pos={0 0}, upload=268564]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:39:39.309012417 (258h13m20.040280068s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:39:39.309017808 (258h13m20.040285458s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:39:39.462661567 (258h13m20.193929187s) [upload=268564]: Done uploading segments...
Aug 19 11:39:39.462675814 (258h13m20.193943444s) [upload=268564]: Upload finished. err: <nil>
Duration: 991.774149ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X...................................X..........X.....] duration:
679.346003ms
FAIL (2025-08-19 11:44:05 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 11:39:38.991988114 (258h13m19.723255775s) [upload=268564]: Starting upload
Aug 19 11:39:38.992053357 (258h13m19.723321006s) [upload=268564]: Done starting upload
Aug 19 11:39:38.992117387 (258h13m19.723385037s) [upload=268564]: Uploading segments...
Aug 19 11:39:38.992415498 (258h13m19.723683148s) [upload=268564]: Got next segment. Inline: false
Aug 19 11:39:38.992455713 (258h13m19.723723374s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:39:38.992461204 (258h13m19.723728853s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:39:39.059798511 (258h13m19.791066172s) [seg_pos={0 0}, upload=268564]: Begin upload segment...
Aug 19 11:39:39.059886276 (258h13m19.791153927s) [seg_pos={0 0}, upload=268564]: Done begin upload segment.
Aug 19 11:39:39.060021702 (258h13m19.791289422s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060041829 (258h13m19.79130949s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060141256 (258h13m19.791408905s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060628392 (258h13m19.791896102s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060638952 (258h13m19.791906602s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061178888 (258h13m19.792446548s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061189698 (258h13m19.792457358s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061249731 (258h13m19.79251738s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061703224 (258h13m19.792970874s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061711229 (258h13m19.792978879s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062150034 (258h13m19.793417684s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062259760 (258h13m19.79352741s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062637480 (258h13m19.793905131s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062844229 (258h13m19.794111879s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063166776 (258h13m19.794434436s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063395746 (258h13m19.794663407s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064038376 (258h13m19.795306035s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064068442 (258h13m19.795336092s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.166563111 (258h13m19.897830732s) [upload=268564]: Next returned nil segment
Aug 19 11:39:39.166576928 (258h13m19.897844558s) [upload=268564]: Waiting for error group managing segments...
Aug 19 11:39:39.199001020 (258h13m19.93026865s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.227088116 (258h13m19.958355746s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.271643054 (258h13m20.002910705s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281503510 (258h13m20.012771159s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281825695 (258h13m20.013093356s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.288750830 (258h13m20.02001849s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.289185497 (258h13m20.020453147s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.292401636 (258h13m20.023669296s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.293023375 (258h13m20.024291025s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297325406 (258h13m20.028593057s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297861284 (258h13m20.029128945s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.303036738 (258h13m20.034304398s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.307338669 (258h13m20.03860632s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308244783 (258h13m20.039512444s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308279669 (258h13m20.03954733s) [seg_pos={0 0}, upload=268564]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:39:39.308497629 (258h13m20.039765279s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308549596 (258h13m20.039817247s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1q5ZaXkQ2kzSdKoqNhFzyNuYbWZ2uQern3umD3HtDYgTCSkGAa): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308680694 (258h13m20.039948343s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308898162 (258h13m20.040165813s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: context canceled; context canceled
Aug 19 11:39:39.308921366 (258h13m20.040189016s) [seg_pos={0 0}, upload=268564]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:39:39.309012417 (258h13m20.040280068s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:39:39.309017808 (258h13m20.040285458s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:39:39.462661567 (258h13m20.193929187s) [upload=268564]: Done uploading segments...
Aug 19 11:39:39.462675814 (258h13m20.193943444s) [upload=268564]: Upload finished. err: <nil>
Duration: 679.368024ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
243.066941ms
FAIL (2025-08-19 11:43:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 243.09778ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
288.517156ms
FAIL (2025-08-19 11:43:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 288.545169ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X...................................X..........X....] duration:
1.078753251s
FAIL (2025-08-19 11:43:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 11:39:38.991988114 (258h13m19.723255775s) [upload=268564]: Starting upload
Aug 19 11:39:38.992053357 (258h13m19.723321006s) [upload=268564]: Done starting upload
Aug 19 11:39:38.992117387 (258h13m19.723385037s) [upload=268564]: Uploading segments...
Aug 19 11:39:38.992415498 (258h13m19.723683148s) [upload=268564]: Got next segment. Inline: false
Aug 19 11:39:38.992455713 (258h13m19.723723374s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:39:38.992461204 (258h13m19.723728853s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:39:39.059798511 (258h13m19.791066172s) [seg_pos={0 0}, upload=268564]: Begin upload segment...
Aug 19 11:39:39.059886276 (258h13m19.791153927s) [seg_pos={0 0}, upload=268564]: Done begin upload segment.
Aug 19 11:39:39.060021702 (258h13m19.791289422s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060041829 (258h13m19.79130949s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060141256 (258h13m19.791408905s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060628392 (258h13m19.791896102s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060638952 (258h13m19.791906602s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061178888 (258h13m19.792446548s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061189698 (258h13m19.792457358s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061249731 (258h13m19.79251738s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061703224 (258h13m19.792970874s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061711229 (258h13m19.792978879s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062150034 (258h13m19.793417684s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062259760 (258h13m19.79352741s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062637480 (258h13m19.793905131s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062844229 (258h13m19.794111879s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063166776 (258h13m19.794434436s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063395746 (258h13m19.794663407s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064038376 (258h13m19.795306035s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064068442 (258h13m19.795336092s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.166563111 (258h13m19.897830732s) [upload=268564]: Next returned nil segment
Aug 19 11:39:39.166576928 (258h13m19.897844558s) [upload=268564]: Waiting for error group managing segments...
Aug 19 11:39:39.199001020 (258h13m19.93026865s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.227088116 (258h13m19.958355746s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.271643054 (258h13m20.002910705s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281503510 (258h13m20.012771159s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281825695 (258h13m20.013093356s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.288750830 (258h13m20.02001849s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.289185497 (258h13m20.020453147s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.292401636 (258h13m20.023669296s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.293023375 (258h13m20.024291025s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297325406 (258h13m20.028593057s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297861284 (258h13m20.029128945s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.303036738 (258h13m20.034304398s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.307338669 (258h13m20.03860632s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308244783 (258h13m20.039512444s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308279669 (258h13m20.03954733s) [seg_pos={0 0}, upload=268564]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:39:39.308497629 (258h13m20.039765279s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308549596 (258h13m20.039817247s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1q5ZaXkQ2kzSdKoqNhFzyNuYbWZ2uQern3umD3HtDYgTCSkGAa): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308680694 (258h13m20.039948343s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308898162 (258h13m20.040165813s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: context canceled; context canceled
Aug 19 11:39:39.308921366 (258h13m20.040189016s) [seg_pos={0 0}, upload=268564]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:39:39.309012417 (258h13m20.040280068s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:39:39.309017808 (258h13m20.040285458s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:39:39.462661567 (258h13m20.193929187s) [upload=268564]: Done uploading segments...
Aug 19 11:39:39.462675814 (258h13m20.193943444s) [upload=268564]: Upload finished. err: <nil>
Duration: 1.078783166s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
179.347585ms
FAIL (2025-08-19 11:42:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 179.366852ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
195.822951ms
FAIL (2025-08-19 11:42:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 195.841977ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X...................................X..........X...] duration:
1.703484998s
FAIL (2025-08-19 11:42:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 11:39:38.991988114 (258h13m19.723255775s) [upload=268564]: Starting upload
Aug 19 11:39:38.992053357 (258h13m19.723321006s) [upload=268564]: Done starting upload
Aug 19 11:39:38.992117387 (258h13m19.723385037s) [upload=268564]: Uploading segments...
Aug 19 11:39:38.992415498 (258h13m19.723683148s) [upload=268564]: Got next segment. Inline: false
Aug 19 11:39:38.992455713 (258h13m19.723723374s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:39:38.992461204 (258h13m19.723728853s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:39:39.059798511 (258h13m19.791066172s) [seg_pos={0 0}, upload=268564]: Begin upload segment...
Aug 19 11:39:39.059886276 (258h13m19.791153927s) [seg_pos={0 0}, upload=268564]: Done begin upload segment.
Aug 19 11:39:39.060021702 (258h13m19.791289422s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060041829 (258h13m19.79130949s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060141256 (258h13m19.791408905s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060628392 (258h13m19.791896102s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060638952 (258h13m19.791906602s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061178888 (258h13m19.792446548s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061189698 (258h13m19.792457358s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061249731 (258h13m19.79251738s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061703224 (258h13m19.792970874s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061711229 (258h13m19.792978879s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062150034 (258h13m19.793417684s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062259760 (258h13m19.79352741s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062637480 (258h13m19.793905131s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062844229 (258h13m19.794111879s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063166776 (258h13m19.794434436s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063395746 (258h13m19.794663407s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064038376 (258h13m19.795306035s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064068442 (258h13m19.795336092s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.166563111 (258h13m19.897830732s) [upload=268564]: Next returned nil segment
Aug 19 11:39:39.166576928 (258h13m19.897844558s) [upload=268564]: Waiting for error group managing segments...
Aug 19 11:39:39.199001020 (258h13m19.93026865s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.227088116 (258h13m19.958355746s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.271643054 (258h13m20.002910705s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281503510 (258h13m20.012771159s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281825695 (258h13m20.013093356s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.288750830 (258h13m20.02001849s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.289185497 (258h13m20.020453147s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.292401636 (258h13m20.023669296s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.293023375 (258h13m20.024291025s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297325406 (258h13m20.028593057s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297861284 (258h13m20.029128945s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.303036738 (258h13m20.034304398s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.307338669 (258h13m20.03860632s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308244783 (258h13m20.039512444s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308279669 (258h13m20.03954733s) [seg_pos={0 0}, upload=268564]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:39:39.308497629 (258h13m20.039765279s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308549596 (258h13m20.039817247s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1q5ZaXkQ2kzSdKoqNhFzyNuYbWZ2uQern3umD3HtDYgTCSkGAa): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308680694 (258h13m20.039948343s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308898162 (258h13m20.040165813s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: context canceled; context canceled
Aug 19 11:39:39.308921366 (258h13m20.040189016s) [seg_pos={0 0}, upload=268564]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:39:39.309012417 (258h13m20.040280068s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:39:39.309017808 (258h13m20.040285458s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:39:39.462661567 (258h13m20.193929187s) [upload=268564]: Done uploading segments...
Aug 19 11:39:39.462675814 (258h13m20.193943444s) [upload=268564]: Upload finished. err: <nil>
Duration: 1.703511007s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
497.469121ms
FAIL (2025-08-19 11:41:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 497.505229ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X...................................X..........X..] duration:
1.027164356s
FAIL (2025-08-19 11:41:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 11:39:38.991988114 (258h13m19.723255775s) [upload=268564]: Starting upload
Aug 19 11:39:38.992053357 (258h13m19.723321006s) [upload=268564]: Done starting upload
Aug 19 11:39:38.992117387 (258h13m19.723385037s) [upload=268564]: Uploading segments...
Aug 19 11:39:38.992415498 (258h13m19.723683148s) [upload=268564]: Got next segment. Inline: false
Aug 19 11:39:38.992455713 (258h13m19.723723374s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:39:38.992461204 (258h13m19.723728853s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:39:39.059798511 (258h13m19.791066172s) [seg_pos={0 0}, upload=268564]: Begin upload segment...
Aug 19 11:39:39.059886276 (258h13m19.791153927s) [seg_pos={0 0}, upload=268564]: Done begin upload segment.
Aug 19 11:39:39.060021702 (258h13m19.791289422s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060041829 (258h13m19.79130949s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060141256 (258h13m19.791408905s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060628392 (258h13m19.791896102s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060638952 (258h13m19.791906602s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061178888 (258h13m19.792446548s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061189698 (258h13m19.792457358s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061249731 (258h13m19.79251738s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061703224 (258h13m19.792970874s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061711229 (258h13m19.792978879s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062150034 (258h13m19.793417684s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062259760 (258h13m19.79352741s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062637480 (258h13m19.793905131s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062844229 (258h13m19.794111879s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063166776 (258h13m19.794434436s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063395746 (258h13m19.794663407s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064038376 (258h13m19.795306035s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064068442 (258h13m19.795336092s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.166563111 (258h13m19.897830732s) [upload=268564]: Next returned nil segment
Aug 19 11:39:39.166576928 (258h13m19.897844558s) [upload=268564]: Waiting for error group managing segments...
Aug 19 11:39:39.199001020 (258h13m19.93026865s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.227088116 (258h13m19.958355746s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.271643054 (258h13m20.002910705s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281503510 (258h13m20.012771159s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281825695 (258h13m20.013093356s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.288750830 (258h13m20.02001849s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.289185497 (258h13m20.020453147s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.292401636 (258h13m20.023669296s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.293023375 (258h13m20.024291025s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297325406 (258h13m20.028593057s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297861284 (258h13m20.029128945s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.303036738 (258h13m20.034304398s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.307338669 (258h13m20.03860632s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308244783 (258h13m20.039512444s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308279669 (258h13m20.03954733s) [seg_pos={0 0}, upload=268564]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:39:39.308497629 (258h13m20.039765279s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308549596 (258h13m20.039817247s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1q5ZaXkQ2kzSdKoqNhFzyNuYbWZ2uQern3umD3HtDYgTCSkGAa): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308680694 (258h13m20.039948343s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308898162 (258h13m20.040165813s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: context canceled; context canceled
Aug 19 11:39:39.308921366 (258h13m20.040189016s) [seg_pos={0 0}, upload=268564]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:39:39.309012417 (258h13m20.040280068s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:39:39.309017808 (258h13m20.040285458s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:39:39.462661567 (258h13m20.193929187s) [upload=268564]: Done uploading segments...
Aug 19 11:39:39.462675814 (258h13m20.193943444s) [upload=268564]: Upload finished. err: <nil>
Duration: 1.027183943s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
199.942791ms
FAIL (2025-08-19 11:40:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 199.972108ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X...................................X..........X.] duration:
600.093775ms
FAIL (2025-08-19 11:40:16 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 11:39:38.991988114 (258h13m19.723255775s) [upload=268564]: Starting upload
Aug 19 11:39:38.992053357 (258h13m19.723321006s) [upload=268564]: Done starting upload
Aug 19 11:39:38.992117387 (258h13m19.723385037s) [upload=268564]: Uploading segments...
Aug 19 11:39:38.992415498 (258h13m19.723683148s) [upload=268564]: Got next segment. Inline: false
Aug 19 11:39:38.992455713 (258h13m19.723723374s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:39:38.992461204 (258h13m19.723728853s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:39:39.059798511 (258h13m19.791066172s) [seg_pos={0 0}, upload=268564]: Begin upload segment...
Aug 19 11:39:39.059886276 (258h13m19.791153927s) [seg_pos={0 0}, upload=268564]: Done begin upload segment.
Aug 19 11:39:39.060021702 (258h13m19.791289422s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060041829 (258h13m19.79130949s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060141256 (258h13m19.791408905s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060628392 (258h13m19.791896102s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060638952 (258h13m19.791906602s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061178888 (258h13m19.792446548s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061189698 (258h13m19.792457358s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061249731 (258h13m19.79251738s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061703224 (258h13m19.792970874s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061711229 (258h13m19.792978879s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062150034 (258h13m19.793417684s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062259760 (258h13m19.79352741s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062637480 (258h13m19.793905131s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062844229 (258h13m19.794111879s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063166776 (258h13m19.794434436s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063395746 (258h13m19.794663407s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064038376 (258h13m19.795306035s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064068442 (258h13m19.795336092s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.166563111 (258h13m19.897830732s) [upload=268564]: Next returned nil segment
Aug 19 11:39:39.166576928 (258h13m19.897844558s) [upload=268564]: Waiting for error group managing segments...
Aug 19 11:39:39.199001020 (258h13m19.93026865s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.227088116 (258h13m19.958355746s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.271643054 (258h13m20.002910705s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281503510 (258h13m20.012771159s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281825695 (258h13m20.013093356s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.288750830 (258h13m20.02001849s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.289185497 (258h13m20.020453147s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.292401636 (258h13m20.023669296s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.293023375 (258h13m20.024291025s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297325406 (258h13m20.028593057s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297861284 (258h13m20.029128945s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.303036738 (258h13m20.034304398s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.307338669 (258h13m20.03860632s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308244783 (258h13m20.039512444s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308279669 (258h13m20.03954733s) [seg_pos={0 0}, upload=268564]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:39:39.308497629 (258h13m20.039765279s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308549596 (258h13m20.039817247s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1q5ZaXkQ2kzSdKoqNhFzyNuYbWZ2uQern3umD3HtDYgTCSkGAa): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308680694 (258h13m20.039948343s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308898162 (258h13m20.040165813s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: context canceled; context canceled
Aug 19 11:39:39.308921366 (258h13m20.040189016s) [seg_pos={0 0}, upload=268564]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:39:39.309012417 (258h13m20.040280068s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:39:39.309017808 (258h13m20.040285458s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:39:39.462661567 (258h13m20.193929187s) [upload=268564]: Done uploading segments...
Aug 19 11:39:39.462675814 (258h13m20.193943444s) [upload=268564]: Upload finished. err: <nil>
Duration: 600.152665ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
158.282565ms
FAIL (2025-08-19 11:39:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 158.312922ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X...................................X..........X] duration:
593.718987ms
FAIL (2025-08-19 11:39:39 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 11:39:38.991988114 (258h13m19.723255775s) [upload=268564]: Starting upload
Aug 19 11:39:38.992053357 (258h13m19.723321006s) [upload=268564]: Done starting upload
Aug 19 11:39:38.992117387 (258h13m19.723385037s) [upload=268564]: Uploading segments...
Aug 19 11:39:38.992415498 (258h13m19.723683148s) [upload=268564]: Got next segment. Inline: false
Aug 19 11:39:38.992455713 (258h13m19.723723374s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:39:38.992461204 (258h13m19.723728853s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:39:39.059798511 (258h13m19.791066172s) [seg_pos={0 0}, upload=268564]: Begin upload segment...
Aug 19 11:39:39.059886276 (258h13m19.791153927s) [seg_pos={0 0}, upload=268564]: Done begin upload segment.
Aug 19 11:39:39.060021702 (258h13m19.791289422s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060041829 (258h13m19.79130949s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060141256 (258h13m19.791408905s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060628392 (258h13m19.791896102s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.060638952 (258h13m19.791906602s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061178888 (258h13m19.792446548s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061189698 (258h13m19.792457358s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061249731 (258h13m19.79251738s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061703224 (258h13m19.792970874s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.061711229 (258h13m19.792978879s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062150034 (258h13m19.793417684s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062259760 (258h13m19.79352741s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062637480 (258h13m19.793905131s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.062844229 (258h13m19.794111879s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063166776 (258h13m19.794434436s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.063395746 (258h13m19.794663407s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064038376 (258h13m19.795306035s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.064068442 (258h13m19.795336092s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Uploading piece...
Aug 19 11:39:39.166563111 (258h13m19.897830732s) [upload=268564]: Next returned nil segment
Aug 19 11:39:39.166576928 (258h13m19.897844558s) [upload=268564]: Waiting for error group managing segments...
Aug 19 11:39:39.199001020 (258h13m19.93026865s) [noise=true , address=104.36.82.3:4800 , piece_id=R3A6LORBUROWGWBIBR3A47MNDDE3KVE4TT2MSZKO6XCVRKI2D2KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.227088116 (258h13m19.958355746s) [noise=true , address=104.36.82.23:4458 , piece_id=UGL6LA2WYRC7MO76OXPHU6NJPO234GW37CHMDQ445VH46OTLALJA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.271643054 (258h13m20.002910705s) [noise=true , address=45.91.116.9:4273 , piece_id=LZDKCVYLCRJZLUMNRIK7PY73VUQXRMMJQBYQJRCMCMF26PSMMFOQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281503510 (258h13m20.012771159s) [noise=true , address=77.90.31.12:4616 , piece_id=FB2O7GY3VJBQ3ERZ55JD6DD4UIIQTMQTARG6QXZO5UES6VGWJQGA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.281825695 (258h13m20.013093356s) [noise=true , address=77.90.31.15:4706 , piece_id=KD5V7MHSFEXORLLAYUOR6BKV2DJDXUIJKJEKAE4RC3BT7MWXOZNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.288750830 (258h13m20.02001849s) [noise=true , address=45.91.116.12:4259 , piece_id=VBZS4VRXVZQBINQWBM4N2SZMCWD6XASHTFXSQ5A3M52UI4RDDT5Q, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.289185497 (258h13m20.020453147s) [noise=true , address=77.90.31.17:4800 , piece_id=HC2OVRACEHXE6ZTGMSZBAIGBIVFHSDXJ4J2A3KS6JC43HKSDF4KQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.292401636 (258h13m20.023669296s) [noise=true , address=45.91.116.5:4300 , piece_id=VOVI2UCEHDIF2YOSIBAJBUM4XN63XYKKGDH4UULBZMS7DKOC33BQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.293023375 (258h13m20.024291025s) [noise=true , address=77.90.31.13:4650 , piece_id=7VG25ZQQQF5TUFDDKQZUMD5RJJJGSGKMCQF5V5ZEM3FQSQ7RJDNQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297325406 (258h13m20.028593057s) [noise=true , address=77.90.31.18:4830 , piece_id=W55WBAV4EUXE7N6EXO7RV3NHWS7JRYHGP5WLQDYDMBSWOENGGSMQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.297861284 (258h13m20.029128945s) [noise=true , address=45.91.116.13:4182 , piece_id=ODIBFB2ZU2GAFD3FBUU6MHETAIV3YKFDIXZ3EK5DFZDNEKTMVIBQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.303036738 (258h13m20.034304398s) [noise=true , address=104.36.82.60:4353 , piece_id=OUQOQONXCYWFK2L64XWRENNGDPWFZDYA5GJJ3KEFFPQHLJWU6XTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.307338669 (258h13m20.03860632s) [noise=true , address=45.91.116.4:4945 , piece_id=7EV6IM2IFT5YQ3TMX74CBERAVHDDWZRLBPCO255ENASRHL3HJ2CQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308244783 (258h13m20.039512444s) [noise=true , address=79.127.201.215:4355 , piece_id=AXXRZOMPC7Y4HGZEAX7HWLTAPYLKFZGRNQR4Z2BVU6AYKXTCAOTA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: <nil>
Aug 19 11:39:39.308279669 (258h13m20.03954733s) [seg_pos={0 0}, upload=268564]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:39:39.308497629 (258h13m20.039765279s) [noise=true , address=104.36.82.19:4436 , piece_id=TGTXX2FMEAZNNCTMQMMCH6O4KKFGDQDKAAB4SR22UURAUAWYGEQQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WvyEw8XevCiQ8yRgzyMo7WTVzpEJ158ErKfAeV4dSTBkS1oRF): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308549596 (258h13m20.039817247s) [noise=true , address=77.90.31.21:4892 , piece_id=GYKGXL4DQ3UKO6K7MGMDYQQX3GJC4IVYMTISQLWWXIDXXKLVU2QQ, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1q5ZaXkQ2kzSdKoqNhFzyNuYbWZ2uQern3umD3HtDYgTCSkGAa): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308680694 (258h13m20.039948343s) [noise=true , address=77.90.31.11:4585 , piece_id=HYP2LHIBPE6C35GQLR2GVHIQUYTCVEPQJRNMV2TM5RU6XQNCER6A, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tve8WUWhJCK2cVWLbxxnz3WVzR2bi2wLx5XrF6QbhSN4HcsQG): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.308898162 (258h13m20.040165813s) [noise=true , address=66.23.193.175:4560 , piece_id=G6VM4UJQLOW527OJKA5QQHRAWKASI6QTZMQ7EVQFBCYCVN7AZ4QA, seg_pos={0 0}, upload=268564]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JnJPYq3oApurPNBCfSqHzcEmtm4V2doRwfaPBPF3xBFtJoVny): protocol: context canceled; context canceled
Aug 19 11:39:39.308921366 (258h13m20.040189016s) [seg_pos={0 0}, upload=268564]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:39:39.309012417 (258h13m20.040280068s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:39:39.309017808 (258h13m20.040285458s) [upload=268564]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:39:39.462661567 (258h13m20.193929187s) [upload=268564]: Done uploading segments...
Aug 19 11:39:39.462675814 (258h13m20.193943444s) [upload=268564]: Upload finished. err: <nil>
Duration: 593.743502ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
796.754469ms
FAIL (2025-08-19 11:38:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 796.774677ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X............X...................................X..........] duration:
807.299233ms
FAIL (2025-08-19 11:38:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:30:20.450902350 (258h4m1.182169999s) [upload=268408]: Starting upload Aug 19 11:30:20.450974074 (258h4m1.182241724s) [upload=268408]: Done starting upload Aug 19 11:30:20.451018869 (258h4m1.182286499s) [upload=268408]: Uploading segments... Aug 19 11:30:20.451467633 (258h4m1.182735263s) [upload=268408]: Got next segment. Inline: false Aug 19 11:30:20.451518278 (258h4m1.182785898s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:30:20.451524990 (258h4m1.18279264s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:30:20.453853620 (258h4m1.185121239s) [upload=268408]: Next segment err: metaclient: Too Many Requests Aug 19 11:30:20.453865292 (258h4m1.185132922s) [upload=268408]: Done uploading segments... Aug 19 11:30:20.453875060 (258h4m1.18514269s) [upload=268408]: Upload finished. err: metaclient: Too Many Requests
Duration: 807.319933ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
207.546899ms
FAIL (2025-08-19 11:38:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 207.715497ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X............X...................................X.........] duration:
811.104429ms
FAIL (2025-08-19 11:37:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:30:20.450902350 (258h4m1.182169999s) [upload=268408]: Starting upload Aug 19 11:30:20.450974074 (258h4m1.182241724s) [upload=268408]: Done starting upload Aug 19 11:30:20.451018869 (258h4m1.182286499s) [upload=268408]: Uploading segments... Aug 19 11:30:20.451467633 (258h4m1.182735263s) [upload=268408]: Got next segment. Inline: false Aug 19 11:30:20.451518278 (258h4m1.182785898s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:30:20.451524990 (258h4m1.18279264s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:30:20.453853620 (258h4m1.185121239s) [upload=268408]: Next segment err: metaclient: Too Many Requests Aug 19 11:30:20.453865292 (258h4m1.185132922s) [upload=268408]: Done uploading segments... Aug 19 11:30:20.453875060 (258h4m1.18514269s) [upload=268408]: Upload finished. err: metaclient: Too Many Requests
Duration: 811.134335ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
232.087377ms
FAIL (2025-08-19 11:37:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 232.132351ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X............X...................................X........] duration:
717.556257ms
FAIL (2025-08-19 11:37:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:30:20.450902350 (258h4m1.182169999s) [upload=268408]: Starting upload Aug 19 11:30:20.450974074 (258h4m1.182241724s) [upload=268408]: Done starting upload Aug 19 11:30:20.451018869 (258h4m1.182286499s) [upload=268408]: Uploading segments... Aug 19 11:30:20.451467633 (258h4m1.182735263s) [upload=268408]: Got next segment. Inline: false Aug 19 11:30:20.451518278 (258h4m1.182785898s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:30:20.451524990 (258h4m1.18279264s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:30:20.453853620 (258h4m1.185121239s) [upload=268408]: Next segment err: metaclient: Too Many Requests Aug 19 11:30:20.453865292 (258h4m1.185132922s) [upload=268408]: Done uploading segments... Aug 19 11:30:20.453875060 (258h4m1.18514269s) [upload=268408]: Upload finished. err: metaclient: Too Many Requests
Duration: 717.581804ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
326.485697ms
FAIL (2025-08-19 11:37:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 326.507238ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
559.314416ms
FAIL (2025-08-19 11:37:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 559.352469ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X............X...................................X.......] duration:
721.177746ms
FAIL (2025-08-19 11:36:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:30:20.450902350 (258h4m1.182169999s) [upload=268408]: Starting upload Aug 19 11:30:20.450974074 (258h4m1.182241724s) [upload=268408]: Done starting upload Aug 19 11:30:20.451018869 (258h4m1.182286499s) [upload=268408]: Uploading segments... Aug 19 11:30:20.451467633 (258h4m1.182735263s) [upload=268408]: Got next segment. Inline: false Aug 19 11:30:20.451518278 (258h4m1.182785898s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:30:20.451524990 (258h4m1.18279264s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:30:20.453853620 (258h4m1.185121239s) [upload=268408]: Next segment err: metaclient: Too Many Requests Aug 19 11:30:20.453865292 (258h4m1.185132922s) [upload=268408]: Done uploading segments... Aug 19 11:30:20.453875060 (258h4m1.18514269s) [upload=268408]: Upload finished. err: metaclient: Too Many Requests
Duration: 721.197864ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
393.591298ms
FAIL (2025-08-19 11:36:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 393.611236ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X............X...................................X......] duration:
953.974805ms
FAIL (2025-08-19 11:35:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:30:20.450902350 (258h4m1.182169999s) [upload=268408]: Starting upload Aug 19 11:30:20.450974074 (258h4m1.182241724s) [upload=268408]: Done starting upload Aug 19 11:30:20.451018869 (258h4m1.182286499s) [upload=268408]: Uploading segments... Aug 19 11:30:20.451467633 (258h4m1.182735263s) [upload=268408]: Got next segment. Inline: false Aug 19 11:30:20.451518278 (258h4m1.182785898s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:30:20.451524990 (258h4m1.18279264s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:30:20.453853620 (258h4m1.185121239s) [upload=268408]: Next segment err: metaclient: Too Many Requests Aug 19 11:30:20.453865292 (258h4m1.185132922s) [upload=268408]: Done uploading segments... Aug 19 11:30:20.453875060 (258h4m1.18514269s) [upload=268408]: Upload finished. err: metaclient: Too Many Requests
Duration: 954.003851ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
258.6535ms
FAIL (2025-08-19 11:35:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 258.673278ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X............X...................................X.....] duration:
760.274901ms
FAIL (2025-08-19 11:34:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:30:20.450902350 (258h4m1.182169999s) [upload=268408]: Starting upload Aug 19 11:30:20.450974074 (258h4m1.182241724s) [upload=268408]: Done starting upload Aug 19 11:30:20.451018869 (258h4m1.182286499s) [upload=268408]: Uploading segments... Aug 19 11:30:20.451467633 (258h4m1.182735263s) [upload=268408]: Got next segment. Inline: false Aug 19 11:30:20.451518278 (258h4m1.182785898s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:30:20.451524990 (258h4m1.18279264s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:30:20.453853620 (258h4m1.185121239s) [upload=268408]: Next segment err: metaclient: Too Many Requests Aug 19 11:30:20.453865292 (258h4m1.185132922s) [upload=268408]: Done uploading segments... Aug 19 11:30:20.453875060 (258h4m1.18514269s) [upload=268408]: Upload finished. err: metaclient: Too Many Requests
Duration: 760.326688ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
170.453095ms
FAIL (2025-08-19 11:34:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 170.474846ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X............X...................................X....] duration:
798.096574ms
FAIL (2025-08-19 11:34:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:30:20.450902350 (258h4m1.182169999s) [upload=268408]: Starting upload Aug 19 11:30:20.450974074 (258h4m1.182241724s) [upload=268408]: Done starting upload Aug 19 11:30:20.451018869 (258h4m1.182286499s) [upload=268408]: Uploading segments... Aug 19 11:30:20.451467633 (258h4m1.182735263s) [upload=268408]: Got next segment. Inline: false Aug 19 11:30:20.451518278 (258h4m1.182785898s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:30:20.451524990 (258h4m1.18279264s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:30:20.453853620 (258h4m1.185121239s) [upload=268408]: Next segment err: metaclient: Too Many Requests Aug 19 11:30:20.453865292 (258h4m1.185132922s) [upload=268408]: Done uploading segments... Aug 19 11:30:20.453875060 (258h4m1.18514269s) [upload=268408]: Upload finished. err: metaclient: Too Many Requests
Duration: 798.136238ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
254.050982ms
FAIL (2025-08-19 11:33:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 254.075187ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X............X...................................X...] duration:
1.041924631s
FAIL (2025-08-19 11:33:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:30:20.450902350 (258h4m1.182169999s) [upload=268408]: Starting upload Aug 19 11:30:20.450974074 (258h4m1.182241724s) [upload=268408]: Done starting upload Aug 19 11:30:20.451018869 (258h4m1.182286499s) [upload=268408]: Uploading segments... Aug 19 11:30:20.451467633 (258h4m1.182735263s) [upload=268408]: Got next segment. Inline: false Aug 19 11:30:20.451518278 (258h4m1.182785898s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:30:20.451524990 (258h4m1.18279264s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:30:20.453853620 (258h4m1.185121239s) [upload=268408]: Next segment err: metaclient: Too Many Requests Aug 19 11:30:20.453865292 (258h4m1.185132922s) [upload=268408]: Done uploading segments... Aug 19 11:30:20.453875060 (258h4m1.18514269s) [upload=268408]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.041951752s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
787.864682ms
FAIL (2025-08-19 11:32:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 787.887854ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X............X...................................X..] duration:
699.916469ms
FAIL (2025-08-19 11:32:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:30:20.450902350 (258h4m1.182169999s) [upload=268408]: Starting upload Aug 19 11:30:20.450974074 (258h4m1.182241724s) [upload=268408]: Done starting upload Aug 19 11:30:20.451018869 (258h4m1.182286499s) [upload=268408]: Uploading segments... Aug 19 11:30:20.451467633 (258h4m1.182735263s) [upload=268408]: Got next segment. Inline: false Aug 19 11:30:20.451518278 (258h4m1.182785898s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:30:20.451524990 (258h4m1.18279264s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:30:20.453853620 (258h4m1.185121239s) [upload=268408]: Next segment err: metaclient: Too Many Requests Aug 19 11:30:20.453865292 (258h4m1.185132922s) [upload=268408]: Done uploading segments... Aug 19 11:30:20.453875060 (258h4m1.18514269s) [upload=268408]: Upload finished. err: metaclient: Too Many Requests
Duration: 699.935116ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
162.444953ms
FAIL (2025-08-19 11:32:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 162.465462ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X............X...................................X.] duration:
632.407771ms
FAIL (2025-08-19 11:31:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:30:20.450902350 (258h4m1.182169999s) [upload=268408]: Starting upload Aug 19 11:30:20.450974074 (258h4m1.182241724s) [upload=268408]: Done starting upload Aug 19 11:30:20.451018869 (258h4m1.182286499s) [upload=268408]: Uploading segments... Aug 19 11:30:20.451467633 (258h4m1.182735263s) [upload=268408]: Got next segment. Inline: false Aug 19 11:30:20.451518278 (258h4m1.182785898s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:30:20.451524990 (258h4m1.18279264s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:30:20.453853620 (258h4m1.185121239s) [upload=268408]: Next segment err: metaclient: Too Many Requests Aug 19 11:30:20.453865292 (258h4m1.185132922s) [upload=268408]: Done uploading segments... Aug 19 11:30:20.453875060 (258h4m1.18514269s) [upload=268408]: Upload finished. err: metaclient: Too Many Requests
Duration: 632.430794ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
215.281326ms
FAIL (2025-08-19 11:31:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 215.306413ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
488.874524ms
FAIL (2025-08-19 11:30:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 488.901164ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X............X...................................X] duration:
18.292873ms
FAIL (2025-08-19 11:30:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:30:20.450902350 (258h4m1.182169999s) [upload=268408]: Starting upload Aug 19 11:30:20.450974074 (258h4m1.182241724s) [upload=268408]: Done starting upload Aug 19 11:30:20.451018869 (258h4m1.182286499s) [upload=268408]: Uploading segments... Aug 19 11:30:20.451467633 (258h4m1.182735263s) [upload=268408]: Got next segment. Inline: false Aug 19 11:30:20.451518278 (258h4m1.182785898s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:30:20.451524990 (258h4m1.18279264s) [upload=268408]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:30:20.453853620 (258h4m1.185121239s) [upload=268408]: Next segment err: metaclient: Too Many Requests Aug 19 11:30:20.453865292 (258h4m1.185132922s) [upload=268408]: Done uploading segments... Aug 19 11:30:20.453875060 (258h4m1.18514269s) [upload=268408]: Upload finished. err: metaclient: Too Many Requests
Duration: 18.317801ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
331.989679ms
FAIL (2025-08-19 11:30:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 332.009188ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
204.575372ms
FAIL (2025-08-19 11:29:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:07:12.666312611 (257h40m53.397580262s) [upload=268017]: Starting upload Aug 19 11:07:12.666383665 (257h40m53.397651315s) [upload=268017]: Done starting upload Aug 19 11:07:12.666445431 (257h40m53.397713082s) [upload=268017]: Uploading segments... Aug 19 11:07:12.666508680 (257h40m53.39777633s) [upload=268017]: Got next segment. Inline: true Aug 19 11:07:12.666515523 (257h40m53.397783173s) [upload=268017]: Waiting for error group managing segments... Aug 19 11:07:12.666564525 (257h40m53.397832175s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:07:12.666601966 (257h40m53.397869616s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:07:12.666606284 (257h40m53.397873935s) [upload=268017]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:07:12.669797687 (257h40m53.401065347s) [upload=268017]: Done uploading segments... Aug 19 11:07:12.669813727 (257h40m53.401081378s) [upload=268017]: Upload finished. err: metaclient: Too Many Requests
Duration: 204.601049ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X............X...................................] duration:
596.142482ms
FAIL (2025-08-19 11:29:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:00:01.448485760 (257h33m42.17975339s) [upload=267892]: Starting upload Aug 19 11:00:01.448530065 (257h33m42.179797695s) [upload=267892]: Done starting upload Aug 19 11:00:01.448656682 (257h33m42.179924312s) [upload=267892]: Uploading segments... Aug 19 11:00:01.448764876 (257h33m42.180032506s) [upload=267892]: Got next segment. Inline: false Aug 19 11:00:01.448832783 (257h33m42.180100403s) [upload=267892]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:00:01.448841349 (257h33m42.180108979s) [upload=267892]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:00:01.467099957 (257h33m42.198367576s) [upload=267892]: Next segment err: metaclient: Too Many Requests Aug 19 11:00:01.467113882 (257h33m42.198381513s) [upload=267892]: Done uploading segments... Aug 19 11:00:01.467125925 (257h33m42.198393545s) [upload=267892]: Upload finished. err: metaclient: Too Many Requests
Duration: 596.166376ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|