Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 625.125484ms FAIL (2025-08-12 23:46:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 12 23:40:25.602807394 (102h14m6.334075015s) [upload=106455]: Starting upload Aug 12 23:40:25.602843082 (102h14m6.334110712s) [upload=106455]: Done starting upload Aug 12 23:40:25.603071431 (102h14m6.334339091s) [upload=106455]: Uploading segments... Aug 12 23:40:25.603211064 (102h14m6.334478714s) [upload=106455]: Got next segment. Inline: false Aug 12 23:40:25.603266829 (102h14m6.334534478s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:40:25.603273010 (102h14m6.33454067s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 23:40:25.640478671 (102h14m6.371746301s) [seg_pos={0 0}, upload=106455]: Begin upload segment... Aug 12 23:40:25.640504920 (102h14m6.371772541s) [seg_pos={0 0}, upload=106455]: Done begin upload segment. Aug 12 23:40:25.640551027 (102h14m6.371818647s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640606341 (102h14m6.37187399s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640858084 (102h14m6.372125714s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641082025 (102h14m6.372349655s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641155102 (102h14m6.372422752s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641332385 (102h14m6.372600015s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641619525 (102h14m6.372887145s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641631898 (102h14m6.372899558s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641841422 (102h14m6.373109042s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642035477 (102h14m6.373303127s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642064592 (102h14m6.373332211s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642342704 (102h14m6.373610334s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642562778 (102h14m6.373830428s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643065462 (102h14m6.374333113s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643497335 (102h14m6.374764995s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643885824 (102h14m6.375153474s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.645513935 (102h14m6.376781585s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.646074248 (102h14m6.377341898s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.743022691 (102h14m6.474290311s) [upload=106455]: Next returned nil segment Aug 12 23:40:25.743031648 (102h14m6.474299267s) [upload=106455]: Waiting for error group managing segments... Aug 12 23:40:25.755181243 (102h14m6.486448863s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.758249461 (102h14m6.48951711s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763254367 (102h14m6.494522027s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763286398 (102h14m6.494554047s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.782074191 (102h14m6.513341841s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.783971977 (102h14m6.515239597s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.787348233 (102h14m6.518615854s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.795444812 (102h14m6.526712432s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.803325063 (102h14m6.534592683s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.806351462 (102h14m6.537619122s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.874479634 (102h14m6.605747264s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.071197169 (102h14m6.80246482s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.084338160 (102h14m6.81560581s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225062191 (102h14m6.956329831s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225100052 (102h14m6.956367702s) [seg_pos={0 0}, upload=106455]: Segment reached optimal threshold of 14 pieces. Aug 12 23:40:26.225281113 (102h14m6.956548763s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225297233 (102h14m6.956564873s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fD69hzWAhaScaVnRiPMZEFbybabwe1qfRZYfxZtwkFkze9wM4): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225380810 (102h14m6.956648451s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225466812 (102h14m6.956734462s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225501978 (102h14m6.956769628s) [seg_pos={0 0}, upload=106455]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 23:40:26.225586546 (102h14m6.956854197s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 23:40:26.225591897 (102h14m6.956859546s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:40:26.440491076 (102h14m7.171758727s) [upload=106455]: Done uploading segments... Aug 12 23:40:26.440509852 (102h14m7.171777492s) [upload=106455]: Upload finished. err: <nil> Duration: 625.149981ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X............................................X......] duration: 215.294814ms FAIL (2025-08-12 23:45:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:40:34.762477818 (102h14m15.493745448s) [upload=106459]: Starting upload Aug 12 23:40:34.762518555 (102h14m15.493786175s) [upload=106459]: Done starting upload Aug 12 23:40:34.762557007 (102h14m15.493824627s) [upload=106459]: Uploading segments... Aug 12 23:40:34.762583717 (102h14m15.493851347s) [upload=106459]: Got next segment. Inline: true Aug 12 23:40:34.762587124 (102h14m15.493854754s) [upload=106459]: Waiting for error group managing segments... Aug 12 23:40:34.762616008 (102h14m15.493883638s) [upload=106459]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:40:34.762620387 (102h14m15.493888017s) [upload=106459]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:40:34.762622741 (102h14m15.493890361s) [upload=106459]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:40:34.765324408 (102h14m15.496592038s) [upload=106459]: Done uploading segments... Aug 12 23:40:34.765331843 (102h14m15.496599473s) [upload=106459]: Upload finished. err: metaclient: Too Many Requests Duration:* 215.321504ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 670.589939ms FAIL (2025-08-12 23:45:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 12 23:40:25.602807394 (102h14m6.334075015s) [upload=106455]: Starting upload Aug 12 23:40:25.602843082 (102h14m6.334110712s) [upload=106455]: Done starting upload Aug 12 23:40:25.603071431 (102h14m6.334339091s) [upload=106455]: Uploading segments... Aug 12 23:40:25.603211064 (102h14m6.334478714s) [upload=106455]: Got next segment. Inline: false Aug 12 23:40:25.603266829 (102h14m6.334534478s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:40:25.603273010 (102h14m6.33454067s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 23:40:25.640478671 (102h14m6.371746301s) [seg_pos={0 0}, upload=106455]: Begin upload segment... Aug 12 23:40:25.640504920 (102h14m6.371772541s) [seg_pos={0 0}, upload=106455]: Done begin upload segment. Aug 12 23:40:25.640551027 (102h14m6.371818647s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640606341 (102h14m6.37187399s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640858084 (102h14m6.372125714s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641082025 (102h14m6.372349655s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641155102 (102h14m6.372422752s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641332385 (102h14m6.372600015s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641619525 (102h14m6.372887145s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641631898 (102h14m6.372899558s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641841422 (102h14m6.373109042s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642035477 (102h14m6.373303127s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642064592 (102h14m6.373332211s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642342704 (102h14m6.373610334s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642562778 (102h14m6.373830428s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643065462 (102h14m6.374333113s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643497335 (102h14m6.374764995s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643885824 (102h14m6.375153474s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.645513935 (102h14m6.376781585s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.646074248 (102h14m6.377341898s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.743022691 (102h14m6.474290311s) [upload=106455]: Next returned nil segment Aug 12 23:40:25.743031648 (102h14m6.474299267s) [upload=106455]: Waiting for error group managing segments... Aug 12 23:40:25.755181243 (102h14m6.486448863s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.758249461 (102h14m6.48951711s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763254367 (102h14m6.494522027s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763286398 (102h14m6.494554047s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.782074191 (102h14m6.513341841s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.783971977 (102h14m6.515239597s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.787348233 (102h14m6.518615854s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.795444812 (102h14m6.526712432s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.803325063 (102h14m6.534592683s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.806351462 (102h14m6.537619122s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.874479634 (102h14m6.605747264s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.071197169 (102h14m6.80246482s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.084338160 (102h14m6.81560581s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225062191 (102h14m6.956329831s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225100052 (102h14m6.956367702s) [seg_pos={0 0}, upload=106455]: Segment reached optimal threshold of 14 pieces. Aug 12 23:40:26.225281113 (102h14m6.956548763s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225297233 (102h14m6.956564873s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fD69hzWAhaScaVnRiPMZEFbybabwe1qfRZYfxZtwkFkze9wM4): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225380810 (102h14m6.956648451s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225466812 (102h14m6.956734462s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225501978 (102h14m6.956769628s) [seg_pos={0 0}, upload=106455]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 23:40:26.225586546 (102h14m6.956854197s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 23:40:26.225591897 (102h14m6.956859546s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:40:26.440491076 (102h14m7.171758727s) [upload=106455]: Done uploading segments... Aug 12 23:40:26.440509852 (102h14m7.171777492s) [upload=106455]: Upload finished. err: <nil> Duration: 670.656304ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X............................................X.....] duration: 203.510676ms FAIL (2025-08-12 23:45:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:40:34.762477818 (102h14m15.493745448s) [upload=106459]: Starting upload Aug 12 23:40:34.762518555 (102h14m15.493786175s) [upload=106459]: Done starting upload Aug 12 23:40:34.762557007 (102h14m15.493824627s) [upload=106459]: Uploading segments... Aug 12 23:40:34.762583717 (102h14m15.493851347s) [upload=106459]: Got next segment. Inline: true Aug 12 23:40:34.762587124 (102h14m15.493854754s) [upload=106459]: Waiting for error group managing segments... Aug 12 23:40:34.762616008 (102h14m15.493883638s) [upload=106459]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:40:34.762620387 (102h14m15.493888017s) [upload=106459]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:40:34.762622741 (102h14m15.493890361s) [upload=106459]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:40:34.765324408 (102h14m15.496592038s) [upload=106459]: Done uploading segments... Aug 12 23:40:34.765331843 (102h14m15.496599473s) [upload=106459]: Upload finished. err: metaclient: Too Many Requests Duration:* 203.533868ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.194490397s FAIL (2025-08-12 23:44:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 12 23:40:25.602807394 (102h14m6.334075015s) [upload=106455]: Starting upload Aug 12 23:40:25.602843082 (102h14m6.334110712s) [upload=106455]: Done starting upload Aug 12 23:40:25.603071431 (102h14m6.334339091s) [upload=106455]: Uploading segments... Aug 12 23:40:25.603211064 (102h14m6.334478714s) [upload=106455]: Got next segment. Inline: false Aug 12 23:40:25.603266829 (102h14m6.334534478s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:40:25.603273010 (102h14m6.33454067s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 23:40:25.640478671 (102h14m6.371746301s) [seg_pos={0 0}, upload=106455]: Begin upload segment... Aug 12 23:40:25.640504920 (102h14m6.371772541s) [seg_pos={0 0}, upload=106455]: Done begin upload segment. Aug 12 23:40:25.640551027 (102h14m6.371818647s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640606341 (102h14m6.37187399s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640858084 (102h14m6.372125714s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641082025 (102h14m6.372349655s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641155102 (102h14m6.372422752s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641332385 (102h14m6.372600015s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641619525 (102h14m6.372887145s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641631898 (102h14m6.372899558s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641841422 (102h14m6.373109042s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642035477 (102h14m6.373303127s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642064592 (102h14m6.373332211s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642342704 (102h14m6.373610334s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642562778 (102h14m6.373830428s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643065462 (102h14m6.374333113s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643497335 (102h14m6.374764995s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643885824 (102h14m6.375153474s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.645513935 (102h14m6.376781585s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.646074248 (102h14m6.377341898s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.743022691 (102h14m6.474290311s) [upload=106455]: Next returned nil segment Aug 12 23:40:25.743031648 (102h14m6.474299267s) [upload=106455]: Waiting for error group managing segments... Aug 12 23:40:25.755181243 (102h14m6.486448863s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.758249461 (102h14m6.48951711s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763254367 (102h14m6.494522027s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763286398 (102h14m6.494554047s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.782074191 (102h14m6.513341841s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.783971977 (102h14m6.515239597s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.787348233 (102h14m6.518615854s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.795444812 (102h14m6.526712432s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.803325063 (102h14m6.534592683s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.806351462 (102h14m6.537619122s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.874479634 (102h14m6.605747264s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.071197169 (102h14m6.80246482s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.084338160 (102h14m6.81560581s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225062191 (102h14m6.956329831s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225100052 (102h14m6.956367702s) [seg_pos={0 0}, upload=106455]: Segment reached optimal threshold of 14 pieces. Aug 12 23:40:26.225281113 (102h14m6.956548763s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225297233 (102h14m6.956564873s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fD69hzWAhaScaVnRiPMZEFbybabwe1qfRZYfxZtwkFkze9wM4): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225380810 (102h14m6.956648451s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225466812 (102h14m6.956734462s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225501978 (102h14m6.956769628s) [seg_pos={0 0}, upload=106455]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 23:40:26.225586546 (102h14m6.956854197s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 23:40:26.225591897 (102h14m6.956859546s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:40:26.440491076 (102h14m7.171758727s) [upload=106455]: Done uploading segments... Aug 12 23:40:26.440509852 (102h14m7.171777492s) [upload=106455]: Upload finished. err: <nil> Duration: 1.19451353s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X............................................X....] duration: 290.007562ms FAIL (2025-08-12 23:44:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:40:34.762477818 (102h14m15.493745448s) [upload=106459]: Starting upload Aug 12 23:40:34.762518555 (102h14m15.493786175s) [upload=106459]: Done starting upload Aug 12 23:40:34.762557007 (102h14m15.493824627s) [upload=106459]: Uploading segments... Aug 12 23:40:34.762583717 (102h14m15.493851347s) [upload=106459]: Got next segment. Inline: true Aug 12 23:40:34.762587124 (102h14m15.493854754s) [upload=106459]: Waiting for error group managing segments... Aug 12 23:40:34.762616008 (102h14m15.493883638s) [upload=106459]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:40:34.762620387 (102h14m15.493888017s) [upload=106459]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:40:34.762622741 (102h14m15.493890361s) [upload=106459]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:40:34.765324408 (102h14m15.496592038s) [upload=106459]: Done uploading segments... Aug 12 23:40:34.765331843 (102h14m15.496599473s) [upload=106459]: Upload finished. err: metaclient: Too Many Requests Duration:* 290.031116ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 919.067299ms FAIL (2025-08-12 23:44:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 12 23:40:25.602807394 (102h14m6.334075015s) [upload=106455]: Starting upload Aug 12 23:40:25.602843082 (102h14m6.334110712s) [upload=106455]: Done starting upload Aug 12 23:40:25.603071431 (102h14m6.334339091s) [upload=106455]: Uploading segments... Aug 12 23:40:25.603211064 (102h14m6.334478714s) [upload=106455]: Got next segment. Inline: false Aug 12 23:40:25.603266829 (102h14m6.334534478s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:40:25.603273010 (102h14m6.33454067s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 23:40:25.640478671 (102h14m6.371746301s) [seg_pos={0 0}, upload=106455]: Begin upload segment... Aug 12 23:40:25.640504920 (102h14m6.371772541s) [seg_pos={0 0}, upload=106455]: Done begin upload segment. Aug 12 23:40:25.640551027 (102h14m6.371818647s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640606341 (102h14m6.37187399s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640858084 (102h14m6.372125714s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641082025 (102h14m6.372349655s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641155102 (102h14m6.372422752s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641332385 (102h14m6.372600015s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641619525 (102h14m6.372887145s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641631898 (102h14m6.372899558s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641841422 (102h14m6.373109042s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642035477 (102h14m6.373303127s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642064592 (102h14m6.373332211s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642342704 (102h14m6.373610334s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642562778 (102h14m6.373830428s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643065462 (102h14m6.374333113s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643497335 (102h14m6.374764995s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643885824 (102h14m6.375153474s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.645513935 (102h14m6.376781585s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.646074248 (102h14m6.377341898s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.743022691 (102h14m6.474290311s) [upload=106455]: Next returned nil segment Aug 12 23:40:25.743031648 (102h14m6.474299267s) [upload=106455]: Waiting for error group managing segments... Aug 12 23:40:25.755181243 (102h14m6.486448863s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.758249461 (102h14m6.48951711s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763254367 (102h14m6.494522027s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763286398 (102h14m6.494554047s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.782074191 (102h14m6.513341841s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.783971977 (102h14m6.515239597s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.787348233 (102h14m6.518615854s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.795444812 (102h14m6.526712432s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.803325063 (102h14m6.534592683s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.806351462 (102h14m6.537619122s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.874479634 (102h14m6.605747264s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.071197169 (102h14m6.80246482s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.084338160 (102h14m6.81560581s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225062191 (102h14m6.956329831s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225100052 (102h14m6.956367702s) [seg_pos={0 0}, upload=106455]: Segment reached optimal threshold of 14 pieces. Aug 12 23:40:26.225281113 (102h14m6.956548763s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225297233 (102h14m6.956564873s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fD69hzWAhaScaVnRiPMZEFbybabwe1qfRZYfxZtwkFkze9wM4): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225380810 (102h14m6.956648451s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225466812 (102h14m6.956734462s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225501978 (102h14m6.956769628s) [seg_pos={0 0}, upload=106455]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 23:40:26.225586546 (102h14m6.956854197s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 23:40:26.225591897 (102h14m6.956859546s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:40:26.440491076 (102h14m7.171758727s) [upload=106455]: Done uploading segments... Aug 12 23:40:26.440509852 (102h14m7.171777492s) [upload=106455]: Upload finished. err: <nil> Duration: 919.096794ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 482.338984ms FAIL (2025-08-12 23:43:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 12 23:40:25.602807394 (102h14m6.334075015s) [upload=106455]: Starting upload Aug 12 23:40:25.602843082 (102h14m6.334110712s) [upload=106455]: Done starting upload Aug 12 23:40:25.603071431 (102h14m6.334339091s) [upload=106455]: Uploading segments... Aug 12 23:40:25.603211064 (102h14m6.334478714s) [upload=106455]: Got next segment. Inline: false Aug 12 23:40:25.603266829 (102h14m6.334534478s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:40:25.603273010 (102h14m6.33454067s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 23:40:25.640478671 (102h14m6.371746301s) [seg_pos={0 0}, upload=106455]: Begin upload segment... Aug 12 23:40:25.640504920 (102h14m6.371772541s) [seg_pos={0 0}, upload=106455]: Done begin upload segment. Aug 12 23:40:25.640551027 (102h14m6.371818647s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640606341 (102h14m6.37187399s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640858084 (102h14m6.372125714s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641082025 (102h14m6.372349655s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641155102 (102h14m6.372422752s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641332385 (102h14m6.372600015s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641619525 (102h14m6.372887145s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641631898 (102h14m6.372899558s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641841422 (102h14m6.373109042s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642035477 (102h14m6.373303127s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642064592 (102h14m6.373332211s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642342704 (102h14m6.373610334s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642562778 (102h14m6.373830428s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643065462 (102h14m6.374333113s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643497335 (102h14m6.374764995s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643885824 (102h14m6.375153474s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.645513935 (102h14m6.376781585s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.646074248 (102h14m6.377341898s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.743022691 (102h14m6.474290311s) [upload=106455]: Next returned nil segment Aug 12 23:40:25.743031648 (102h14m6.474299267s) [upload=106455]: Waiting for error group managing segments... Aug 12 23:40:25.755181243 (102h14m6.486448863s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.758249461 (102h14m6.48951711s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763254367 (102h14m6.494522027s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763286398 (102h14m6.494554047s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.782074191 (102h14m6.513341841s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.783971977 (102h14m6.515239597s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.787348233 (102h14m6.518615854s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.795444812 (102h14m6.526712432s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.803325063 (102h14m6.534592683s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.806351462 (102h14m6.537619122s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.874479634 (102h14m6.605747264s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.071197169 (102h14m6.80246482s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.084338160 (102h14m6.81560581s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225062191 (102h14m6.956329831s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225100052 (102h14m6.956367702s) [seg_pos={0 0}, upload=106455]: Segment reached optimal threshold of 14 pieces. Aug 12 23:40:26.225281113 (102h14m6.956548763s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225297233 (102h14m6.956564873s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fD69hzWAhaScaVnRiPMZEFbybabwe1qfRZYfxZtwkFkze9wM4): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225380810 (102h14m6.956648451s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225466812 (102h14m6.956734462s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225501978 (102h14m6.956769628s) [seg_pos={0 0}, upload=106455]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 23:40:26.225586546 (102h14m6.956854197s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 23:40:26.225591897 (102h14m6.956859546s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:40:26.440491076 (102h14m7.171758727s) [upload=106455]: Done uploading segments... Aug 12 23:40:26.440509852 (102h14m7.171777492s) [upload=106455]: Upload finished. err: <nil> Duration: 482.368499ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X............................................X...] duration: 141.681057ms FAIL (2025-08-12 23:43:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:40:34.762477818 (102h14m15.493745448s) [upload=106459]: Starting upload Aug 12 23:40:34.762518555 (102h14m15.493786175s) [upload=106459]: Done starting upload Aug 12 23:40:34.762557007 (102h14m15.493824627s) [upload=106459]: Uploading segments... Aug 12 23:40:34.762583717 (102h14m15.493851347s) [upload=106459]: Got next segment. Inline: true Aug 12 23:40:34.762587124 (102h14m15.493854754s) [upload=106459]: Waiting for error group managing segments... Aug 12 23:40:34.762616008 (102h14m15.493883638s) [upload=106459]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:40:34.762620387 (102h14m15.493888017s) [upload=106459]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:40:34.762622741 (102h14m15.493890361s) [upload=106459]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:40:34.765324408 (102h14m15.496592038s) [upload=106459]: Done uploading segments... Aug 12 23:40:34.765331843 (102h14m15.496599473s) [upload=106459]: Upload finished. err: metaclient: Too Many Requests Duration:* 141.709661ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 788.169362ms FAIL (2025-08-12 23:43:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 12 23:40:25.602807394 (102h14m6.334075015s) [upload=106455]: Starting upload Aug 12 23:40:25.602843082 (102h14m6.334110712s) [upload=106455]: Done starting upload Aug 12 23:40:25.603071431 (102h14m6.334339091s) [upload=106455]: Uploading segments... Aug 12 23:40:25.603211064 (102h14m6.334478714s) [upload=106455]: Got next segment. Inline: false Aug 12 23:40:25.603266829 (102h14m6.334534478s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:40:25.603273010 (102h14m6.33454067s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 23:40:25.640478671 (102h14m6.371746301s) [seg_pos={0 0}, upload=106455]: Begin upload segment... Aug 12 23:40:25.640504920 (102h14m6.371772541s) [seg_pos={0 0}, upload=106455]: Done begin upload segment. Aug 12 23:40:25.640551027 (102h14m6.371818647s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640606341 (102h14m6.37187399s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640858084 (102h14m6.372125714s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641082025 (102h14m6.372349655s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641155102 (102h14m6.372422752s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641332385 (102h14m6.372600015s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641619525 (102h14m6.372887145s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641631898 (102h14m6.372899558s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641841422 (102h14m6.373109042s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642035477 (102h14m6.373303127s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642064592 (102h14m6.373332211s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642342704 (102h14m6.373610334s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642562778 (102h14m6.373830428s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643065462 (102h14m6.374333113s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643497335 (102h14m6.374764995s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643885824 (102h14m6.375153474s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.645513935 (102h14m6.376781585s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.646074248 (102h14m6.377341898s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.743022691 (102h14m6.474290311s) [upload=106455]: Next returned nil segment Aug 12 23:40:25.743031648 (102h14m6.474299267s) [upload=106455]: Waiting for error group managing segments... Aug 12 23:40:25.755181243 (102h14m6.486448863s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.758249461 (102h14m6.48951711s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763254367 (102h14m6.494522027s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763286398 (102h14m6.494554047s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.782074191 (102h14m6.513341841s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.783971977 (102h14m6.515239597s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.787348233 (102h14m6.518615854s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.795444812 (102h14m6.526712432s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.803325063 (102h14m6.534592683s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.806351462 (102h14m6.537619122s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.874479634 (102h14m6.605747264s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.071197169 (102h14m6.80246482s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.084338160 (102h14m6.81560581s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225062191 (102h14m6.956329831s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225100052 (102h14m6.956367702s) [seg_pos={0 0}, upload=106455]: Segment reached optimal threshold of 14 pieces. Aug 12 23:40:26.225281113 (102h14m6.956548763s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225297233 (102h14m6.956564873s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fD69hzWAhaScaVnRiPMZEFbybabwe1qfRZYfxZtwkFkze9wM4): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225380810 (102h14m6.956648451s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225466812 (102h14m6.956734462s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225501978 (102h14m6.956769628s) [seg_pos={0 0}, upload=106455]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 23:40:26.225586546 (102h14m6.956854197s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 23:40:26.225591897 (102h14m6.956859546s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:40:26.440491076 (102h14m7.171758727s) [upload=106455]: Done uploading segments... Aug 12 23:40:26.440509852 (102h14m7.171777492s) [upload=106455]: Upload finished. err: <nil> Duration: 788.196394ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 428.940226ms FAIL (2025-08-12 23:43:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 12 23:40:25.602807394 (102h14m6.334075015s) [upload=106455]: Starting upload Aug 12 23:40:25.602843082 (102h14m6.334110712s) [upload=106455]: Done starting upload Aug 12 23:40:25.603071431 (102h14m6.334339091s) [upload=106455]: Uploading segments... Aug 12 23:40:25.603211064 (102h14m6.334478714s) [upload=106455]: Got next segment. Inline: false Aug 12 23:40:25.603266829 (102h14m6.334534478s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:40:25.603273010 (102h14m6.33454067s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 23:40:25.640478671 (102h14m6.371746301s) [seg_pos={0 0}, upload=106455]: Begin upload segment... Aug 12 23:40:25.640504920 (102h14m6.371772541s) [seg_pos={0 0}, upload=106455]: Done begin upload segment. Aug 12 23:40:25.640551027 (102h14m6.371818647s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640606341 (102h14m6.37187399s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640858084 (102h14m6.372125714s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641082025 (102h14m6.372349655s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641155102 (102h14m6.372422752s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641332385 (102h14m6.372600015s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641619525 (102h14m6.372887145s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641631898 (102h14m6.372899558s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641841422 (102h14m6.373109042s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642035477 (102h14m6.373303127s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642064592 (102h14m6.373332211s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642342704 (102h14m6.373610334s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642562778 (102h14m6.373830428s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643065462 (102h14m6.374333113s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643497335 (102h14m6.374764995s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643885824 (102h14m6.375153474s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.645513935 (102h14m6.376781585s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.646074248 (102h14m6.377341898s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.743022691 (102h14m6.474290311s) [upload=106455]: Next returned nil segment Aug 12 23:40:25.743031648 (102h14m6.474299267s) [upload=106455]: Waiting for error group managing segments... Aug 12 23:40:25.755181243 (102h14m6.486448863s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.758249461 (102h14m6.48951711s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763254367 (102h14m6.494522027s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763286398 (102h14m6.494554047s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.782074191 (102h14m6.513341841s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.783971977 (102h14m6.515239597s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.787348233 (102h14m6.518615854s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.795444812 (102h14m6.526712432s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.803325063 (102h14m6.534592683s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.806351462 (102h14m6.537619122s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.874479634 (102h14m6.605747264s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.071197169 (102h14m6.80246482s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.084338160 (102h14m6.81560581s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225062191 (102h14m6.956329831s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225100052 (102h14m6.956367702s) [seg_pos={0 0}, upload=106455]: Segment reached optimal threshold of 14 pieces. Aug 12 23:40:26.225281113 (102h14m6.956548763s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225297233 (102h14m6.956564873s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fD69hzWAhaScaVnRiPMZEFbybabwe1qfRZYfxZtwkFkze9wM4): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225380810 (102h14m6.956648451s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225466812 (102h14m6.956734462s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225501978 (102h14m6.956769628s) [seg_pos={0 0}, upload=106455]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 23:40:26.225586546 (102h14m6.956854197s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 23:40:26.225591897 (102h14m6.956859546s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:40:26.440491076 (102h14m7.171758727s) [upload=106455]: Done uploading segments... Aug 12 23:40:26.440509852 (102h14m7.171777492s) [upload=106455]: Upload finished. err: <nil> Duration: 428.970143ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X............................................X..] duration: 152.298397ms FAIL (2025-08-12 23:42:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:40:34.762477818 (102h14m15.493745448s) [upload=106459]: Starting upload Aug 12 23:40:34.762518555 (102h14m15.493786175s) [upload=106459]: Done starting upload Aug 12 23:40:34.762557007 (102h14m15.493824627s) [upload=106459]: Uploading segments... Aug 12 23:40:34.762583717 (102h14m15.493851347s) [upload=106459]: Got next segment. Inline: true Aug 12 23:40:34.762587124 (102h14m15.493854754s) [upload=106459]: Waiting for error group managing segments... Aug 12 23:40:34.762616008 (102h14m15.493883638s) [upload=106459]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:40:34.762620387 (102h14m15.493888017s) [upload=106459]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:40:34.762622741 (102h14m15.493890361s) [upload=106459]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:40:34.765324408 (102h14m15.496592038s) [upload=106459]: Done uploading segments... Aug 12 23:40:34.765331843 (102h14m15.496599473s) [upload=106459]: Upload finished. err: metaclient: Too Many Requests Duration:* 152.333562ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 505.62907ms FAIL (2025-08-12 23:42:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 12 23:40:25.602807394 (102h14m6.334075015s) [upload=106455]: Starting upload Aug 12 23:40:25.602843082 (102h14m6.334110712s) [upload=106455]: Done starting upload Aug 12 23:40:25.603071431 (102h14m6.334339091s) [upload=106455]: Uploading segments... Aug 12 23:40:25.603211064 (102h14m6.334478714s) [upload=106455]: Got next segment. Inline: false Aug 12 23:40:25.603266829 (102h14m6.334534478s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:40:25.603273010 (102h14m6.33454067s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 23:40:25.640478671 (102h14m6.371746301s) [seg_pos={0 0}, upload=106455]: Begin upload segment... Aug 12 23:40:25.640504920 (102h14m6.371772541s) [seg_pos={0 0}, upload=106455]: Done begin upload segment. Aug 12 23:40:25.640551027 (102h14m6.371818647s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640606341 (102h14m6.37187399s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640858084 (102h14m6.372125714s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641082025 (102h14m6.372349655s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641155102 (102h14m6.372422752s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641332385 (102h14m6.372600015s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641619525 (102h14m6.372887145s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641631898 (102h14m6.372899558s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641841422 (102h14m6.373109042s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642035477 (102h14m6.373303127s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642064592 (102h14m6.373332211s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642342704 (102h14m6.373610334s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642562778 (102h14m6.373830428s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643065462 (102h14m6.374333113s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643497335 (102h14m6.374764995s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643885824 (102h14m6.375153474s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.645513935 (102h14m6.376781585s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.646074248 (102h14m6.377341898s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.743022691 (102h14m6.474290311s) [upload=106455]: Next returned nil segment Aug 12 23:40:25.743031648 (102h14m6.474299267s) [upload=106455]: Waiting for error group managing segments... Aug 12 23:40:25.755181243 (102h14m6.486448863s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.758249461 (102h14m6.48951711s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763254367 (102h14m6.494522027s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763286398 (102h14m6.494554047s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.782074191 (102h14m6.513341841s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.783971977 (102h14m6.515239597s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.787348233 (102h14m6.518615854s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.795444812 (102h14m6.526712432s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.803325063 (102h14m6.534592683s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.806351462 (102h14m6.537619122s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.874479634 (102h14m6.605747264s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.071197169 (102h14m6.80246482s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.084338160 (102h14m6.81560581s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225062191 (102h14m6.956329831s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225100052 (102h14m6.956367702s) [seg_pos={0 0}, upload=106455]: Segment reached optimal threshold of 14 pieces. Aug 12 23:40:26.225281113 (102h14m6.956548763s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225297233 (102h14m6.956564873s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fD69hzWAhaScaVnRiPMZEFbybabwe1qfRZYfxZtwkFkze9wM4): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225380810 (102h14m6.956648451s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225466812 (102h14m6.956734462s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225501978 (102h14m6.956769628s) [seg_pos={0 0}, upload=106455]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 23:40:26.225586546 (102h14m6.956854197s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 23:40:26.225591897 (102h14m6.956859546s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:40:26.440491076 (102h14m7.171758727s) [upload=106455]: Done uploading segments... Aug 12 23:40:26.440509852 (102h14m7.171777492s) [upload=106455]: Upload finished. err: <nil> Duration: 505.656581ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X............................................X.] duration: 175.929724ms FAIL (2025-08-12 23:41:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:40:34.762477818 (102h14m15.493745448s) [upload=106459]: Starting upload Aug 12 23:40:34.762518555 (102h14m15.493786175s) [upload=106459]: Done starting upload Aug 12 23:40:34.762557007 (102h14m15.493824627s) [upload=106459]: Uploading segments... Aug 12 23:40:34.762583717 (102h14m15.493851347s) [upload=106459]: Got next segment. Inline: true Aug 12 23:40:34.762587124 (102h14m15.493854754s) [upload=106459]: Waiting for error group managing segments... Aug 12 23:40:34.762616008 (102h14m15.493883638s) [upload=106459]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:40:34.762620387 (102h14m15.493888017s) [upload=106459]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:40:34.762622741 (102h14m15.493890361s) [upload=106459]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:40:34.765324408 (102h14m15.496592038s) [upload=106459]: Done uploading segments... Aug 12 23:40:34.765331843 (102h14m15.496599473s) [upload=106459]: Upload finished. err: metaclient: Too Many Requests Duration:* 175.95367ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 533.473183ms FAIL (2025-08-12 23:41:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 12 23:40:25.602807394 (102h14m6.334075015s) [upload=106455]: Starting upload Aug 12 23:40:25.602843082 (102h14m6.334110712s) [upload=106455]: Done starting upload Aug 12 23:40:25.603071431 (102h14m6.334339091s) [upload=106455]: Uploading segments... Aug 12 23:40:25.603211064 (102h14m6.334478714s) [upload=106455]: Got next segment. Inline: false Aug 12 23:40:25.603266829 (102h14m6.334534478s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:40:25.603273010 (102h14m6.33454067s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 23:40:25.640478671 (102h14m6.371746301s) [seg_pos={0 0}, upload=106455]: Begin upload segment... Aug 12 23:40:25.640504920 (102h14m6.371772541s) [seg_pos={0 0}, upload=106455]: Done begin upload segment. Aug 12 23:40:25.640551027 (102h14m6.371818647s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640606341 (102h14m6.37187399s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640858084 (102h14m6.372125714s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641082025 (102h14m6.372349655s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641155102 (102h14m6.372422752s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641332385 (102h14m6.372600015s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641619525 (102h14m6.372887145s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641631898 (102h14m6.372899558s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641841422 (102h14m6.373109042s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642035477 (102h14m6.373303127s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642064592 (102h14m6.373332211s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642342704 (102h14m6.373610334s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642562778 (102h14m6.373830428s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643065462 (102h14m6.374333113s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643497335 (102h14m6.374764995s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643885824 (102h14m6.375153474s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.645513935 (102h14m6.376781585s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.646074248 (102h14m6.377341898s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.743022691 (102h14m6.474290311s) [upload=106455]: Next returned nil segment Aug 12 23:40:25.743031648 (102h14m6.474299267s) [upload=106455]: Waiting for error group managing segments... Aug 12 23:40:25.755181243 (102h14m6.486448863s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.758249461 (102h14m6.48951711s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763254367 (102h14m6.494522027s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763286398 (102h14m6.494554047s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.782074191 (102h14m6.513341841s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.783971977 (102h14m6.515239597s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.787348233 (102h14m6.518615854s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.795444812 (102h14m6.526712432s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.803325063 (102h14m6.534592683s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.806351462 (102h14m6.537619122s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.874479634 (102h14m6.605747264s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.071197169 (102h14m6.80246482s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.084338160 (102h14m6.81560581s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225062191 (102h14m6.956329831s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225100052 (102h14m6.956367702s) [seg_pos={0 0}, upload=106455]: Segment reached optimal threshold of 14 pieces. Aug 12 23:40:26.225281113 (102h14m6.956548763s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225297233 (102h14m6.956564873s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fD69hzWAhaScaVnRiPMZEFbybabwe1qfRZYfxZtwkFkze9wM4): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225380810 (102h14m6.956648451s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225466812 (102h14m6.956734462s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225501978 (102h14m6.956769628s) [seg_pos={0 0}, upload=106455]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 23:40:26.225586546 (102h14m6.956854197s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 23:40:26.225591897 (102h14m6.956859546s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:40:26.440491076 (102h14m7.171758727s) [upload=106455]: Done uploading segments... Aug 12 23:40:26.440509852 (102h14m7.171777492s) [upload=106455]: Upload finished. err: <nil> Duration: 533.498651ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X............................................X] duration: 14.547232ms FAIL (2025-08-12 23:40:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:40:34.762477818 (102h14m15.493745448s) [upload=106459]: Starting upload Aug 12 23:40:34.762518555 (102h14m15.493786175s) [upload=106459]: Done starting upload Aug 12 23:40:34.762557007 (102h14m15.493824627s) [upload=106459]: Uploading segments... Aug 12 23:40:34.762583717 (102h14m15.493851347s) [upload=106459]: Got next segment. Inline: true Aug 12 23:40:34.762587124 (102h14m15.493854754s) [upload=106459]: Waiting for error group managing segments... Aug 12 23:40:34.762616008 (102h14m15.493883638s) [upload=106459]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:40:34.762620387 (102h14m15.493888017s) [upload=106459]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:40:34.762622741 (102h14m15.493890361s) [upload=106459]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:40:34.765324408 (102h14m15.496592038s) [upload=106459]: Done uploading segments... Aug 12 23:40:34.765331843 (102h14m15.496599473s) [upload=106459]: Upload finished. err: metaclient: Too Many Requests Duration:* 14.562701ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 915.551301ms FAIL (2025-08-12 23:40:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:4194304 (size:4194304) ======LOGS====== Aug 12 23:40:25.602807394 (102h14m6.334075015s) [upload=106455]: Starting upload Aug 12 23:40:25.602843082 (102h14m6.334110712s) [upload=106455]: Done starting upload Aug 12 23:40:25.603071431 (102h14m6.334339091s) [upload=106455]: Uploading segments... Aug 12 23:40:25.603211064 (102h14m6.334478714s) [upload=106455]: Got next segment. Inline: false Aug 12 23:40:25.603266829 (102h14m6.334534478s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:40:25.603273010 (102h14m6.33454067s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 23:40:25.640478671 (102h14m6.371746301s) [seg_pos={0 0}, upload=106455]: Begin upload segment... Aug 12 23:40:25.640504920 (102h14m6.371772541s) [seg_pos={0 0}, upload=106455]: Done begin upload segment. Aug 12 23:40:25.640551027 (102h14m6.371818647s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640606341 (102h14m6.37187399s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.640858084 (102h14m6.372125714s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641082025 (102h14m6.372349655s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641155102 (102h14m6.372422752s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641332385 (102h14m6.372600015s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641619525 (102h14m6.372887145s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641631898 (102h14m6.372899558s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.641841422 (102h14m6.373109042s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642035477 (102h14m6.373303127s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642064592 (102h14m6.373332211s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642342704 (102h14m6.373610334s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.642562778 (102h14m6.373830428s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643065462 (102h14m6.374333113s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643497335 (102h14m6.374764995s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.643885824 (102h14m6.375153474s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.645513935 (102h14m6.376781585s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.646074248 (102h14m6.377341898s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Uploading piece... Aug 12 23:40:25.743022691 (102h14m6.474290311s) [upload=106455]: Next returned nil segment Aug 12 23:40:25.743031648 (102h14m6.474299267s) [upload=106455]: Waiting for error group managing segments... Aug 12 23:40:25.755181243 (102h14m6.486448863s) [noise=true , address=104.36.82.36:4643 , piece_id=IGCII5QSMVCENS3INDJDQC2N7BY2KA7NSPBPSDPQMPJVGXEQ3CRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.758249461 (102h14m6.48951711s) [noise=true , address=104.36.82.49:4006 , piece_id=HT5NKSMQNO2RLW7EXQ7GXYQBO23K5PPURTO5Y7MZYKCMIHKTUALQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763254367 (102h14m6.494522027s) [noise=true , address=104.36.82.59:4332 , piece_id=J4RA4CFV7UM7LEWGFGLZ25RECYIAMJ5FQPGDS2FIZPJZPDKQ3CDA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.763286398 (102h14m6.494554047s) [noise=true , address=104.36.82.59:4308 , piece_id=Y65MS2FLBEFOYCWACPEQZPPE66NHKFGN5KZ6XUX5HTDXH5OS7GQA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.782074191 (102h14m6.513341841s) [noise=true , address=104.36.82.8:4993 , piece_id=EZFRRAXHFZEQND23OBYKRJ2XONLHGQDLXV4QABOQHUDW24SGO2RA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.783971977 (102h14m6.515239597s) [noise=true , address=104.36.82.17:4344 , piece_id=2NEQNYK2FJBROQB2FXNJLPSO3XJHPM6EQKO7XLTBFIAXV43NCN6Q, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.787348233 (102h14m6.518615854s) [noise=true , address=77.90.31.11:4580 , piece_id=NOPVLS4PONRE7NPF2L7GCVQGPUOX2N5FY4OQSWNVJMZ77CXCMWMQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.795444812 (102h14m6.526712432s) [noise=true , address=77.90.31.14:4675 , piece_id=E5EK3KTIUJGQJHGWRGMX323CYQKBBZQ5MZ76H37A65WBN5OVPM2A, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.803325063 (102h14m6.534592683s) [noise=true , address=77.90.31.16:4738 , piece_id=UTOV2G2J32TOBIWE3J2SRC5RTMJK27VIIC7I35XJJ24QAKEPE3XQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.806351462 (102h14m6.537619122s) [noise=true , address=104.36.82.5:4852 , piece_id=AQTLSP5VWHQPAL6YFX5FBYTM7EWCORN5WCSWGK2OA2EPMWWJXOAQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:25.874479634 (102h14m6.605747264s) [noise=true , address=104.36.82.61:4406 , piece_id=BYDOPDT77YZDM3OCAGQKSBZTRZP2R743CU56THUEU2KV3HDIAVTA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.071197169 (102h14m6.80246482s) [noise=true , address=104.36.82.60:4343 , piece_id=PO5A6WLC5HVR7MIC3WAPUU6IJZKUMJ7N5R32GQDGQ67TOMERSMTQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.084338160 (102h14m6.81560581s) [noise=true , address=156.146.43.225:4445 , piece_id=SSQESVQLWAKNUSEGMUUDGG5ALOHYDHM4LDCKMN2IYF6QCTYSL5FA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225062191 (102h14m6.956329831s) [noise=true , address=64.49.13.169:4708 , piece_id=UZGAF2QKCIJ55QAUBDK5T2VWIUHMRMEQSEW7Y6O3J7ZXMNV6HOCQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: <nil> Aug 12 23:40:26.225100052 (102h14m6.956367702s) [seg_pos={0 0}, upload=106455]: Segment reached optimal threshold of 14 pieces. Aug 12 23:40:26.225281113 (102h14m6.956548763s) [noise=true , address=64.49.13.140:4511 , piece_id=42SXX72RQ7MERWXREDWMKNMZGFMHY45OBKJS4MGLLL6UBL5YLFLQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225297233 (102h14m6.956564873s) [noise=true , address=79.127.205.233:4624 , piece_id=Y5I4IBBHMTUHHZT5RUXWYHS77KAPFUFRUPTAARELKX64IHZISTRQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fD69hzWAhaScaVnRiPMZEFbybabwe1qfRZYfxZtwkFkze9wM4): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225380810 (102h14m6.956648451s) [noise=true , address=104.36.82.23:4479 , piece_id=WPVJ6PVEMU2KGEGV3BLRLYPIRW4T5G6URBMU3FQA2GRRKOGTMKZA, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225466812 (102h14m6.956734462s) [noise=true , address=79.127.201.215:4347 , piece_id=ID5R4BV3TJ42HKKQFX4LWKONNTAKAOHDRFTS7X5P6DFWRQCX5PPQ, seg_pos={0 0}, upload=106455]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ND5WrCasfsKiniSUtKTzrgZaDkHQtJ5CyrL7yXGZx5gtaF5dF): protocol: expected piece hash; context canceled; EOF Aug 12 23:40:26.225501978 (102h14m6.956769628s) [seg_pos={0 0}, upload=106455]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 23:40:26.225586546 (102h14m6.956854197s) [upload=106455]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 23:40:26.225591897 (102h14m6.956859546s) [upload=106455]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:40:26.440491076 (102h14m7.171758727s) [upload=106455]: Done uploading segments... Aug 12 23:40:26.440509852 (102h14m7.171777492s) [upload=106455]: Upload finished. err: <nil> Duration: 915.567521ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 166.144242ms FAIL (2025-08-12 23:39:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 166.165963ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 212.473851ms FAIL (2025-08-12 23:38:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 212.496334ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 201.110482ms FAIL (2025-08-12 23:38:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 201.127764ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 185.87128ms FAIL (2025-08-12 23:37:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 185.900995ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 292.632124ms FAIL (2025-08-12 23:36:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 292.646201ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 165.644361ms FAIL (2025-08-12 23:35:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 165.672373ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 175.635227ms FAIL (2025-08-12 23:34:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 175.655546ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 331.758166ms FAIL (2025-08-12 23:34:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 331.78748ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 263.537539ms FAIL (2025-08-12 23:33:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 263.57567ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 197.739867ms FAIL (2025-08-12 23:32:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 197.760225ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 253.474595ms FAIL (2025-08-12 23:31:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 253.505052ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 241.640212ms FAIL (2025-08-12 23:31:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 241.664027ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 295.323324ms FAIL (2025-08-12 23:30:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 295.392504ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 350.495628ms FAIL (2025-08-12 23:30:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 350.525976ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 167.707619ms FAIL (2025-08-12 23:29:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 167.735521ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 199.559377ms FAIL (2025-08-12 23:28:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 199.580256ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 605.010665ms FAIL (2025-08-12 23:28:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 22:40:43.425431886 (101h14m24.156699505s) [upload=105406]: Starting upload Aug 12 22:40:43.425467372 (101h14m24.156735002s) [upload=105406]: Done starting upload Aug 12 22:40:43.425678669 (101h14m24.156946289s) [upload=105406]: Uploading segments... Aug 12 22:40:43.425701793 (101h14m24.156969412s) [upload=105406]: Got next segment. Inline: false Aug 12 22:40:43.425727020 (101h14m24.15699465s) [upload=105406]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 22:40:43.425730356 (101h14m24.156997986s) [upload=105406]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 22:40:43.428062399 (101h14m24.159330019s) [upload=105406]: Next segment err: metaclient: Too Many Requests Aug 12 22:40:43.428076966 (101h14m24.159344596s) [upload=105406]: Done uploading segments... Aug 12 22:40:43.428090952 (101h14m24.159358582s) [upload=105406]: Upload finished. err: metaclient: Too Many Requests Duration: 605.041292ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 218.721044ms FAIL (2025-08-12 23:28:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 218.752773ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 705.768377ms FAIL (2025-08-12 23:28:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 22:40:43.425431886 (101h14m24.156699505s) [upload=105406]: Starting upload Aug 12 22:40:43.425467372 (101h14m24.156735002s) [upload=105406]: Done starting upload Aug 12 22:40:43.425678669 (101h14m24.156946289s) [upload=105406]: Uploading segments... Aug 12 22:40:43.425701793 (101h14m24.156969412s) [upload=105406]: Got next segment. Inline: false Aug 12 22:40:43.425727020 (101h14m24.15699465s) [upload=105406]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 22:40:43.425730356 (101h14m24.156997986s) [upload=105406]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 22:40:43.428062399 (101h14m24.159330019s) [upload=105406]: Next segment err: metaclient: Too Many Requests Aug 12 22:40:43.428076966 (101h14m24.159344596s) [upload=105406]: Done uploading segments... Aug 12 22:40:43.428090952 (101h14m24.159358582s) [upload=105406]: Upload finished. err: metaclient: Too Many Requests Duration: 705.78549ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 214.076695ms FAIL (2025-08-12 23:27:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 214.095539ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 543.884654ms FAIL (2025-08-12 23:27:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 22:40:43.425431886 (101h14m24.156699505s) [upload=105406]: Starting upload Aug 12 22:40:43.425467372 (101h14m24.156735002s) [upload=105406]: Done starting upload Aug 12 22:40:43.425678669 (101h14m24.156946289s) [upload=105406]: Uploading segments... Aug 12 22:40:43.425701793 (101h14m24.156969412s) [upload=105406]: Got next segment. Inline: false Aug 12 22:40:43.425727020 (101h14m24.15699465s) [upload=105406]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 22:40:43.425730356 (101h14m24.156997986s) [upload=105406]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 22:40:43.428062399 (101h14m24.159330019s) [upload=105406]: Next segment err: metaclient: Too Many Requests Aug 12 22:40:43.428076966 (101h14m24.159344596s) [upload=105406]: Done uploading segments... Aug 12 22:40:43.428090952 (101h14m24.159358582s) [upload=105406]: Upload finished. err: metaclient: Too Many Requests Duration: 543.908919ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 220.991712ms FAIL (2025-08-12 23:27:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 221.01215ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 1.205042054s FAIL (2025-08-12 23:27:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 22:40:43.425431886 (101h14m24.156699505s) [upload=105406]: Starting upload Aug 12 22:40:43.425467372 (101h14m24.156735002s) [upload=105406]: Done starting upload Aug 12 22:40:43.425678669 (101h14m24.156946289s) [upload=105406]: Uploading segments... Aug 12 22:40:43.425701793 (101h14m24.156969412s) [upload=105406]: Got next segment. Inline: false Aug 12 22:40:43.425727020 (101h14m24.15699465s) [upload=105406]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 22:40:43.425730356 (101h14m24.156997986s) [upload=105406]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 22:40:43.428062399 (101h14m24.159330019s) [upload=105406]: Next segment err: metaclient: Too Many Requests Aug 12 22:40:43.428076966 (101h14m24.159344596s) [upload=105406]: Done uploading segments... Aug 12 22:40:43.428090952 (101h14m24.159358582s) [upload=105406]: Upload finished. err: metaclient: Too Many Requests Duration: 1.20506743s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 1.27152081s FAIL (2025-08-12 23:26:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 22:40:43.425431886 (101h14m24.156699505s) [upload=105406]: Starting upload Aug 12 22:40:43.425467372 (101h14m24.156735002s) [upload=105406]: Done starting upload Aug 12 22:40:43.425678669 (101h14m24.156946289s) [upload=105406]: Uploading segments... Aug 12 22:40:43.425701793 (101h14m24.156969412s) [upload=105406]: Got next segment. Inline: false Aug 12 22:40:43.425727020 (101h14m24.15699465s) [upload=105406]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 22:40:43.425730356 (101h14m24.156997986s) [upload=105406]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 22:40:43.428062399 (101h14m24.159330019s) [upload=105406]: Next segment err: metaclient: Too Many Requests Aug 12 22:40:43.428076966 (101h14m24.159344596s) [upload=105406]: Done uploading segments... Aug 12 22:40:43.428090952 (101h14m24.159358582s) [upload=105406]: Upload finished. err: metaclient: Too Many Requests Duration: 1.271544054s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 165.78418ms FAIL (2025-08-12 23:26:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 165.804979ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 193.030154ms FAIL (2025-08-12 23:26:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 193.052665ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 683.452704ms FAIL (2025-08-12 23:25:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 22:40:43.425431886 (101h14m24.156699505s) [upload=105406]: Starting upload Aug 12 22:40:43.425467372 (101h14m24.156735002s) [upload=105406]: Done starting upload Aug 12 22:40:43.425678669 (101h14m24.156946289s) [upload=105406]: Uploading segments... Aug 12 22:40:43.425701793 (101h14m24.156969412s) [upload=105406]: Got next segment. Inline: false Aug 12 22:40:43.425727020 (101h14m24.15699465s) [upload=105406]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 22:40:43.425730356 (101h14m24.156997986s) [upload=105406]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 22:40:43.428062399 (101h14m24.159330019s) [upload=105406]: Next segment err: metaclient: Too Many Requests Aug 12 22:40:43.428076966 (101h14m24.159344596s) [upload=105406]: Done uploading segments... Aug 12 22:40:43.428090952 (101h14m24.159358582s) [upload=105406]: Upload finished. err: metaclient: Too Many Requests Duration: 683.474164ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 172.178972ms FAIL (2025-08-12 23:24:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 172.198869ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 546.815192ms FAIL (2025-08-12 23:24:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 22:40:43.425431886 (101h14m24.156699505s) [upload=105406]: Starting upload Aug 12 22:40:43.425467372 (101h14m24.156735002s) [upload=105406]: Done starting upload Aug 12 22:40:43.425678669 (101h14m24.156946289s) [upload=105406]: Uploading segments... Aug 12 22:40:43.425701793 (101h14m24.156969412s) [upload=105406]: Got next segment. Inline: false Aug 12 22:40:43.425727020 (101h14m24.15699465s) [upload=105406]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 22:40:43.425730356 (101h14m24.156997986s) [upload=105406]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 22:40:43.428062399 (101h14m24.159330019s) [upload=105406]: Next segment err: metaclient: Too Many Requests Aug 12 22:40:43.428076966 (101h14m24.159344596s) [upload=105406]: Done uploading segments... Aug 12 22:40:43.428090952 (101h14m24.159358582s) [upload=105406]: Upload finished. err: metaclient: Too Many Requests Duration: 546.832475ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 485.441057ms FAIL (2025-08-12 23:24:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 485.461734ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 528.624512ms FAIL (2025-08-12 23:23:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 22:40:43.425431886 (101h14m24.156699505s) [upload=105406]: Starting upload Aug 12 22:40:43.425467372 (101h14m24.156735002s) [upload=105406]: Done starting upload Aug 12 22:40:43.425678669 (101h14m24.156946289s) [upload=105406]: Uploading segments... Aug 12 22:40:43.425701793 (101h14m24.156969412s) [upload=105406]: Got next segment. Inline: false Aug 12 22:40:43.425727020 (101h14m24.15699465s) [upload=105406]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 22:40:43.425730356 (101h14m24.156997986s) [upload=105406]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 22:40:43.428062399 (101h14m24.159330019s) [upload=105406]: Next segment err: metaclient: Too Many Requests Aug 12 22:40:43.428076966 (101h14m24.159344596s) [upload=105406]: Done uploading segments... Aug 12 22:40:43.428090952 (101h14m24.159358582s) [upload=105406]: Upload finished. err: metaclient: Too Many Requests Duration: 528.643418ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 336.158551ms FAIL (2025-08-12 23:23:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 336.181524ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 135.578553ms FAIL (2025-08-12 23:22:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 23:07:25.079114539 (101h41m5.810382159s) [upload=105872]: Starting upload Aug 12 23:07:25.079156067 (101h41m5.810423687s) [upload=105872]: Done starting upload Aug 12 23:07:25.079212524 (101h41m5.810480154s) [upload=105872]: Uploading segments... Aug 12 23:07:25.079252419 (101h41m5.810520049s) [upload=105872]: Got next segment. Inline: true Aug 12 23:07:25.079258119 (101h41m5.810525749s) [upload=105872]: Waiting for error group managing segments... Aug 12 23:07:25.079298876 (101h41m5.810566496s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 23:07:25.079303715 (101h41m5.810571345s) [upload=105872]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 23:07:25.079307341 (101h41m5.810574972s) [upload=105872]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 23:07:25.082026463 (101h41m5.813294083s) [upload=105872]: Done uploading segments... Aug 12 23:07:25.082034098 (101h41m5.813301728s) [upload=105872]: Upload finished. err: metaclient: Too Many Requests Duration:* 135.600124ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)