Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
422.416925ms
FAIL (2025-08-25 05:09:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 422.442091ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
1.175689703s
FAIL (2025-08-25 05:09:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.175709829s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
169.061679ms
FAIL (2025-08-25 05:09:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 169.094882ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
178.366911ms
FAIL (2025-08-25 05:08:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 178.391597ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
357.298138ms
FAIL (2025-08-25 05:07:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 357.326021ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
180.240181ms
FAIL (2025-08-25 05:07:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 180.264615ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
1.643371382s
FAIL (2025-08-25 05:07:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.643395867s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
243.21312ms
FAIL (2025-08-25 05:07:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 243.237235ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
399.459386ms
FAIL (2025-08-25 05:07:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 399.478122ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
537.63978ms
FAIL (2025-08-25 05:06:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 537.658184ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
178.883363ms
FAIL (2025-08-25 05:06:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 178.923559ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
209.083793ms
FAIL (2025-08-25 05:06:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 209.108731ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
343.158733ms
FAIL (2025-08-25 05:05:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 343.181645ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
546.059037ms
FAIL (2025-08-25 05:05:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 546.0823ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
374.285458ms
FAIL (2025-08-25 05:04:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 374.306729ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
1.446642328s
FAIL (2025-08-25 05:04:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.446672525s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.706542592s
FAIL (2025-08-25 05:04:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.706566917s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
166.380143ms
FAIL (2025-08-25 05:03:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 166.414958ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
296.315078ms
FAIL (2025-08-25 05:03:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 296.340244ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
357.530473ms
FAIL (2025-08-25 05:02:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 357.551582ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
375.587094ms
FAIL (2025-08-25 05:02:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 375.603345ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
532.011336ms
FAIL (2025-08-25 05:02:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 532.039718ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
1.682313662s
FAIL (2025-08-25 05:02:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.682340323s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
155.241598ms
FAIL (2025-08-25 05:01:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 155.264381ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
629.79287ms
FAIL (2025-08-25 05:01:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 629.817656ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
180.158208ms
FAIL (2025-08-25 05:01:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 180.182274ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
1.221674675s
FAIL (2025-08-25 05:00:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.221697918s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X..........................................X................] duration:
153.940954ms
FAIL (2025-08-25 04:59:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 153.96033ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
1.708914596s
FAIL (2025-08-25 04:59:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.708936236s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
370.689394ms
FAIL (2025-08-25 04:59:08 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 370.784212ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X..........................................X...............] duration:
135.596687ms
FAIL (2025-08-25 04:58:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 135.625974ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X..........................................X..............] duration:
182.137776ms
FAIL (2025-08-25 04:58:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 182.155029ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.083012124s
FAIL (2025-08-25 04:58:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 2.083032051s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X..........................................X.............] duration:
184.253581ms
FAIL (2025-08-25 04:57:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 184.282616ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.86809507s
FAIL (2025-08-25 04:57:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.868124545s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X..........................................X............] duration:
139.196131ms
FAIL (2025-08-25 04:56:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 139.219805ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
1.659794321s
FAIL (2025-08-25 04:56:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.659816663s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.060925301s
FAIL (2025-08-25 04:55:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.06094682s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X..........................................X...........] duration:
174.300714ms
FAIL (2025-08-25 04:55:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 174.329357ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
552.41089ms
FAIL (2025-08-25 04:55:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 552.433182ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X..........................................X..........] duration:
276.558787ms
FAIL (2025-08-25 04:54:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 276.587993ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
479.243699ms
FAIL (2025-08-25 04:54:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 479.264237ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X..........................................X.........] duration:
152.679922ms
FAIL (2025-08-25 04:54:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 152.704259ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.041201456s
FAIL (2025-08-25 04:53:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.041223437s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X..........................................X........] duration:
140.201309ms
FAIL (2025-08-25 04:53:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 140.2227ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
401.346943ms
FAIL (2025-08-25 04:53:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 401.369896ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
371.475091ms
FAIL (2025-08-25 04:52:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 371.49596ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
490.489697ms
FAIL (2025-08-25 04:52:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 490.577462ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X..........................................X.......] duration:
313.821315ms
FAIL (2025-08-25 04:51:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 313.848276ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
369.310003ms
FAIL (2025-08-25 04:51:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 369.337335ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|