Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X.........X................................] duration:
451.857456ms
FAIL (2025-08-21 04:03:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 451.89225ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
1.567921356s
FAIL (2025-08-21 04:02:44 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.567938839s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X.........X...............................] duration:
216.764722ms
FAIL (2025-08-21 04:02:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 216.791031ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.542300259s
FAIL (2025-08-21 04:01:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 2.542318291s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X.........X..............................] duration:
175.713918ms
FAIL (2025-08-21 04:01:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 175.734066ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X.........X.............................] duration:
432.819295ms
FAIL (2025-08-21 04:00:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 432.841727ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
1.496309722s
FAIL (2025-08-21 04:00:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.496352091s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
602.982668ms
FAIL (2025-08-21 04:00:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 602.997406ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X.........X............................] duration:
147.785526ms
FAIL (2025-08-21 03:59:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 147.807176ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X.........X...........................] duration:
262.146794ms
FAIL (2025-08-21 03:59:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 262.170489ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.213586874s
FAIL (2025-08-21 03:59:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 2.213617232s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
1.208013216s
FAIL (2025-08-21 03:59:00 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.208051158s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X.........X..........................] duration:
147.264285ms
FAIL (2025-08-21 03:58:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 147.282809ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
1.138713279s
FAIL (2025-08-21 03:58:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.138736182s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
1.029197189s
FAIL (2025-08-21 03:57:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.029217197s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X.........X.........................] duration:
166.968467ms
FAIL (2025-08-21 03:57:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 166.999576ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
587.03053ms
FAIL (2025-08-21 03:57:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 587.048414ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
1.833250752s
FAIL (2025-08-21 03:56:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.833273055s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.........X........................] duration:
535.805453ms
FAIL (2025-08-21 03:56:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 535.822444ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X.........X.......................] duration:
149.12887ms
FAIL (2025-08-21 03:56:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 149.153096ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X.........X......................] duration:
130.979331ms
FAIL (2025-08-21 03:55:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 131.009598ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
356.373539ms
FAIL (2025-08-21 03:55:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 356.397926ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
1.254039008s
FAIL (2025-08-21 03:54:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.254059336s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X.........X.....................] duration:
150.668112ms
FAIL (2025-08-21 03:54:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 150.688371ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
1.390370727s
FAIL (2025-08-21 03:54:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.39040921s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X.........X....................] duration:
439.405481ms
FAIL (2025-08-21 03:54:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 439.425077ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
1.383744269s
FAIL (2025-08-21 03:53:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.38376571s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X.........X...................] duration:
205.170252ms
FAIL (2025-08-21 03:52:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 205.193635ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
565.248234ms
FAIL (2025-08-21 03:52:41 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 565.280946ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X.........X..................] duration:
197.838429ms
FAIL (2025-08-21 03:51:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 197.857404ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.176337902s
FAIL (2025-08-21 03:51:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 2.17636962s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X.........X.................] duration:
130.597542ms
FAIL (2025-08-21 03:51:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 130.620494ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.124677223s
FAIL (2025-08-21 03:51:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 2.124699724s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X.........X................] duration:
147.039281ms
FAIL (2025-08-21 03:50:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 147.06497ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
433.784165ms
FAIL (2025-08-21 03:50:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 433.803591ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X.........X...............] duration:
142.843402ms
FAIL (2025-08-21 03:50:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 142.863619ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
1.662619508s
FAIL (2025-08-21 03:49:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.662643605s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X.........X..............] duration:
165.815269ms
FAIL (2025-08-21 03:49:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 165.83703ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
1.181564732s
FAIL (2025-08-21 03:48:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.181583457s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X.........X.............] duration:
151.802695ms
FAIL (2025-08-21 03:47:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 151.844092ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
470.803629ms
FAIL (2025-08-21 03:47:41 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 470.830369ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X.........X............] duration:
399.479476ms
FAIL (2025-08-21 03:47:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 399.499324ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X.........X...........] duration:
143.511418ms
FAIL (2025-08-21 03:46:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 143.573124ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
1.633986962s
FAIL (2025-08-21 03:46:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.634013912s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X.........X..........] duration:
212.217259ms
FAIL (2025-08-21 03:46:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 212.24468ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
1.587150955s
FAIL (2025-08-21 03:46:05 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.587171875s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................X.........X.........] duration:
121.421902ms
FAIL (2025-08-21 03:45:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 121.446629ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
1.737846078s
FAIL (2025-08-21 03:45:18 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.737865164s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X.........X........] duration:
309.956177ms
FAIL (2025-08-21 03:44:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 309.975454ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
457.838464ms
FAIL (2025-08-21 03:44:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 457.861557ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|