Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X.........X....] duration:
416.103245ms
FAIL (2025-08-21 03:42:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 416.12198ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
894.006268ms
FAIL (2025-08-21 03:42:15 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 894.036355ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X.........X...] duration:
1.517372338s
FAIL (2025-08-21 03:42:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.517398607s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X.........X..] duration:
132.16603ms
FAIL (2025-08-21 03:41:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 132.191608ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
1.792424041s
FAIL (2025-08-21 03:41:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.792442656s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................................X.........X.] duration:
143.230109ms
FAIL (2025-08-21 03:40:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 143.260427ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
1.355863215s
FAIL (2025-08-21 03:40:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.355883483s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X.........X] duration:
14.176761ms
FAIL (2025-08-21 03:39:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 14.196378ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
386.909915ms
FAIL (2025-08-21 03:39:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 386.948296ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
144.196367ms
FAIL (2025-08-21 03:39:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:34:21.169374372 (298h8m1.900641991s) [upload=309984]: Starting upload Aug 21 03:34:21.169413326 (298h8m1.900680945s) [upload=309984]: Done starting upload Aug 21 03:34:21.169457959 (298h8m1.900725579s) [upload=309984]: Uploading segments... Aug 21 03:34:21.169493265 (298h8m1.900760906s) [upload=309984]: Got next segment. Inline: true Aug 21 03:34:21.169496973 (298h8m1.900764603s) [upload=309984]: Waiting for error group managing segments... Aug 21 03:34:21.169535184 (298h8m1.900802804s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:34:21.169538891 (298h8m1.900806511s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:34:21.169541355 (298h8m1.900808985s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:34:21.172111448 (298h8m1.903379068s) [upload=309984]: Done uploading segments... Aug 21 03:34:21.172118431 (298h8m1.903386061s) [upload=309984]: Upload finished. err: metaclient: Too Many Requests
Duration: 144.217937ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X..................................................X........] duration:
149.83153ms
FAIL (2025-08-21 03:38:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:34:21.169374372 (298h8m1.900641991s) [upload=309984]: Starting upload Aug 21 03:34:21.169413326 (298h8m1.900680945s) [upload=309984]: Done starting upload Aug 21 03:34:21.169457959 (298h8m1.900725579s) [upload=309984]: Uploading segments... Aug 21 03:34:21.169493265 (298h8m1.900760906s) [upload=309984]: Got next segment. Inline: true Aug 21 03:34:21.169496973 (298h8m1.900764603s) [upload=309984]: Waiting for error group managing segments... Aug 21 03:34:21.169535184 (298h8m1.900802804s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:34:21.169538891 (298h8m1.900806511s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:34:21.169541355 (298h8m1.900808985s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:34:21.172111448 (298h8m1.903379068s) [upload=309984]: Done uploading segments... Aug 21 03:34:21.172118431 (298h8m1.903386061s) [upload=309984]: Upload finished. err: metaclient: Too Many Requests
Duration: 149.851086ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X..................................................X.......] duration:
142.488576ms
FAIL (2025-08-21 03:38:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:34:21.169374372 (298h8m1.900641991s) [upload=309984]: Starting upload Aug 21 03:34:21.169413326 (298h8m1.900680945s) [upload=309984]: Done starting upload Aug 21 03:34:21.169457959 (298h8m1.900725579s) [upload=309984]: Uploading segments... Aug 21 03:34:21.169493265 (298h8m1.900760906s) [upload=309984]: Got next segment. Inline: true Aug 21 03:34:21.169496973 (298h8m1.900764603s) [upload=309984]: Waiting for error group managing segments... Aug 21 03:34:21.169535184 (298h8m1.900802804s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:34:21.169538891 (298h8m1.900806511s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:34:21.169541355 (298h8m1.900808985s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:34:21.172111448 (298h8m1.903379068s) [upload=309984]: Done uploading segments... Aug 21 03:34:21.172118431 (298h8m1.903386061s) [upload=309984]: Upload finished. err: metaclient: Too Many Requests
Duration: 142.512811ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
1.670140022s
FAIL (2025-08-21 03:38:21 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.670178003s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X..................................................X......] duration:
149.933675ms
FAIL (2025-08-21 03:38:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:34:21.169374372 (298h8m1.900641991s) [upload=309984]: Starting upload Aug 21 03:34:21.169413326 (298h8m1.900680945s) [upload=309984]: Done starting upload Aug 21 03:34:21.169457959 (298h8m1.900725579s) [upload=309984]: Uploading segments... Aug 21 03:34:21.169493265 (298h8m1.900760906s) [upload=309984]: Got next segment. Inline: true Aug 21 03:34:21.169496973 (298h8m1.900764603s) [upload=309984]: Waiting for error group managing segments... Aug 21 03:34:21.169535184 (298h8m1.900802804s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:34:21.169538891 (298h8m1.900806511s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:34:21.169541355 (298h8m1.900808985s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:34:21.172111448 (298h8m1.903379068s) [upload=309984]: Done uploading segments... Aug 21 03:34:21.172118431 (298h8m1.903386061s) [upload=309984]: Upload finished. err: metaclient: Too Many Requests
Duration: 149.955687ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.235858742s
FAIL (2025-08-21 03:37:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.235881034s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X..................................................X.....] duration:
557.967902ms
FAIL (2025-08-21 03:37:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:34:21.169374372 (298h8m1.900641991s) [upload=309984]: Starting upload Aug 21 03:34:21.169413326 (298h8m1.900680945s) [upload=309984]: Done starting upload Aug 21 03:34:21.169457959 (298h8m1.900725579s) [upload=309984]: Uploading segments... Aug 21 03:34:21.169493265 (298h8m1.900760906s) [upload=309984]: Got next segment. Inline: true Aug 21 03:34:21.169496973 (298h8m1.900764603s) [upload=309984]: Waiting for error group managing segments... Aug 21 03:34:21.169535184 (298h8m1.900802804s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:34:21.169538891 (298h8m1.900806511s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:34:21.169541355 (298h8m1.900808985s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:34:21.172111448 (298h8m1.903379068s) [upload=309984]: Done uploading segments... Aug 21 03:34:21.172118431 (298h8m1.903386061s) [upload=309984]: Upload finished. err: metaclient: Too Many Requests
Duration: 557.991696ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X..................................................X....] duration:
142.32944ms
FAIL (2025-08-21 03:37:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:34:21.169374372 (298h8m1.900641991s) [upload=309984]: Starting upload Aug 21 03:34:21.169413326 (298h8m1.900680945s) [upload=309984]: Done starting upload Aug 21 03:34:21.169457959 (298h8m1.900725579s) [upload=309984]: Uploading segments... Aug 21 03:34:21.169493265 (298h8m1.900760906s) [upload=309984]: Got next segment. Inline: true Aug 21 03:34:21.169496973 (298h8m1.900764603s) [upload=309984]: Waiting for error group managing segments... Aug 21 03:34:21.169535184 (298h8m1.900802804s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:34:21.169538891 (298h8m1.900806511s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:34:21.169541355 (298h8m1.900808985s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:34:21.172111448 (298h8m1.903379068s) [upload=309984]: Done uploading segments... Aug 21 03:34:21.172118431 (298h8m1.903386061s) [upload=309984]: Upload finished. err: metaclient: Too Many Requests
Duration: 142.351622ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
1.28541875s
FAIL (2025-08-21 03:36:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.285441253s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X..................................................X...] duration:
148.767544ms
FAIL (2025-08-21 03:36:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:34:21.169374372 (298h8m1.900641991s) [upload=309984]: Starting upload Aug 21 03:34:21.169413326 (298h8m1.900680945s) [upload=309984]: Done starting upload Aug 21 03:34:21.169457959 (298h8m1.900725579s) [upload=309984]: Uploading segments... Aug 21 03:34:21.169493265 (298h8m1.900760906s) [upload=309984]: Got next segment. Inline: true Aug 21 03:34:21.169496973 (298h8m1.900764603s) [upload=309984]: Waiting for error group managing segments... Aug 21 03:34:21.169535184 (298h8m1.900802804s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:34:21.169538891 (298h8m1.900806511s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:34:21.169541355 (298h8m1.900808985s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:34:21.172111448 (298h8m1.903379068s) [upload=309984]: Done uploading segments... Aug 21 03:34:21.172118431 (298h8m1.903386061s) [upload=309984]: Upload finished. err: metaclient: Too Many Requests
Duration: 148.787451ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
449.670811ms
FAIL (2025-08-21 03:36:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 449.702571ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X..................................................X..] duration:
143.840671ms
FAIL (2025-08-21 03:35:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:34:21.169374372 (298h8m1.900641991s) [upload=309984]: Starting upload Aug 21 03:34:21.169413326 (298h8m1.900680945s) [upload=309984]: Done starting upload Aug 21 03:34:21.169457959 (298h8m1.900725579s) [upload=309984]: Uploading segments... Aug 21 03:34:21.169493265 (298h8m1.900760906s) [upload=309984]: Got next segment. Inline: true Aug 21 03:34:21.169496973 (298h8m1.900764603s) [upload=309984]: Waiting for error group managing segments... Aug 21 03:34:21.169535184 (298h8m1.900802804s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:34:21.169538891 (298h8m1.900806511s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:34:21.169541355 (298h8m1.900808985s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:34:21.172111448 (298h8m1.903379068s) [upload=309984]: Done uploading segments... Aug 21 03:34:21.172118431 (298h8m1.903386061s) [upload=309984]: Upload finished. err: metaclient: Too Many Requests
Duration: 143.855768ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.033204386s
FAIL (2025-08-21 03:35:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.033223723s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.734536562s
FAIL (2025-08-21 03:35:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.734557261s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X..................................................X.] duration:
165.661654ms
FAIL (2025-08-21 03:34:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:34:21.169374372 (298h8m1.900641991s) [upload=309984]: Starting upload Aug 21 03:34:21.169413326 (298h8m1.900680945s) [upload=309984]: Done starting upload Aug 21 03:34:21.169457959 (298h8m1.900725579s) [upload=309984]: Uploading segments... Aug 21 03:34:21.169493265 (298h8m1.900760906s) [upload=309984]: Got next segment. Inline: true Aug 21 03:34:21.169496973 (298h8m1.900764603s) [upload=309984]: Waiting for error group managing segments... Aug 21 03:34:21.169535184 (298h8m1.900802804s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:34:21.169538891 (298h8m1.900806511s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:34:21.169541355 (298h8m1.900808985s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:34:21.172111448 (298h8m1.903379068s) [upload=309984]: Done uploading segments... Aug 21 03:34:21.172118431 (298h8m1.903386061s) [upload=309984]: Upload finished. err: metaclient: Too Many Requests
Duration: 165.700045ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.47768967s
FAIL (2025-08-21 03:34:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.477714688s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X..................................................X] duration:
15.479199ms
FAIL (2025-08-21 03:34:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:34:21.169374372 (298h8m1.900641991s) [upload=309984]: Starting upload Aug 21 03:34:21.169413326 (298h8m1.900680945s) [upload=309984]: Done starting upload Aug 21 03:34:21.169457959 (298h8m1.900725579s) [upload=309984]: Uploading segments... Aug 21 03:34:21.169493265 (298h8m1.900760906s) [upload=309984]: Got next segment. Inline: true Aug 21 03:34:21.169496973 (298h8m1.900764603s) [upload=309984]: Waiting for error group managing segments... Aug 21 03:34:21.169535184 (298h8m1.900802804s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:34:21.169538891 (298h8m1.900806511s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:34:21.169541355 (298h8m1.900808985s) [upload=309984]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:34:21.172111448 (298h8m1.903379068s) [upload=309984]: Done uploading segments... Aug 21 03:34:21.172118431 (298h8m1.903386061s) [upload=309984]: Upload finished. err: metaclient: Too Many Requests
Duration: 15.497513ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
492.831209ms
FAIL (2025-08-21 03:33:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 492.857759ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
130.091933ms
FAIL (2025-08-21 03:33:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 02:54:13.743577287 (297h27m54.474844917s) [upload=309290]: Starting upload Aug 21 02:54:13.743638692 (297h27m54.474906312s) [upload=309290]: Done starting upload Aug 21 02:54:13.743677785 (297h27m54.474945406s) [upload=309290]: Uploading segments... Aug 21 02:54:13.743724944 (297h27m54.474992564s) [upload=309290]: Got next segment. Inline: true Aug 21 02:54:13.743729662 (297h27m54.474997283s) [upload=309290]: Waiting for error group managing segments... Aug 21 02:54:13.743760932 (297h27m54.475028551s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 02:54:13.743766281 (297h27m54.475033901s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 02:54:13.743769478 (297h27m54.475037099s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 02:54:13.746297772 (297h27m54.477565392s) [upload=309290]: Done uploading segments... Aug 21 02:54:13.746303994 (297h27m54.477571614s) [upload=309290]: Upload finished. err: metaclient: Too Many Requests
Duration: 130.113243ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
1.419861427s
FAIL (2025-08-21 03:33:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.41988984s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
140.112281ms
FAIL (2025-08-21 03:32:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 02:54:13.743577287 (297h27m54.474844917s) [upload=309290]: Starting upload Aug 21 02:54:13.743638692 (297h27m54.474906312s) [upload=309290]: Done starting upload Aug 21 02:54:13.743677785 (297h27m54.474945406s) [upload=309290]: Uploading segments... Aug 21 02:54:13.743724944 (297h27m54.474992564s) [upload=309290]: Got next segment. Inline: true Aug 21 02:54:13.743729662 (297h27m54.474997283s) [upload=309290]: Waiting for error group managing segments... Aug 21 02:54:13.743760932 (297h27m54.475028551s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 02:54:13.743766281 (297h27m54.475033901s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 02:54:13.743769478 (297h27m54.475037099s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 02:54:13.746297772 (297h27m54.477565392s) [upload=309290]: Done uploading segments... Aug 21 02:54:13.746303994 (297h27m54.477571614s) [upload=309290]: Upload finished. err: metaclient: Too Many Requests
Duration: 140.136125ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
1.603950022s
FAIL (2025-08-21 03:32:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.603972105s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
142.32951ms
FAIL (2025-08-21 03:31:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 02:54:13.743577287 (297h27m54.474844917s) [upload=309290]: Starting upload Aug 21 02:54:13.743638692 (297h27m54.474906312s) [upload=309290]: Done starting upload Aug 21 02:54:13.743677785 (297h27m54.474945406s) [upload=309290]: Uploading segments... Aug 21 02:54:13.743724944 (297h27m54.474992564s) [upload=309290]: Got next segment. Inline: true Aug 21 02:54:13.743729662 (297h27m54.474997283s) [upload=309290]: Waiting for error group managing segments... Aug 21 02:54:13.743760932 (297h27m54.475028551s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 02:54:13.743766281 (297h27m54.475033901s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 02:54:13.743769478 (297h27m54.475037099s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 02:54:13.746297772 (297h27m54.477565392s) [upload=309290]: Done uploading segments... Aug 21 02:54:13.746303994 (297h27m54.477571614s) [upload=309290]: Upload finished. err: metaclient: Too Many Requests
Duration: 142.352453ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
1.387908618s
FAIL (2025-08-21 03:31:06 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.387933424s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
387.744224ms
FAIL (2025-08-21 03:30:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 02:54:13.743577287 (297h27m54.474844917s) [upload=309290]: Starting upload Aug 21 02:54:13.743638692 (297h27m54.474906312s) [upload=309290]: Done starting upload Aug 21 02:54:13.743677785 (297h27m54.474945406s) [upload=309290]: Uploading segments... Aug 21 02:54:13.743724944 (297h27m54.474992564s) [upload=309290]: Got next segment. Inline: true Aug 21 02:54:13.743729662 (297h27m54.474997283s) [upload=309290]: Waiting for error group managing segments... Aug 21 02:54:13.743760932 (297h27m54.475028551s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 02:54:13.743766281 (297h27m54.475033901s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 02:54:13.743769478 (297h27m54.475037099s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 02:54:13.746297772 (297h27m54.477565392s) [upload=309290]: Done uploading segments... Aug 21 02:54:13.746303994 (297h27m54.477571614s) [upload=309290]: Upload finished. err: metaclient: Too Many Requests
Duration: 387.777217ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
1.200250561s
FAIL (2025-08-21 03:30:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.200269186s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
389.425614ms
FAIL (2025-08-21 03:29:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 02:54:13.743577287 (297h27m54.474844917s) [upload=309290]: Starting upload Aug 21 02:54:13.743638692 (297h27m54.474906312s) [upload=309290]: Done starting upload Aug 21 02:54:13.743677785 (297h27m54.474945406s) [upload=309290]: Uploading segments... Aug 21 02:54:13.743724944 (297h27m54.474992564s) [upload=309290]: Got next segment. Inline: true Aug 21 02:54:13.743729662 (297h27m54.474997283s) [upload=309290]: Waiting for error group managing segments... Aug 21 02:54:13.743760932 (297h27m54.475028551s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 02:54:13.743766281 (297h27m54.475033901s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 02:54:13.743769478 (297h27m54.475037099s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 02:54:13.746297772 (297h27m54.477565392s) [upload=309290]: Done uploading segments... Aug 21 02:54:13.746303994 (297h27m54.477571614s) [upload=309290]: Upload finished. err: metaclient: Too Many Requests
Duration: 389.446182ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
446.654651ms
FAIL (2025-08-21 03:29:03 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 446.679196ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
138.721798ms
FAIL (2025-08-21 03:28:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 02:54:13.743577287 (297h27m54.474844917s) [upload=309290]: Starting upload Aug 21 02:54:13.743638692 (297h27m54.474906312s) [upload=309290]: Done starting upload Aug 21 02:54:13.743677785 (297h27m54.474945406s) [upload=309290]: Uploading segments... Aug 21 02:54:13.743724944 (297h27m54.474992564s) [upload=309290]: Got next segment. Inline: true Aug 21 02:54:13.743729662 (297h27m54.474997283s) [upload=309290]: Waiting for error group managing segments... Aug 21 02:54:13.743760932 (297h27m54.475028551s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 02:54:13.743766281 (297h27m54.475033901s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 02:54:13.743769478 (297h27m54.475037099s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 02:54:13.746297772 (297h27m54.477565392s) [upload=309290]: Done uploading segments... Aug 21 02:54:13.746303994 (297h27m54.477571614s) [upload=309290]: Upload finished. err: metaclient: Too Many Requests
Duration: 138.74958ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.541270967s
FAIL (2025-08-21 03:28:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.541293649s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
158.099227ms
FAIL (2025-08-21 03:27:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 02:54:13.743577287 (297h27m54.474844917s) [upload=309290]: Starting upload Aug 21 02:54:13.743638692 (297h27m54.474906312s) [upload=309290]: Done starting upload Aug 21 02:54:13.743677785 (297h27m54.474945406s) [upload=309290]: Uploading segments... Aug 21 02:54:13.743724944 (297h27m54.474992564s) [upload=309290]: Got next segment. Inline: true Aug 21 02:54:13.743729662 (297h27m54.474997283s) [upload=309290]: Waiting for error group managing segments... Aug 21 02:54:13.743760932 (297h27m54.475028551s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 02:54:13.743766281 (297h27m54.475033901s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 02:54:13.743769478 (297h27m54.475037099s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 02:54:13.746297772 (297h27m54.477565392s) [upload=309290]: Done uploading segments... Aug 21 02:54:13.746303994 (297h27m54.477571614s) [upload=309290]: Upload finished. err: metaclient: Too Many Requests
Duration: 158.117241ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
3.192772762s
FAIL (2025-08-21 03:27:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 3.192819942s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
152.498156ms
FAIL (2025-08-21 03:27:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 02:54:13.743577287 (297h27m54.474844917s) [upload=309290]: Starting upload Aug 21 02:54:13.743638692 (297h27m54.474906312s) [upload=309290]: Done starting upload Aug 21 02:54:13.743677785 (297h27m54.474945406s) [upload=309290]: Uploading segments... Aug 21 02:54:13.743724944 (297h27m54.474992564s) [upload=309290]: Got next segment. Inline: true Aug 21 02:54:13.743729662 (297h27m54.474997283s) [upload=309290]: Waiting for error group managing segments... Aug 21 02:54:13.743760932 (297h27m54.475028551s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 02:54:13.743766281 (297h27m54.475033901s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 02:54:13.743769478 (297h27m54.475037099s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 02:54:13.746297772 (297h27m54.477565392s) [upload=309290]: Done uploading segments... Aug 21 02:54:13.746303994 (297h27m54.477571614s) [upload=309290]: Upload finished. err: metaclient: Too Many Requests
Duration: 152.523544ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.17862084s
FAIL (2025-08-21 03:27:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.178639424s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
170.906943ms
FAIL (2025-08-21 03:26:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 02:54:13.743577287 (297h27m54.474844917s) [upload=309290]: Starting upload Aug 21 02:54:13.743638692 (297h27m54.474906312s) [upload=309290]: Done starting upload Aug 21 02:54:13.743677785 (297h27m54.474945406s) [upload=309290]: Uploading segments... Aug 21 02:54:13.743724944 (297h27m54.474992564s) [upload=309290]: Got next segment. Inline: true Aug 21 02:54:13.743729662 (297h27m54.474997283s) [upload=309290]: Waiting for error group managing segments... Aug 21 02:54:13.743760932 (297h27m54.475028551s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 02:54:13.743766281 (297h27m54.475033901s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 02:54:13.743769478 (297h27m54.475037099s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 02:54:13.746297772 (297h27m54.477565392s) [upload=309290]: Done uploading segments... Aug 21 02:54:13.746303994 (297h27m54.477571614s) [upload=309290]: Upload finished. err: metaclient: Too Many Requests
Duration: 170.928794ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.544037599s
FAIL (2025-08-21 03:26:37 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.544056505s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
167.095579ms
FAIL (2025-08-21 03:26:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 02:54:13.743577287 (297h27m54.474844917s) [upload=309290]: Starting upload Aug 21 02:54:13.743638692 (297h27m54.474906312s) [upload=309290]: Done starting upload Aug 21 02:54:13.743677785 (297h27m54.474945406s) [upload=309290]: Uploading segments... Aug 21 02:54:13.743724944 (297h27m54.474992564s) [upload=309290]: Got next segment. Inline: true Aug 21 02:54:13.743729662 (297h27m54.474997283s) [upload=309290]: Waiting for error group managing segments... Aug 21 02:54:13.743760932 (297h27m54.475028551s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 02:54:13.743766281 (297h27m54.475033901s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 02:54:13.743769478 (297h27m54.475037099s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 02:54:13.746297772 (297h27m54.477565392s) [upload=309290]: Done uploading segments... Aug 21 02:54:13.746303994 (297h27m54.477571614s) [upload=309290]: Upload finished. err: metaclient: Too Many Requests
Duration: 167.126196ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
147.876869ms
FAIL (2025-08-21 03:26:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 02:54:13.743577287 (297h27m54.474844917s) [upload=309290]: Starting upload Aug 21 02:54:13.743638692 (297h27m54.474906312s) [upload=309290]: Done starting upload Aug 21 02:54:13.743677785 (297h27m54.474945406s) [upload=309290]: Uploading segments... Aug 21 02:54:13.743724944 (297h27m54.474992564s) [upload=309290]: Got next segment. Inline: true Aug 21 02:54:13.743729662 (297h27m54.474997283s) [upload=309290]: Waiting for error group managing segments... Aug 21 02:54:13.743760932 (297h27m54.475028551s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 02:54:13.743766281 (297h27m54.475033901s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 02:54:13.743769478 (297h27m54.475037099s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 02:54:13.746297772 (297h27m54.477565392s) [upload=309290]: Done uploading segments... Aug 21 02:54:13.746303994 (297h27m54.477571614s) [upload=309290]: Upload finished. err: metaclient: Too Many Requests
Duration: 147.900223ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.259811679s
FAIL (2025-08-21 03:25:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.259830624s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
145.817147ms
FAIL (2025-08-21 03:25:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 02:54:13.743577287 (297h27m54.474844917s) [upload=309290]: Starting upload Aug 21 02:54:13.743638692 (297h27m54.474906312s) [upload=309290]: Done starting upload Aug 21 02:54:13.743677785 (297h27m54.474945406s) [upload=309290]: Uploading segments... Aug 21 02:54:13.743724944 (297h27m54.474992564s) [upload=309290]: Got next segment. Inline: true Aug 21 02:54:13.743729662 (297h27m54.474997283s) [upload=309290]: Waiting for error group managing segments... Aug 21 02:54:13.743760932 (297h27m54.475028551s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 02:54:13.743766281 (297h27m54.475033901s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 02:54:13.743769478 (297h27m54.475037099s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 02:54:13.746297772 (297h27m54.477565392s) [upload=309290]: Done uploading segments... Aug 21 02:54:13.746303994 (297h27m54.477571614s) [upload=309290]: Upload finished. err: metaclient: Too Many Requests
Duration: 145.833538ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
430.341995ms
FAIL (2025-08-21 03:25:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 02:54:13.743577287 (297h27m54.474844917s) [upload=309290]: Starting upload Aug 21 02:54:13.743638692 (297h27m54.474906312s) [upload=309290]: Done starting upload Aug 21 02:54:13.743677785 (297h27m54.474945406s) [upload=309290]: Uploading segments... Aug 21 02:54:13.743724944 (297h27m54.474992564s) [upload=309290]: Got next segment. Inline: true Aug 21 02:54:13.743729662 (297h27m54.474997283s) [upload=309290]: Waiting for error group managing segments... Aug 21 02:54:13.743760932 (297h27m54.475028551s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 02:54:13.743766281 (297h27m54.475033901s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 02:54:13.743769478 (297h27m54.475037099s) [upload=309290]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 02:54:13.746297772 (297h27m54.477565392s) [upload=309290]: Done uploading segments... Aug 21 02:54:13.746303994 (297h27m54.477571614s) [upload=309290]: Upload finished. err: metaclient: Too Many Requests
Duration: 430.364477ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|