Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X...............X....................................X] duration:
15.230031ms
FAIL (2025-08-20 00:48:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:48:57.425391415 (271h22m38.156659034s) [upload=282221]: Starting upload Aug 20 00:48:57.425416733 (271h22m38.156684353s) [upload=282221]: Done starting upload Aug 20 00:48:57.425609375 (271h22m38.156876995s) [upload=282221]: Uploading segments... Aug 20 00:48:57.425639021 (271h22m38.156906641s) [upload=282221]: Got next segment. Inline: false Aug 20 00:48:57.425659329 (271h22m38.156926939s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:48:57.425662425 (271h22m38.156930045s) [upload=282221]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 00:48:57.427999631 (271h22m38.159267251s) [upload=282221]: Next segment err: metaclient: Too Many Requests Aug 20 00:48:57.428008057 (271h22m38.159275667s) [upload=282221]: Done uploading segments... Aug 20 00:48:57.428014660 (271h22m38.159282271s) [upload=282221]: Upload finished. err: metaclient: Too Many Requests
Duration: 15.246542ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X...............X....................................] duration:
493.158766ms
FAIL (2025-08-20 00:48:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 493.22531ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X..............X............] duration:
326.750988ms
FAIL (2025-08-20 00:47:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 326.769532ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X...............X...................................] duration:
403.861868ms
FAIL (2025-08-20 00:47:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 403.884501ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X..............X...........] duration:
231.971959ms
FAIL (2025-08-20 00:47:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 232.018185ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X...............X..................................] duration:
525.863268ms
FAIL (2025-08-20 00:46:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 525.889758ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X..............X..........] duration:
253.994576ms
FAIL (2025-08-20 00:46:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 254.014133ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X...............X.................................] duration:
461.47956ms
FAIL (2025-08-20 00:45:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 461.501611ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X..............X.........] duration:
448.309183ms
FAIL (2025-08-20 00:45:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 448.338438ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X...............X................................] duration:
587.56902ms
FAIL (2025-08-20 00:45:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 587.587796ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X..............X........] duration:
276.439743ms
FAIL (2025-08-20 00:44:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 276.470902ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X..............X.......] duration:
169.794803ms
FAIL (2025-08-20 00:44:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 169.822955ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X...............X...............................] duration:
621.92907ms
FAIL (2025-08-20 00:44:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 621.95092ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X..............X......] duration:
287.328514ms
FAIL (2025-08-20 00:43:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 287.351047ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X...............X..............................] duration:
551.765286ms
FAIL (2025-08-20 00:43:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 551.789823ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X..............X.....] duration:
140.313528ms
FAIL (2025-08-20 00:43:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 140.340509ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................X..............X....] duration:
671.624574ms
FAIL (2025-08-20 00:42:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 671.644602ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X...............X.............................] duration:
727.463611ms
FAIL (2025-08-20 00:42:16 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 727.493446ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X..............X...] duration:
162.858101ms
FAIL (2025-08-20 00:42:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 162.872597ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X...............X............................] duration:
498.933828ms
FAIL (2025-08-20 00:42:00 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 498.97226ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X...............X...........................] duration:
516.121935ms
FAIL (2025-08-20 00:41:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 516.178571ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X..............X..] duration:
204.32654ms
FAIL (2025-08-20 00:41:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 204.352138ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X...............X..........................] duration:
511.229209ms
FAIL (2025-08-20 00:40:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 511.254957ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X..............X.] duration:
153.310158ms
FAIL (2025-08-20 00:40:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 153.323513ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X...............X.........................] duration:
421.151013ms
FAIL (2025-08-20 00:40:05 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 421.173916ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................................X..............X] duration:
18.870108ms
FAIL (2025-08-20 00:39:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:39:14.198191546 (271h12m54.929459166s) [upload=282046]: Starting upload Aug 20 00:39:14.198254906 (271h12m54.929522526s) [upload=282046]: Done starting upload Aug 20 00:39:14.198310801 (271h12m54.929578421s) [upload=282046]: Uploading segments... Aug 20 00:39:14.198348321 (271h12m54.929615941s) [upload=282046]: Got next segment. Inline: true Aug 20 00:39:14.198352669 (271h12m54.92962029s) [upload=282046]: Waiting for error group managing segments... Aug 20 00:39:14.198385682 (271h12m54.929653312s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:39:14.198389518 (271h12m54.929657148s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:39:14.198392314 (271h12m54.929659934s) [upload=282046]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:39:14.204961743 (271h12m54.936229373s) [upload=282046]: Done uploading segments... Aug 20 00:39:14.204981851 (271h12m54.936249481s) [upload=282046]: Upload finished. err: metaclient: Too Many Requests
Duration: 18.892801ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
177.609592ms
FAIL (2025-08-20 00:38:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:29:08.832328584 (271h2m49.563596214s) [upload=281871]: Starting upload Aug 20 00:29:08.832367598 (271h2m49.563635228s) [upload=281871]: Done starting upload Aug 20 00:29:08.832424434 (271h2m49.563692055s) [upload=281871]: Uploading segments... Aug 20 00:29:08.832477535 (271h2m49.563745155s) [upload=281871]: Got next segment. Inline: true Aug 20 00:29:08.832483246 (271h2m49.563750876s) [upload=281871]: Waiting for error group managing segments... Aug 20 00:29:08.832526898 (271h2m49.563794518s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:29:08.832532077 (271h2m49.563799707s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:29:08.832535724 (271h2m49.563803344s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:29:08.835492887 (271h2m49.566760507s) [upload=281871]: Done uploading segments... Aug 20 00:29:08.835500832 (271h2m49.566768462s) [upload=281871]: Upload finished. err: metaclient: Too Many Requests
Duration: 177.629188ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X...............X........................] duration:
1.158082447s
FAIL (2025-08-20 00:38:55 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 1.158119416s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
538.446691ms
FAIL (2025-08-20 00:38:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:29:08.832328584 (271h2m49.563596214s) [upload=281871]: Starting upload Aug 20 00:29:08.832367598 (271h2m49.563635228s) [upload=281871]: Done starting upload Aug 20 00:29:08.832424434 (271h2m49.563692055s) [upload=281871]: Uploading segments... Aug 20 00:29:08.832477535 (271h2m49.563745155s) [upload=281871]: Got next segment. Inline: true Aug 20 00:29:08.832483246 (271h2m49.563750876s) [upload=281871]: Waiting for error group managing segments... Aug 20 00:29:08.832526898 (271h2m49.563794518s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:29:08.832532077 (271h2m49.563799707s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:29:08.832535724 (271h2m49.563803344s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:29:08.835492887 (271h2m49.566760507s) [upload=281871]: Done uploading segments... Aug 20 00:29:08.835500832 (271h2m49.566768462s) [upload=281871]: Upload finished. err: metaclient: Too Many Requests
Duration: 538.471929ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X...................X...............X.......................] duration:
439.438514ms
FAIL (2025-08-20 00:37:55 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 439.455858ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
657.402511ms
FAIL (2025-08-20 00:37:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:29:08.832328584 (271h2m49.563596214s) [upload=281871]: Starting upload Aug 20 00:29:08.832367598 (271h2m49.563635228s) [upload=281871]: Done starting upload Aug 20 00:29:08.832424434 (271h2m49.563692055s) [upload=281871]: Uploading segments... Aug 20 00:29:08.832477535 (271h2m49.563745155s) [upload=281871]: Got next segment. Inline: true Aug 20 00:29:08.832483246 (271h2m49.563750876s) [upload=281871]: Waiting for error group managing segments... Aug 20 00:29:08.832526898 (271h2m49.563794518s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:29:08.832532077 (271h2m49.563799707s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:29:08.832535724 (271h2m49.563803344s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:29:08.835492887 (271h2m49.566760507s) [upload=281871]: Done uploading segments... Aug 20 00:29:08.835500832 (271h2m49.566768462s) [upload=281871]: Upload finished. err: metaclient: Too Many Requests
Duration: 657.424784ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X...................X...............X......................] duration:
526.881284ms
FAIL (2025-08-20 00:37:35 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 526.899627ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X...................X...............X.....................] duration:
360.996019ms
FAIL (2025-08-20 00:36:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 361.020275ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
149.513367ms
FAIL (2025-08-20 00:36:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:29:08.832328584 (271h2m49.563596214s) [upload=281871]: Starting upload Aug 20 00:29:08.832367598 (271h2m49.563635228s) [upload=281871]: Done starting upload Aug 20 00:29:08.832424434 (271h2m49.563692055s) [upload=281871]: Uploading segments... Aug 20 00:29:08.832477535 (271h2m49.563745155s) [upload=281871]: Got next segment. Inline: true Aug 20 00:29:08.832483246 (271h2m49.563750876s) [upload=281871]: Waiting for error group managing segments... Aug 20 00:29:08.832526898 (271h2m49.563794518s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:29:08.832532077 (271h2m49.563799707s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:29:08.832535724 (271h2m49.563803344s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:29:08.835492887 (271h2m49.566760507s) [upload=281871]: Done uploading segments... Aug 20 00:29:08.835500832 (271h2m49.566768462s) [upload=281871]: Upload finished. err: metaclient: Too Many Requests
Duration: 149.53668ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X...................X...............X....................] duration:
433.114318ms
FAIL (2025-08-20 00:35:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 433.136109ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
152.28004ms
FAIL (2025-08-20 00:35:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:29:08.832328584 (271h2m49.563596214s) [upload=281871]: Starting upload Aug 20 00:29:08.832367598 (271h2m49.563635228s) [upload=281871]: Done starting upload Aug 20 00:29:08.832424434 (271h2m49.563692055s) [upload=281871]: Uploading segments... Aug 20 00:29:08.832477535 (271h2m49.563745155s) [upload=281871]: Got next segment. Inline: true Aug 20 00:29:08.832483246 (271h2m49.563750876s) [upload=281871]: Waiting for error group managing segments... Aug 20 00:29:08.832526898 (271h2m49.563794518s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:29:08.832532077 (271h2m49.563799707s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:29:08.832535724 (271h2m49.563803344s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:29:08.835492887 (271h2m49.566760507s) [upload=281871]: Done uploading segments... Aug 20 00:29:08.835500832 (271h2m49.566768462s) [upload=281871]: Upload finished. err: metaclient: Too Many Requests
Duration: 152.370451ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X...................X...............X...................] duration:
632.877025ms
FAIL (2025-08-20 00:34:41 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 632.897083ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
263.048766ms
FAIL (2025-08-20 00:34:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:29:08.832328584 (271h2m49.563596214s) [upload=281871]: Starting upload Aug 20 00:29:08.832367598 (271h2m49.563635228s) [upload=281871]: Done starting upload Aug 20 00:29:08.832424434 (271h2m49.563692055s) [upload=281871]: Uploading segments... Aug 20 00:29:08.832477535 (271h2m49.563745155s) [upload=281871]: Got next segment. Inline: true Aug 20 00:29:08.832483246 (271h2m49.563750876s) [upload=281871]: Waiting for error group managing segments... Aug 20 00:29:08.832526898 (271h2m49.563794518s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:29:08.832532077 (271h2m49.563799707s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:29:08.832535724 (271h2m49.563803344s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:29:08.835492887 (271h2m49.566760507s) [upload=281871]: Done uploading segments... Aug 20 00:29:08.835500832 (271h2m49.566768462s) [upload=281871]: Upload finished. err: metaclient: Too Many Requests
Duration: 263.075838ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
282.359906ms
FAIL (2025-08-20 00:34:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:29:08.832328584 (271h2m49.563596214s) [upload=281871]: Starting upload Aug 20 00:29:08.832367598 (271h2m49.563635228s) [upload=281871]: Done starting upload Aug 20 00:29:08.832424434 (271h2m49.563692055s) [upload=281871]: Uploading segments... Aug 20 00:29:08.832477535 (271h2m49.563745155s) [upload=281871]: Got next segment. Inline: true Aug 20 00:29:08.832483246 (271h2m49.563750876s) [upload=281871]: Waiting for error group managing segments... Aug 20 00:29:08.832526898 (271h2m49.563794518s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:29:08.832532077 (271h2m49.563799707s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:29:08.832535724 (271h2m49.563803344s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:29:08.835492887 (271h2m49.566760507s) [upload=281871]: Done uploading segments... Aug 20 00:29:08.835500832 (271h2m49.566768462s) [upload=281871]: Upload finished. err: metaclient: Too Many Requests
Duration: 282.377118ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
233.045ms
FAIL (2025-08-20 00:33:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:29:08.832328584 (271h2m49.563596214s) [upload=281871]: Starting upload Aug 20 00:29:08.832367598 (271h2m49.563635228s) [upload=281871]: Done starting upload Aug 20 00:29:08.832424434 (271h2m49.563692055s) [upload=281871]: Uploading segments... Aug 20 00:29:08.832477535 (271h2m49.563745155s) [upload=281871]: Got next segment. Inline: true Aug 20 00:29:08.832483246 (271h2m49.563750876s) [upload=281871]: Waiting for error group managing segments... Aug 20 00:29:08.832526898 (271h2m49.563794518s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:29:08.832532077 (271h2m49.563799707s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:29:08.832535724 (271h2m49.563803344s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:29:08.835492887 (271h2m49.566760507s) [upload=281871]: Done uploading segments... Aug 20 00:29:08.835500832 (271h2m49.566768462s) [upload=281871]: Upload finished. err: metaclient: Too Many Requests
Duration: 233.064919ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X...................X...............X..................] duration:
616.413271ms
FAIL (2025-08-20 00:33:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 616.439791ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
215.088531ms
FAIL (2025-08-20 00:32:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:29:08.832328584 (271h2m49.563596214s) [upload=281871]: Starting upload Aug 20 00:29:08.832367598 (271h2m49.563635228s) [upload=281871]: Done starting upload Aug 20 00:29:08.832424434 (271h2m49.563692055s) [upload=281871]: Uploading segments... Aug 20 00:29:08.832477535 (271h2m49.563745155s) [upload=281871]: Got next segment. Inline: true Aug 20 00:29:08.832483246 (271h2m49.563750876s) [upload=281871]: Waiting for error group managing segments... Aug 20 00:29:08.832526898 (271h2m49.563794518s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:29:08.832532077 (271h2m49.563799707s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:29:08.832535724 (271h2m49.563803344s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:29:08.835492887 (271h2m49.566760507s) [upload=281871]: Done uploading segments... Aug 20 00:29:08.835500832 (271h2m49.566768462s) [upload=281871]: Upload finished. err: metaclient: Too Many Requests
Duration: 215.116684ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X...................X...............X.................] duration:
519.134814ms
FAIL (2025-08-20 00:32:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 519.159381ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
263.844342ms
FAIL (2025-08-20 00:32:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:29:08.832328584 (271h2m49.563596214s) [upload=281871]: Starting upload Aug 20 00:29:08.832367598 (271h2m49.563635228s) [upload=281871]: Done starting upload Aug 20 00:29:08.832424434 (271h2m49.563692055s) [upload=281871]: Uploading segments... Aug 20 00:29:08.832477535 (271h2m49.563745155s) [upload=281871]: Got next segment. Inline: true Aug 20 00:29:08.832483246 (271h2m49.563750876s) [upload=281871]: Waiting for error group managing segments... Aug 20 00:29:08.832526898 (271h2m49.563794518s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:29:08.832532077 (271h2m49.563799707s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:29:08.832535724 (271h2m49.563803344s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:29:08.835492887 (271h2m49.566760507s) [upload=281871]: Done uploading segments... Aug 20 00:29:08.835500832 (271h2m49.566768462s) [upload=281871]: Upload finished. err: metaclient: Too Many Requests
Duration: 263.897693ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X...................X...............X................] duration:
826.359737ms
FAIL (2025-08-20 00:31:21 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 826.387448ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
207.290511ms
FAIL (2025-08-20 00:31:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:29:08.832328584 (271h2m49.563596214s) [upload=281871]: Starting upload Aug 20 00:29:08.832367598 (271h2m49.563635228s) [upload=281871]: Done starting upload Aug 20 00:29:08.832424434 (271h2m49.563692055s) [upload=281871]: Uploading segments... Aug 20 00:29:08.832477535 (271h2m49.563745155s) [upload=281871]: Got next segment. Inline: true Aug 20 00:29:08.832483246 (271h2m49.563750876s) [upload=281871]: Waiting for error group managing segments... Aug 20 00:29:08.832526898 (271h2m49.563794518s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:29:08.832532077 (271h2m49.563799707s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:29:08.832535724 (271h2m49.563803344s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:29:08.835492887 (271h2m49.566760507s) [upload=281871]: Done uploading segments... Aug 20 00:29:08.835500832 (271h2m49.566768462s) [upload=281871]: Upload finished. err: metaclient: Too Many Requests
Duration: 207.315968ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
432.873252ms
FAIL (2025-08-20 00:30:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:29:08.832328584 (271h2m49.563596214s) [upload=281871]: Starting upload Aug 20 00:29:08.832367598 (271h2m49.563635228s) [upload=281871]: Done starting upload Aug 20 00:29:08.832424434 (271h2m49.563692055s) [upload=281871]: Uploading segments... Aug 20 00:29:08.832477535 (271h2m49.563745155s) [upload=281871]: Got next segment. Inline: true Aug 20 00:29:08.832483246 (271h2m49.563750876s) [upload=281871]: Waiting for error group managing segments... Aug 20 00:29:08.832526898 (271h2m49.563794518s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:29:08.832532077 (271h2m49.563799707s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:29:08.832535724 (271h2m49.563803344s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:29:08.835492887 (271h2m49.566760507s) [upload=281871]: Done uploading segments... Aug 20 00:29:08.835500832 (271h2m49.566768462s) [upload=281871]: Upload finished. err: metaclient: Too Many Requests
Duration: 432.89361ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
181.039154ms
FAIL (2025-08-20 00:30:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:29:08.832328584 (271h2m49.563596214s) [upload=281871]: Starting upload Aug 20 00:29:08.832367598 (271h2m49.563635228s) [upload=281871]: Done starting upload Aug 20 00:29:08.832424434 (271h2m49.563692055s) [upload=281871]: Uploading segments... Aug 20 00:29:08.832477535 (271h2m49.563745155s) [upload=281871]: Got next segment. Inline: true Aug 20 00:29:08.832483246 (271h2m49.563750876s) [upload=281871]: Waiting for error group managing segments... Aug 20 00:29:08.832526898 (271h2m49.563794518s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:29:08.832532077 (271h2m49.563799707s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:29:08.832535724 (271h2m49.563803344s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:29:08.835492887 (271h2m49.566760507s) [upload=281871]: Done uploading segments... Aug 20 00:29:08.835500832 (271h2m49.566768462s) [upload=281871]: Upload finished. err: metaclient: Too Many Requests
Duration: 181.075423ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X...................X...............X...............] duration:
2.106155822s
FAIL (2025-08-20 00:30:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 00:18:15.330423604 (270h51m56.061691234s) [upload=281696]: Starting upload
Aug 20 00:18:15.330477417 (270h51m56.061745036s) [upload=281696]: Done starting upload
Aug 20 00:18:15.330583786 (270h51m56.061851406s) [upload=281696]: Uploading segments...
Aug 20 00:18:15.330725502 (270h51m56.061993132s) [upload=281696]: Got next segment. Inline: false
Aug 20 00:18:15.330762582 (270h51m56.062030202s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 00:18:15.330766449 (270h51m56.06203407s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 00:18:15.415565632 (270h51m56.146833272s) [seg_pos={0 0}, upload=281696]: Begin upload segment...
Aug 20 00:18:15.415670370 (270h51m56.14693805s) [seg_pos={0 0}, upload=281696]: Done begin upload segment.
Aug 20 00:18:15.415710344 (270h51m56.146977984s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415724661 (270h51m56.146992312s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.415799231 (270h51m56.147066882s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416267533 (270h51m56.147535173s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416280146 (270h51m56.147547787s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416700938 (270h51m56.147968589s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.416725475 (270h51m56.147993115s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417044916 (270h51m56.148312565s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417125096 (270h51m56.148392736s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417403550 (270h51m56.1486712s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417523746 (270h51m56.148791386s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417814863 (270h51m56.149082514s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.417954286 (270h51m56.149221926s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418206961 (270h51m56.149474611s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418334631 (270h51m56.149602271s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.418765181 (270h51m56.150032821s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.419168089 (270h51m56.15043574s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.420253852 (270h51m56.151521492s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Uploading piece...
Aug 20 00:18:15.509776849 (270h51m56.241044469s) [upload=281696]: Next returned nil segment
Aug 20 00:18:15.509792559 (270h51m56.241060178s) [upload=281696]: Waiting for error group managing segments...
Aug 20 00:18:15.518843636 (270h51m56.250111256s) [noise=true , address=45.91.116.5:4328 , piece_id=RGUUUSDIANHWC7TJVBYHXBB3LNZV6BZ5CVIR3KUAIJIZRPY27ZMQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521047533 (270h51m56.252315152s) [noise=true , address=45.91.116.10:4094 , piece_id=JHDLRP2DLAFRH3K6CT5PEHDHJEX665IALF2FMUBOUM5322NZENRQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.521392291 (270h51m56.252659911s) [noise=true , address=77.90.31.19:4859 , piece_id=FGPO5OH7TQE4XFKUMAGYC6VP7MEBL7GYOSXBFJ7VOYBVUDMILIQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.522765454 (270h51m56.254033075s) [noise=true , address=45.91.116.11:4140 , piece_id=KEOTHDHLRF4MBDBCAVVJJQPULSZRSX5GTWXJLPCH6SXCNGGQBGAQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.523761128 (270h51m56.255028748s) [noise=true , address=104.36.82.14:4248 , piece_id=HRWPHYNZA7GF2VR5KURQNGBN4GL6YFIV2ZQZ62WISUIB4XRVGIYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.525474842 (270h51m56.256742462s) [noise=true , address=104.36.82.61:4376 , piece_id=ZZJU6RQS457XMA6AVSDMLIAMTKGXVY5FSCZ55A4CYGSUJP3NYMNQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.526154650 (270h51m56.257422271s) [noise=true , address=104.36.82.17:4333 , piece_id=OKMFHLPZJC2VACW7QSXMOH75AFE5NVKM6GXXYQXTOAY663ZK7MQA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527435339 (270h51m56.25870296s) [noise=true , address=45.91.116.6:4008 , piece_id=IPP5LZRHRRMHSMCDNNQREX6ZRWGBG5H3DITBGRQAJ25E2A6XDDCA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.527580803 (270h51m56.258848424s) [noise=true , address=104.36.82.62:4423 , piece_id=46XMD4YEUWVDAB6EEKKWILA2FHBD555ZPP43AVR3LGPVC55TS2VA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.543243970 (270h51m56.2745116s) [noise=true , address=104.36.82.43:4843 , piece_id=OMXMEJWP7JU6QF2EZQAA3NWPODVKQMEFNMGIRZIJQMFJTD2UXMPA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.548416461 (270h51m56.27968408s) [noise=true , address=104.36.82.51:4073 , piece_id=CPQRU3AMGV4QZO5O6YDFDOGMX2VGZO7LT6ZKOR74SL6C5AWKZ2AQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.550351852 (270h51m56.281619473s) [noise=true , address=77.90.31.11:4588 , piece_id=EGXKPKCTEUFGG4FSBL6OHNYXK77IJKC7LKTKQRUFLRAI23Y43Y6Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.558476517 (270h51m56.289744138s) [noise=true , address=104.36.82.15:4278 , piece_id=O77O3GBRYVRQFZOK5UQDBEOPIIBHCDM5AIVQ5SNKEYUC3JFWICYQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.565984581 (270h51m56.297252202s) [noise=true , address=77.90.31.15:4710 , piece_id=3RTUODULN6JTKJP3CEOFQX6XBH5M5SJKYJSZTWSUHUXU7XGUNU4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: <nil>
Aug 20 00:18:15.566001313 (270h51m56.297268933s) [seg_pos={0 0}, upload=281696]: Segment reached optimal threshold of 14 pieces.
Aug 20 00:18:15.566123974 (270h51m56.297391584s) [noise=true , address=45.91.116.8:4049 , piece_id=WDWQU2HPVZ2I2KML2YRZ7BPS2LPZZETFIOG4FRPXZSFIMWK3LK4A, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bbyRMajztw9frbd1V1meid4vQU1AC343NtZrg6qe27HUyw6bQ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566163027 (270h51m56.297430648s) [noise=true , address=104.36.82.59:4332 , piece_id=SBYSMDDMUQX3EWBTWEHQ23Z77CPXKX6W47AV7IHGJTO4I2RM7TXA, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UEUsbCaVzugWQ3VWyyqpxRSzWxsaHqS8hzN8srq4mrxs1bvQJ): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566204535 (270h51m56.297472156s) [noise=true , address=79.127.220.97:4381 , piece_id=7O2RPNH7D5N4PYSGLICICCBDXVHTPRAR3E7Z2QQTRPNSIFTV5I3Q, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f8pqEEYkEMNA5EAqosj1z4szYgouBWZ9adfcEQCk6SvVa7VVr): protocol: expected piece hash; context canceled; EOF
Aug 20 00:18:15.566374675 (270h51m56.297642326s) [noise=true , address=77.90.31.10:4532 , piece_id=VSIZ4KUMP57GZJBHZWKYQEQUCQNE24M6WG552OT67SQBOM7IQCWQ, seg_pos={0 0}, upload=281696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T6kkKvTNR5MZZijjr1vMU6g75YkoRpzMvGSgQCqRnfCm9JULe): protocol: write tcp 5.161.89.252:47678->77.90.31.10:4532: use of closed network connection; conn closed: op
Aug 20 00:18:15.566409181 (270h51m56.297676841s) [seg_pos={0 0}, upload=281696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 00:18:15.566479633 (270h51m56.297747293s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 00:18:15.566484642 (270h51m56.297752303s) [upload=281696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 00:18:15.720757631 (270h51m56.452025282s) [upload=281696]: Done uploading segments...
Aug 20 00:18:15.720776667 (270h51m56.452044317s) [upload=281696]: Upload finished. err: <nil>
Duration: 2.106174237s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
162.999638ms
FAIL (2025-08-20 00:29:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 00:29:08.832328584 (271h2m49.563596214s) [upload=281871]: Starting upload Aug 20 00:29:08.832367598 (271h2m49.563635228s) [upload=281871]: Done starting upload Aug 20 00:29:08.832424434 (271h2m49.563692055s) [upload=281871]: Uploading segments... Aug 20 00:29:08.832477535 (271h2m49.563745155s) [upload=281871]: Got next segment. Inline: true Aug 20 00:29:08.832483246 (271h2m49.563750876s) [upload=281871]: Waiting for error group managing segments... Aug 20 00:29:08.832526898 (271h2m49.563794518s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 00:29:08.832532077 (271h2m49.563799707s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 00:29:08.832535724 (271h2m49.563803344s) [upload=281871]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 00:29:08.835492887 (271h2m49.566760507s) [upload=281871]: Done uploading segments... Aug 20 00:29:08.835500832 (271h2m49.566768462s) [upload=281871]: Upload finished. err: metaclient: Too Many Requests
Duration: 163.028092ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|