Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X..............................X..........X.] duration:
395.258241ms
FAIL (2025-08-18 02:52:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 18 02:51:53.533418022 (225h25m34.264685652s) [upload=234584]: Starting upload
Aug 18 02:51:53.533456995 (225h25m34.264724615s) [upload=234584]: Done starting upload
Aug 18 02:51:53.533595515 (225h25m34.264863165s) [upload=234584]: Uploading segments...
Aug 18 02:51:53.533704761 (225h25m34.264972411s) [upload=234584]: Got next segment. Inline: false
Aug 18 02:51:53.533744816 (225h25m34.265012466s) [upload=234584]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:51:53.533750557 (225h25m34.265018206s) [upload=234584]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:51:53.560782115 (225h25m34.292049745s) [seg_pos={0 0}, upload=234584]: Begin upload segment...
Aug 18 02:51:53.560810637 (225h25m34.292078268s) [seg_pos={0 0}, upload=234584]: Done begin upload segment.
Aug 18 02:51:53.560830044 (225h25m34.292097675s) [noise=true , address=77.90.31.13:4644 , piece_id=ZNZ4V4ONICQX4DBWM3D4HYMX65MQLVIZ3YSDNFVDK52VXC3LPXDQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.560937836 (225h25m34.292205487s) [noise=true , address=104.36.82.3:4799 , piece_id=MJFNACMRHHJ6YUTTXWFPCSK76Q637M25PYZDFYT3SMPFHD6QZJSA, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.561139165 (225h25m34.292406795s) [noise=true , address=77.90.31.19:4853 , piece_id=IZZFORRHU2B5VP7EQVV2UYEIIA6MYC2X7FCBV2ZI2VO4MT2FLUPQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.561361232 (225h25m34.292628862s) [noise=true , address=104.36.82.38:4697 , piece_id=FGBXFTMPB5TN3MFUIBVZBYFU5SPCXLT2LBLAUOCFFSOYOLB46DPQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.561607445 (225h25m34.292875065s) [noise=true , address=104.36.82.18:4371 , piece_id=2WEWUVPON46PVON2PBQRRHXXRSKRVDOINDGCSB62AZELHXAWK5MQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.561724194 (225h25m34.292991844s) [noise=true , address=104.36.82.60:4343 , piece_id=EOTBYZVAVXABNAMDH5OQ6QUHHYRSNH67NWRY33FVIV6HELAWYH4A, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.561831186 (225h25m34.293098806s) [noise=true , address=77.90.31.16:4764 , piece_id=YSVEW2IJNARZJR7WDMF6ESPBR63TPH3FKEYZIQTTRYQGQEOAY4SA, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.562071387 (225h25m34.293339018s) [noise=true , address=104.36.82.35:4605 , piece_id=BMGN2GMP67IDRZYJS5VW3F4S3GHXKGIP22WEOXUPSF66YK74V5GQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.562289708 (225h25m34.293557328s) [noise=true , address=104.36.82.5:4861 , piece_id=3HVPL26KKW7FH6Q5QBCQHQVPOHUROAEHJJLLFKAPG7VIPSRXWYZQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.562311679 (225h25m34.293579329s) [noise=true , address=104.36.82.50:4041 , piece_id=PVHKLIQWRB63ZTQL67N2VE5M23MTTPFBJKTX37WXJR6BY2VRIDPA, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.562576106 (225h25m34.293843736s) [noise=true , address=45.91.116.10:4094 , piece_id=2LMTJ626JQM3ZIXC66NLBWAQQUSO47NTQ2U3B5YXK75L4H6WGEZQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.562821076 (225h25m34.294088716s) [noise=true , address=45.91.116.12:4233 , piece_id=NNHRQEU37FHX4DWEEAUB7K3WWWRQLWPWK24NREIVW7XOFCKNVYJQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.562946512 (225h25m34.294214142s) [noise=true , address=79.127.220.97:4384 , piece_id=SRWSOZWIA7A5KAIOEPHAZOLDIBVNDPD5U3LFOS6U3HFU7GJSYLVA, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.563169611 (225h25m34.294437231s) [noise=true , address=77.90.31.12:4623 , piece_id=KSQAK65PQ4TOL6LJR63Q74IHSR7VJ2RN3OVCUNIDCV5J62GSUDNA, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.563341244 (225h25m34.294608894s) [noise=true , address=77.90.31.19:4854 , piece_id=QDR7V47RP2ZAUBENMP2DL32742RNCWDT2SHSJPHMAHRK4O5EE22A, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.563848707 (225h25m34.295116358s) [noise=true , address=104.36.82.44:4877 , piece_id=QHH4YZS3OM536ZWYAE44THXT2MS3T2P2FLVCI7UAXGUYOYQYHDDQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.564547472 (225h25m34.295815121s) [noise=true , address=79.127.201.215:4356 , piece_id=HP5JW5X22T3HCEIVRDFMKIA4TVZWEXRP7KAOAIPNOY2KRHYPHZJQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.565080513 (225h25m34.296348163s) [noise=true , address=45.91.116.9:4279 , piece_id=5AORARLQRVJV55WN7QSUKU3NY7KUZ5WW7HPCFYLV4UNUGIZSRSLQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.677252587 (225h25m34.408520207s) [upload=234584]: Next returned nil segment
Aug 18 02:51:53.677288705 (225h25m34.408556325s) [upload=234584]: Waiting for error group managing segments...
Aug 18 02:51:53.686774583 (225h25m34.418042204s) [noise=true , address=45.91.116.9:4279 , piece_id=5AORARLQRVJV55WN7QSUKU3NY7KUZ5WW7HPCFYLV4UNUGIZSRSLQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.691607738 (225h25m34.422875388s) [noise=true , address=104.36.82.5:4861 , piece_id=3HVPL26KKW7FH6Q5QBCQHQVPOHUROAEHJJLLFKAPG7VIPSRXWYZQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.691928240 (225h25m34.42319585s) [noise=true , address=104.36.82.35:4605 , piece_id=BMGN2GMP67IDRZYJS5VW3F4S3GHXKGIP22WEOXUPSF66YK74V5GQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.692626022 (225h25m34.423893672s) [noise=true , address=104.36.82.38:4697 , piece_id=FGBXFTMPB5TN3MFUIBVZBYFU5SPCXLT2LBLAUOCFFSOYOLB46DPQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.693739965 (225h25m34.425007585s) [noise=true , address=77.90.31.16:4764 , piece_id=YSVEW2IJNARZJR7WDMF6ESPBR63TPH3FKEYZIQTTRYQGQEOAY4SA, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.696934760 (225h25m34.42820242s) [noise=true , address=104.36.82.50:4041 , piece_id=PVHKLIQWRB63ZTQL67N2VE5M23MTTPFBJKTX37WXJR6BY2VRIDPA, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.697492589 (225h25m34.428760209s) [noise=true , address=104.36.82.44:4877 , piece_id=QHH4YZS3OM536ZWYAE44THXT2MS3T2P2FLVCI7UAXGUYOYQYHDDQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.697777675 (225h25m34.429045295s) [noise=true , address=104.36.82.3:4799 , piece_id=MJFNACMRHHJ6YUTTXWFPCSK76Q637M25PYZDFYT3SMPFHD6QZJSA, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.698667798 (225h25m34.429935417s) [noise=true , address=45.91.116.12:4233 , piece_id=NNHRQEU37FHX4DWEEAUB7K3WWWRQLWPWK24NREIVW7XOFCKNVYJQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.721802430 (225h25m34.453070081s) [noise=true , address=77.90.31.19:4854 , piece_id=QDR7V47RP2ZAUBENMP2DL32742RNCWDT2SHSJPHMAHRK4O5EE22A, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.737266997 (225h25m34.468534627s) [noise=true , address=79.127.220.97:4384 , piece_id=SRWSOZWIA7A5KAIOEPHAZOLDIBVNDPD5U3LFOS6U3HFU7GJSYLVA, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.738121863 (225h25m34.469389514s) [noise=true , address=104.36.82.18:4371 , piece_id=2WEWUVPON46PVON2PBQRRHXXRSKRVDOINDGCSB62AZELHXAWK5MQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.777847510 (225h25m34.50911513s) [noise=true , address=77.90.31.19:4853 , piece_id=IZZFORRHU2B5VP7EQVV2UYEIIA6MYC2X7FCBV2ZI2VO4MT2FLUPQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.808603548 (225h25m34.539871198s) [noise=true , address=79.127.201.215:4356 , piece_id=HP5JW5X22T3HCEIVRDFMKIA4TVZWEXRP7KAOAIPNOY2KRHYPHZJQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.808641569 (225h25m34.53990922s) [seg_pos={0 0}, upload=234584]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:51:53.808936984 (225h25m34.540204634s) [noise=true , address=45.91.116.10:4094 , piece_id=2LMTJ626JQM3ZIXC66NLBWAQQUSO47NTQ2U3B5YXK75L4H6WGEZQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12R5csTJKhU4qSrzDL9vvhhosTu7BCYeEQigCtiVPaGLKEuJbmw): protocol: expected piece hash; context canceled; EOF
Aug 18 02:51:53.809003390 (225h25m34.54027104s) [noise=true , address=104.36.82.60:4343 , piece_id=EOTBYZVAVXABNAMDH5OQ6QUHHYRSNH67NWRY33FVIV6HELAWYH4A, seg_pos={0 0}, upload=234584]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf): protocol: expected piece hash; context canceled; EOF
Aug 18 02:51:53.809095513 (225h25m34.540363163s) [noise=true , address=77.90.31.13:4644 , piece_id=ZNZ4V4ONICQX4DBWM3D4HYMX65MQLVIZ3YSDNFVDK52VXC3LPXDQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13QCH91kRMQjVj2ASsVDcyXQ1aapQRVeUm6MMCGimsR6Ns973h): protocol: write tcp 5.161.89.252:27288->77.90.31.13:4644: use of closed network connection; write tcp 5.161.89.252:27288->77.90.31.13:4644: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27288->77.90.31.13:4644: use of closed network connection
Aug 18 02:51:53.809108658 (225h25m34.540376307s) [noise=true , address=77.90.31.12:4623 , piece_id=KSQAK65PQ4TOL6LJR63Q74IHSR7VJ2RN3OVCUNIDCV5J62GSUDNA, seg_pos={0 0}, upload=234584]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 18 02:51:53.809127312 (225h25m34.540394963s) [seg_pos={0 0}, upload=234584]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:51:53.809203625 (225h25m34.540471276s) [upload=234584]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:51:53.809209066 (225h25m34.540476716s) [upload=234584]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:51:53.859699626 (225h25m34.590967276s) [upload=234584]: Done uploading segments...
Aug 18 02:51:53.859716678 (225h25m34.590984328s) [upload=234584]: Upload finished. err: <nil>
Duration: 395.277327ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X..............................X..........X] duration:
371.926397ms
FAIL (2025-08-18 02:51:53 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 18 02:51:53.533418022 (225h25m34.264685652s) [upload=234584]: Starting upload
Aug 18 02:51:53.533456995 (225h25m34.264724615s) [upload=234584]: Done starting upload
Aug 18 02:51:53.533595515 (225h25m34.264863165s) [upload=234584]: Uploading segments...
Aug 18 02:51:53.533704761 (225h25m34.264972411s) [upload=234584]: Got next segment. Inline: false
Aug 18 02:51:53.533744816 (225h25m34.265012466s) [upload=234584]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:51:53.533750557 (225h25m34.265018206s) [upload=234584]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 02:51:53.560782115 (225h25m34.292049745s) [seg_pos={0 0}, upload=234584]: Begin upload segment...
Aug 18 02:51:53.560810637 (225h25m34.292078268s) [seg_pos={0 0}, upload=234584]: Done begin upload segment.
Aug 18 02:51:53.560830044 (225h25m34.292097675s) [noise=true , address=77.90.31.13:4644 , piece_id=ZNZ4V4ONICQX4DBWM3D4HYMX65MQLVIZ3YSDNFVDK52VXC3LPXDQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.560937836 (225h25m34.292205487s) [noise=true , address=104.36.82.3:4799 , piece_id=MJFNACMRHHJ6YUTTXWFPCSK76Q637M25PYZDFYT3SMPFHD6QZJSA, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.561139165 (225h25m34.292406795s) [noise=true , address=77.90.31.19:4853 , piece_id=IZZFORRHU2B5VP7EQVV2UYEIIA6MYC2X7FCBV2ZI2VO4MT2FLUPQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.561361232 (225h25m34.292628862s) [noise=true , address=104.36.82.38:4697 , piece_id=FGBXFTMPB5TN3MFUIBVZBYFU5SPCXLT2LBLAUOCFFSOYOLB46DPQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.561607445 (225h25m34.292875065s) [noise=true , address=104.36.82.18:4371 , piece_id=2WEWUVPON46PVON2PBQRRHXXRSKRVDOINDGCSB62AZELHXAWK5MQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.561724194 (225h25m34.292991844s) [noise=true , address=104.36.82.60:4343 , piece_id=EOTBYZVAVXABNAMDH5OQ6QUHHYRSNH67NWRY33FVIV6HELAWYH4A, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.561831186 (225h25m34.293098806s) [noise=true , address=77.90.31.16:4764 , piece_id=YSVEW2IJNARZJR7WDMF6ESPBR63TPH3FKEYZIQTTRYQGQEOAY4SA, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.562071387 (225h25m34.293339018s) [noise=true , address=104.36.82.35:4605 , piece_id=BMGN2GMP67IDRZYJS5VW3F4S3GHXKGIP22WEOXUPSF66YK74V5GQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.562289708 (225h25m34.293557328s) [noise=true , address=104.36.82.5:4861 , piece_id=3HVPL26KKW7FH6Q5QBCQHQVPOHUROAEHJJLLFKAPG7VIPSRXWYZQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.562311679 (225h25m34.293579329s) [noise=true , address=104.36.82.50:4041 , piece_id=PVHKLIQWRB63ZTQL67N2VE5M23MTTPFBJKTX37WXJR6BY2VRIDPA, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.562576106 (225h25m34.293843736s) [noise=true , address=45.91.116.10:4094 , piece_id=2LMTJ626JQM3ZIXC66NLBWAQQUSO47NTQ2U3B5YXK75L4H6WGEZQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.562821076 (225h25m34.294088716s) [noise=true , address=45.91.116.12:4233 , piece_id=NNHRQEU37FHX4DWEEAUB7K3WWWRQLWPWK24NREIVW7XOFCKNVYJQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.562946512 (225h25m34.294214142s) [noise=true , address=79.127.220.97:4384 , piece_id=SRWSOZWIA7A5KAIOEPHAZOLDIBVNDPD5U3LFOS6U3HFU7GJSYLVA, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.563169611 (225h25m34.294437231s) [noise=true , address=77.90.31.12:4623 , piece_id=KSQAK65PQ4TOL6LJR63Q74IHSR7VJ2RN3OVCUNIDCV5J62GSUDNA, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.563341244 (225h25m34.294608894s) [noise=true , address=77.90.31.19:4854 , piece_id=QDR7V47RP2ZAUBENMP2DL32742RNCWDT2SHSJPHMAHRK4O5EE22A, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.563848707 (225h25m34.295116358s) [noise=true , address=104.36.82.44:4877 , piece_id=QHH4YZS3OM536ZWYAE44THXT2MS3T2P2FLVCI7UAXGUYOYQYHDDQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.564547472 (225h25m34.295815121s) [noise=true , address=79.127.201.215:4356 , piece_id=HP5JW5X22T3HCEIVRDFMKIA4TVZWEXRP7KAOAIPNOY2KRHYPHZJQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.565080513 (225h25m34.296348163s) [noise=true , address=45.91.116.9:4279 , piece_id=5AORARLQRVJV55WN7QSUKU3NY7KUZ5WW7HPCFYLV4UNUGIZSRSLQ, seg_pos={0 0}, upload=234584]: Uploading piece...
Aug 18 02:51:53.677252587 (225h25m34.408520207s) [upload=234584]: Next returned nil segment
Aug 18 02:51:53.677288705 (225h25m34.408556325s) [upload=234584]: Waiting for error group managing segments...
Aug 18 02:51:53.686774583 (225h25m34.418042204s) [noise=true , address=45.91.116.9:4279 , piece_id=5AORARLQRVJV55WN7QSUKU3NY7KUZ5WW7HPCFYLV4UNUGIZSRSLQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.691607738 (225h25m34.422875388s) [noise=true , address=104.36.82.5:4861 , piece_id=3HVPL26KKW7FH6Q5QBCQHQVPOHUROAEHJJLLFKAPG7VIPSRXWYZQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.691928240 (225h25m34.42319585s) [noise=true , address=104.36.82.35:4605 , piece_id=BMGN2GMP67IDRZYJS5VW3F4S3GHXKGIP22WEOXUPSF66YK74V5GQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.692626022 (225h25m34.423893672s) [noise=true , address=104.36.82.38:4697 , piece_id=FGBXFTMPB5TN3MFUIBVZBYFU5SPCXLT2LBLAUOCFFSOYOLB46DPQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.693739965 (225h25m34.425007585s) [noise=true , address=77.90.31.16:4764 , piece_id=YSVEW2IJNARZJR7WDMF6ESPBR63TPH3FKEYZIQTTRYQGQEOAY4SA, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.696934760 (225h25m34.42820242s) [noise=true , address=104.36.82.50:4041 , piece_id=PVHKLIQWRB63ZTQL67N2VE5M23MTTPFBJKTX37WXJR6BY2VRIDPA, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.697492589 (225h25m34.428760209s) [noise=true , address=104.36.82.44:4877 , piece_id=QHH4YZS3OM536ZWYAE44THXT2MS3T2P2FLVCI7UAXGUYOYQYHDDQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.697777675 (225h25m34.429045295s) [noise=true , address=104.36.82.3:4799 , piece_id=MJFNACMRHHJ6YUTTXWFPCSK76Q637M25PYZDFYT3SMPFHD6QZJSA, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.698667798 (225h25m34.429935417s) [noise=true , address=45.91.116.12:4233 , piece_id=NNHRQEU37FHX4DWEEAUB7K3WWWRQLWPWK24NREIVW7XOFCKNVYJQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.721802430 (225h25m34.453070081s) [noise=true , address=77.90.31.19:4854 , piece_id=QDR7V47RP2ZAUBENMP2DL32742RNCWDT2SHSJPHMAHRK4O5EE22A, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.737266997 (225h25m34.468534627s) [noise=true , address=79.127.220.97:4384 , piece_id=SRWSOZWIA7A5KAIOEPHAZOLDIBVNDPD5U3LFOS6U3HFU7GJSYLVA, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.738121863 (225h25m34.469389514s) [noise=true , address=104.36.82.18:4371 , piece_id=2WEWUVPON46PVON2PBQRRHXXRSKRVDOINDGCSB62AZELHXAWK5MQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.777847510 (225h25m34.50911513s) [noise=true , address=77.90.31.19:4853 , piece_id=IZZFORRHU2B5VP7EQVV2UYEIIA6MYC2X7FCBV2ZI2VO4MT2FLUPQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.808603548 (225h25m34.539871198s) [noise=true , address=79.127.201.215:4356 , piece_id=HP5JW5X22T3HCEIVRDFMKIA4TVZWEXRP7KAOAIPNOY2KRHYPHZJQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: <nil>
Aug 18 02:51:53.808641569 (225h25m34.53990922s) [seg_pos={0 0}, upload=234584]: Segment reached optimal threshold of 14 pieces.
Aug 18 02:51:53.808936984 (225h25m34.540204634s) [noise=true , address=45.91.116.10:4094 , piece_id=2LMTJ626JQM3ZIXC66NLBWAQQUSO47NTQ2U3B5YXK75L4H6WGEZQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12R5csTJKhU4qSrzDL9vvhhosTu7BCYeEQigCtiVPaGLKEuJbmw): protocol: expected piece hash; context canceled; EOF
Aug 18 02:51:53.809003390 (225h25m34.54027104s) [noise=true , address=104.36.82.60:4343 , piece_id=EOTBYZVAVXABNAMDH5OQ6QUHHYRSNH67NWRY33FVIV6HELAWYH4A, seg_pos={0 0}, upload=234584]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf): protocol: expected piece hash; context canceled; EOF
Aug 18 02:51:53.809095513 (225h25m34.540363163s) [noise=true , address=77.90.31.13:4644 , piece_id=ZNZ4V4ONICQX4DBWM3D4HYMX65MQLVIZ3YSDNFVDK52VXC3LPXDQ, seg_pos={0 0}, upload=234584]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13QCH91kRMQjVj2ASsVDcyXQ1aapQRVeUm6MMCGimsR6Ns973h): protocol: write tcp 5.161.89.252:27288->77.90.31.13:4644: use of closed network connection; write tcp 5.161.89.252:27288->77.90.31.13:4644: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27288->77.90.31.13:4644: use of closed network connection
Aug 18 02:51:53.809108658 (225h25m34.540376307s) [noise=true , address=77.90.31.12:4623 , piece_id=KSQAK65PQ4TOL6LJR63Q74IHSR7VJ2RN3OVCUNIDCV5J62GSUDNA, seg_pos={0 0}, upload=234584]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ANjFmZrb9SDcqEHW8CBzeMtwvmceoLH9MtPabAjBw8wXjBuaM): protocol: expected piece hash; context canceled; EOF
Aug 18 02:51:53.809127312 (225h25m34.540394963s) [seg_pos={0 0}, upload=234584]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 02:51:53.809203625 (225h25m34.540471276s) [upload=234584]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 02:51:53.809209066 (225h25m34.540476716s) [upload=234584]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:51:53.859699626 (225h25m34.590967276s) [upload=234584]: Done uploading segments...
Aug 18 02:51:53.859716678 (225h25m34.590984328s) [upload=234584]: Upload finished. err: <nil>
Duration: 371.948428ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
156.363074ms
FAIL (2025-08-18 02:51:44 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 156.385777ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X..............................X..........] duration:
396.943177ms
FAIL (2025-08-18 02:51:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:43:22.806467444 (225h17m3.537735064s) [upload=234424]: Starting upload Aug 18 02:43:22.806507148 (225h17m3.537774778s) [upload=234424]: Done starting upload Aug 18 02:43:22.806602629 (225h17m3.537870259s) [upload=234424]: Uploading segments... Aug 18 02:43:22.806723435 (225h17m3.537991065s) [upload=234424]: Got next segment. Inline: false Aug 18 02:43:22.806746528 (225h17m3.538014148s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:43:22.806752058 (225h17m3.538019679s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:43:22.809465438 (225h17m3.540733068s) [upload=234424]: Next segment err: metaclient: Too Many Requests Aug 18 02:43:22.809474917 (225h17m3.540742548s) [upload=234424]: Done uploading segments... Aug 18 02:43:22.809482923 (225h17m3.540750542s) [upload=234424]: Upload finished. err: metaclient: Too Many Requests
Duration: 396.971812ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X..............................X.........] duration:
675.255011ms
FAIL (2025-08-18 02:50:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:43:22.806467444 (225h17m3.537735064s) [upload=234424]: Starting upload Aug 18 02:43:22.806507148 (225h17m3.537774778s) [upload=234424]: Done starting upload Aug 18 02:43:22.806602629 (225h17m3.537870259s) [upload=234424]: Uploading segments... Aug 18 02:43:22.806723435 (225h17m3.537991065s) [upload=234424]: Got next segment. Inline: false Aug 18 02:43:22.806746528 (225h17m3.538014148s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:43:22.806752058 (225h17m3.538019679s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:43:22.809465438 (225h17m3.540733068s) [upload=234424]: Next segment err: metaclient: Too Many Requests Aug 18 02:43:22.809474917 (225h17m3.540742548s) [upload=234424]: Done uploading segments... Aug 18 02:43:22.809482923 (225h17m3.540750542s) [upload=234424]: Upload finished. err: metaclient: Too Many Requests
Duration: 675.278515ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
221.803683ms
FAIL (2025-08-18 02:50:51 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 221.822367ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
130.61537ms
FAIL (2025-08-18 02:50:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 130.643451ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X..............................X........] duration:
374.291482ms
FAIL (2025-08-18 02:49:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:43:22.806467444 (225h17m3.537735064s) [upload=234424]: Starting upload Aug 18 02:43:22.806507148 (225h17m3.537774778s) [upload=234424]: Done starting upload Aug 18 02:43:22.806602629 (225h17m3.537870259s) [upload=234424]: Uploading segments... Aug 18 02:43:22.806723435 (225h17m3.537991065s) [upload=234424]: Got next segment. Inline: false Aug 18 02:43:22.806746528 (225h17m3.538014148s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:43:22.806752058 (225h17m3.538019679s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:43:22.809465438 (225h17m3.540733068s) [upload=234424]: Next segment err: metaclient: Too Many Requests Aug 18 02:43:22.809474917 (225h17m3.540742548s) [upload=234424]: Done uploading segments... Aug 18 02:43:22.809482923 (225h17m3.540750542s) [upload=234424]: Upload finished. err: metaclient: Too Many Requests
Duration: 374.324715ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X..............................X.......] duration:
385.357944ms
FAIL (2025-08-18 02:49:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:43:22.806467444 (225h17m3.537735064s) [upload=234424]: Starting upload Aug 18 02:43:22.806507148 (225h17m3.537774778s) [upload=234424]: Done starting upload Aug 18 02:43:22.806602629 (225h17m3.537870259s) [upload=234424]: Uploading segments... Aug 18 02:43:22.806723435 (225h17m3.537991065s) [upload=234424]: Got next segment. Inline: false Aug 18 02:43:22.806746528 (225h17m3.538014148s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:43:22.806752058 (225h17m3.538019679s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:43:22.809465438 (225h17m3.540733068s) [upload=234424]: Next segment err: metaclient: Too Many Requests Aug 18 02:43:22.809474917 (225h17m3.540742548s) [upload=234424]: Done uploading segments... Aug 18 02:43:22.809482923 (225h17m3.540750542s) [upload=234424]: Upload finished. err: metaclient: Too Many Requests
Duration: 385.378864ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
136.259288ms
FAIL (2025-08-18 02:49:18 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 136.281389ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
127.525913ms
FAIL (2025-08-18 02:48:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 127.552712ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X..............................X......] duration:
375.427598ms
FAIL (2025-08-18 02:48:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:43:22.806467444 (225h17m3.537735064s) [upload=234424]: Starting upload Aug 18 02:43:22.806507148 (225h17m3.537774778s) [upload=234424]: Done starting upload Aug 18 02:43:22.806602629 (225h17m3.537870259s) [upload=234424]: Uploading segments... Aug 18 02:43:22.806723435 (225h17m3.537991065s) [upload=234424]: Got next segment. Inline: false Aug 18 02:43:22.806746528 (225h17m3.538014148s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:43:22.806752058 (225h17m3.538019679s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:43:22.809465438 (225h17m3.540733068s) [upload=234424]: Next segment err: metaclient: Too Many Requests Aug 18 02:43:22.809474917 (225h17m3.540742548s) [upload=234424]: Done uploading segments... Aug 18 02:43:22.809482923 (225h17m3.540750542s) [upload=234424]: Upload finished. err: metaclient: Too Many Requests
Duration: 375.445531ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
136.667896ms
FAIL (2025-08-18 02:48:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 136.697932ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X..............................X.....] duration:
792.705257ms
FAIL (2025-08-18 02:47:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:43:22.806467444 (225h17m3.537735064s) [upload=234424]: Starting upload Aug 18 02:43:22.806507148 (225h17m3.537774778s) [upload=234424]: Done starting upload Aug 18 02:43:22.806602629 (225h17m3.537870259s) [upload=234424]: Uploading segments... Aug 18 02:43:22.806723435 (225h17m3.537991065s) [upload=234424]: Got next segment. Inline: false Aug 18 02:43:22.806746528 (225h17m3.538014148s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:43:22.806752058 (225h17m3.538019679s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:43:22.809465438 (225h17m3.540733068s) [upload=234424]: Next segment err: metaclient: Too Many Requests Aug 18 02:43:22.809474917 (225h17m3.540742548s) [upload=234424]: Done uploading segments... Aug 18 02:43:22.809482923 (225h17m3.540750542s) [upload=234424]: Upload finished. err: metaclient: Too Many Requests
Duration: 792.732838ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
146.846837ms
FAIL (2025-08-18 02:47:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 146.870192ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
226.073157ms
FAIL (2025-08-18 02:46:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 226.099577ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
393.306643ms
FAIL (2025-08-18 02:46:21 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 393.331469ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X..............................X....] duration:
366.121076ms
FAIL (2025-08-18 02:46:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:43:22.806467444 (225h17m3.537735064s) [upload=234424]: Starting upload Aug 18 02:43:22.806507148 (225h17m3.537774778s) [upload=234424]: Done starting upload Aug 18 02:43:22.806602629 (225h17m3.537870259s) [upload=234424]: Uploading segments... Aug 18 02:43:22.806723435 (225h17m3.537991065s) [upload=234424]: Got next segment. Inline: false Aug 18 02:43:22.806746528 (225h17m3.538014148s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:43:22.806752058 (225h17m3.538019679s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:43:22.809465438 (225h17m3.540733068s) [upload=234424]: Next segment err: metaclient: Too Many Requests Aug 18 02:43:22.809474917 (225h17m3.540742548s) [upload=234424]: Done uploading segments... Aug 18 02:43:22.809482923 (225h17m3.540750542s) [upload=234424]: Upload finished. err: metaclient: Too Many Requests
Duration: 366.141123ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
200.177103ms
FAIL (2025-08-18 02:45:21 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 200.207241ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X..............................X...] duration:
364.543401ms
FAIL (2025-08-18 02:45:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:43:22.806467444 (225h17m3.537735064s) [upload=234424]: Starting upload Aug 18 02:43:22.806507148 (225h17m3.537774778s) [upload=234424]: Done starting upload Aug 18 02:43:22.806602629 (225h17m3.537870259s) [upload=234424]: Uploading segments... Aug 18 02:43:22.806723435 (225h17m3.537991065s) [upload=234424]: Got next segment. Inline: false Aug 18 02:43:22.806746528 (225h17m3.538014148s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:43:22.806752058 (225h17m3.538019679s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:43:22.809465438 (225h17m3.540733068s) [upload=234424]: Next segment err: metaclient: Too Many Requests Aug 18 02:43:22.809474917 (225h17m3.540742548s) [upload=234424]: Done uploading segments... Aug 18 02:43:22.809482923 (225h17m3.540750542s) [upload=234424]: Upload finished. err: metaclient: Too Many Requests
Duration: 364.582266ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X..............................X..] duration:
376.992348ms
FAIL (2025-08-18 02:45:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:43:22.806467444 (225h17m3.537735064s) [upload=234424]: Starting upload Aug 18 02:43:22.806507148 (225h17m3.537774778s) [upload=234424]: Done starting upload Aug 18 02:43:22.806602629 (225h17m3.537870259s) [upload=234424]: Uploading segments... Aug 18 02:43:22.806723435 (225h17m3.537991065s) [upload=234424]: Got next segment. Inline: false Aug 18 02:43:22.806746528 (225h17m3.538014148s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:43:22.806752058 (225h17m3.538019679s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:43:22.809465438 (225h17m3.540733068s) [upload=234424]: Next segment err: metaclient: Too Many Requests Aug 18 02:43:22.809474917 (225h17m3.540742548s) [upload=234424]: Done uploading segments... Aug 18 02:43:22.809482923 (225h17m3.540750542s) [upload=234424]: Upload finished. err: metaclient: Too Many Requests
Duration: 377.01448ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X..............................X.] duration:
561.517825ms
FAIL (2025-08-18 02:44:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:43:22.806467444 (225h17m3.537735064s) [upload=234424]: Starting upload Aug 18 02:43:22.806507148 (225h17m3.537774778s) [upload=234424]: Done starting upload Aug 18 02:43:22.806602629 (225h17m3.537870259s) [upload=234424]: Uploading segments... Aug 18 02:43:22.806723435 (225h17m3.537991065s) [upload=234424]: Got next segment. Inline: false Aug 18 02:43:22.806746528 (225h17m3.538014148s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:43:22.806752058 (225h17m3.538019679s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:43:22.809465438 (225h17m3.540733068s) [upload=234424]: Next segment err: metaclient: Too Many Requests Aug 18 02:43:22.809474917 (225h17m3.540742548s) [upload=234424]: Done uploading segments... Aug 18 02:43:22.809482923 (225h17m3.540750542s) [upload=234424]: Upload finished. err: metaclient: Too Many Requests
Duration: 561.550186ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
178.090101ms
FAIL (2025-08-18 02:44:18 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 178.118755ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
131.661305ms
FAIL (2025-08-18 02:43:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 131.67964ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X..............................X] duration:
16.886408ms
FAIL (2025-08-18 02:43:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:43:22.806467444 (225h17m3.537735064s) [upload=234424]: Starting upload Aug 18 02:43:22.806507148 (225h17m3.537774778s) [upload=234424]: Done starting upload Aug 18 02:43:22.806602629 (225h17m3.537870259s) [upload=234424]: Uploading segments... Aug 18 02:43:22.806723435 (225h17m3.537991065s) [upload=234424]: Got next segment. Inline: false Aug 18 02:43:22.806746528 (225h17m3.538014148s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:43:22.806752058 (225h17m3.538019679s) [upload=234424]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:43:22.809465438 (225h17m3.540733068s) [upload=234424]: Next segment err: metaclient: Too Many Requests Aug 18 02:43:22.809474917 (225h17m3.540742548s) [upload=234424]: Done uploading segments... Aug 18 02:43:22.809482923 (225h17m3.540750542s) [upload=234424]: Upload finished. err: metaclient: Too Many Requests
Duration: 16.900715ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
151.194849ms
FAIL (2025-08-18 02:42:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 151.213464ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X............................X..............................] duration:
489.225487ms
FAIL (2025-08-18 02:42:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:18:27.415866899 (224h52m8.147134529s) [upload=234000]: Starting upload Aug 18 02:18:27.415904180 (224h52m8.1471718s) [upload=234000]: Done starting upload Aug 18 02:18:27.416025788 (224h52m8.147293418s) [upload=234000]: Uploading segments... Aug 18 02:18:27.416229702 (224h52m8.147497332s) [upload=234000]: Got next segment. Inline: false Aug 18 02:18:27.416259177 (224h52m8.147526807s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:18:27.416262984 (224h52m8.147530604s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:18:27.418773402 (224h52m8.150041033s) [upload=234000]: Next segment err: metaclient: Too Many Requests Aug 18 02:18:27.418783521 (224h52m8.150051151s) [upload=234000]: Done uploading segments... Aug 18 02:18:27.418791666 (224h52m8.150059286s) [upload=234000]: Upload finished. err: metaclient: Too Many Requests
Duration: 489.246927ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
131.30215ms
FAIL (2025-08-18 02:42:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 131.324823ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X............................X.............................] duration:
355.033648ms
FAIL (2025-08-18 02:41:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:18:27.415866899 (224h52m8.147134529s) [upload=234000]: Starting upload Aug 18 02:18:27.415904180 (224h52m8.1471718s) [upload=234000]: Done starting upload Aug 18 02:18:27.416025788 (224h52m8.147293418s) [upload=234000]: Uploading segments... Aug 18 02:18:27.416229702 (224h52m8.147497332s) [upload=234000]: Got next segment. Inline: false Aug 18 02:18:27.416259177 (224h52m8.147526807s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:18:27.416262984 (224h52m8.147530604s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:18:27.418773402 (224h52m8.150041033s) [upload=234000]: Next segment err: metaclient: Too Many Requests Aug 18 02:18:27.418783521 (224h52m8.150051151s) [upload=234000]: Done uploading segments... Aug 18 02:18:27.418791666 (224h52m8.150059286s) [upload=234000]: Upload finished. err: metaclient: Too Many Requests
Duration: 355.063022ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
124.863778ms
FAIL (2025-08-18 02:41:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 124.882243ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
219.260493ms
FAIL (2025-08-18 02:40:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 219.289617ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X............................X............................] duration:
453.770399ms
FAIL (2025-08-18 02:40:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:18:27.415866899 (224h52m8.147134529s) [upload=234000]: Starting upload Aug 18 02:18:27.415904180 (224h52m8.1471718s) [upload=234000]: Done starting upload Aug 18 02:18:27.416025788 (224h52m8.147293418s) [upload=234000]: Uploading segments... Aug 18 02:18:27.416229702 (224h52m8.147497332s) [upload=234000]: Got next segment. Inline: false Aug 18 02:18:27.416259177 (224h52m8.147526807s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:18:27.416262984 (224h52m8.147530604s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:18:27.418773402 (224h52m8.150041033s) [upload=234000]: Next segment err: metaclient: Too Many Requests Aug 18 02:18:27.418783521 (224h52m8.150051151s) [upload=234000]: Done uploading segments... Aug 18 02:18:27.418791666 (224h52m8.150059286s) [upload=234000]: Upload finished. err: metaclient: Too Many Requests
Duration: 453.7924ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
136.873681ms
FAIL (2025-08-18 02:40:16 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 136.895333ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X............................X...........................] duration:
891.930677ms
FAIL (2025-08-18 02:40:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:18:27.415866899 (224h52m8.147134529s) [upload=234000]: Starting upload Aug 18 02:18:27.415904180 (224h52m8.1471718s) [upload=234000]: Done starting upload Aug 18 02:18:27.416025788 (224h52m8.147293418s) [upload=234000]: Uploading segments... Aug 18 02:18:27.416229702 (224h52m8.147497332s) [upload=234000]: Got next segment. Inline: false Aug 18 02:18:27.416259177 (224h52m8.147526807s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:18:27.416262984 (224h52m8.147530604s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:18:27.418773402 (224h52m8.150041033s) [upload=234000]: Next segment err: metaclient: Too Many Requests Aug 18 02:18:27.418783521 (224h52m8.150051151s) [upload=234000]: Done uploading segments... Aug 18 02:18:27.418791666 (224h52m8.150059286s) [upload=234000]: Upload finished. err: metaclient: Too Many Requests
Duration: 891.956886ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
448.760062ms
FAIL (2025-08-18 02:39:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 448.786692ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X............................X..........................] duration:
387.865857ms
FAIL (2025-08-18 02:39:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:18:27.415866899 (224h52m8.147134529s) [upload=234000]: Starting upload Aug 18 02:18:27.415904180 (224h52m8.1471718s) [upload=234000]: Done starting upload Aug 18 02:18:27.416025788 (224h52m8.147293418s) [upload=234000]: Uploading segments... Aug 18 02:18:27.416229702 (224h52m8.147497332s) [upload=234000]: Got next segment. Inline: false Aug 18 02:18:27.416259177 (224h52m8.147526807s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:18:27.416262984 (224h52m8.147530604s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:18:27.418773402 (224h52m8.150041033s) [upload=234000]: Next segment err: metaclient: Too Many Requests Aug 18 02:18:27.418783521 (224h52m8.150051151s) [upload=234000]: Done uploading segments... Aug 18 02:18:27.418791666 (224h52m8.150059286s) [upload=234000]: Upload finished. err: metaclient: Too Many Requests
Duration: 387.893289ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X....X............................X.........................] duration:
549.667301ms
FAIL (2025-08-18 02:38:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:18:27.415866899 (224h52m8.147134529s) [upload=234000]: Starting upload Aug 18 02:18:27.415904180 (224h52m8.1471718s) [upload=234000]: Done starting upload Aug 18 02:18:27.416025788 (224h52m8.147293418s) [upload=234000]: Uploading segments... Aug 18 02:18:27.416229702 (224h52m8.147497332s) [upload=234000]: Got next segment. Inline: false Aug 18 02:18:27.416259177 (224h52m8.147526807s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:18:27.416262984 (224h52m8.147530604s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:18:27.418773402 (224h52m8.150041033s) [upload=234000]: Next segment err: metaclient: Too Many Requests Aug 18 02:18:27.418783521 (224h52m8.150051151s) [upload=234000]: Done uploading segments... Aug 18 02:18:27.418791666 (224h52m8.150059286s) [upload=234000]: Upload finished. err: metaclient: Too Many Requests
Duration: 549.692999ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
306.678261ms
FAIL (2025-08-18 02:38:21 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 306.710731ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
160.74516ms
FAIL (2025-08-18 02:38:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 160.762774ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X....X............................X........................] duration:
562.500302ms
FAIL (2025-08-18 02:37:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:18:27.415866899 (224h52m8.147134529s) [upload=234000]: Starting upload Aug 18 02:18:27.415904180 (224h52m8.1471718s) [upload=234000]: Done starting upload Aug 18 02:18:27.416025788 (224h52m8.147293418s) [upload=234000]: Uploading segments... Aug 18 02:18:27.416229702 (224h52m8.147497332s) [upload=234000]: Got next segment. Inline: false Aug 18 02:18:27.416259177 (224h52m8.147526807s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:18:27.416262984 (224h52m8.147530604s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:18:27.418773402 (224h52m8.150041033s) [upload=234000]: Next segment err: metaclient: Too Many Requests Aug 18 02:18:27.418783521 (224h52m8.150051151s) [upload=234000]: Done uploading segments... Aug 18 02:18:27.418791666 (224h52m8.150059286s) [upload=234000]: Upload finished. err: metaclient: Too Many Requests
Duration: 562.525591ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
155.992348ms
FAIL (2025-08-18 02:37:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 156.017396ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X....X............................X.......................] duration:
392.157298ms
FAIL (2025-08-18 02:36:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:18:27.415866899 (224h52m8.147134529s) [upload=234000]: Starting upload Aug 18 02:18:27.415904180 (224h52m8.1471718s) [upload=234000]: Done starting upload Aug 18 02:18:27.416025788 (224h52m8.147293418s) [upload=234000]: Uploading segments... Aug 18 02:18:27.416229702 (224h52m8.147497332s) [upload=234000]: Got next segment. Inline: false Aug 18 02:18:27.416259177 (224h52m8.147526807s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:18:27.416262984 (224h52m8.147530604s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:18:27.418773402 (224h52m8.150041033s) [upload=234000]: Next segment err: metaclient: Too Many Requests Aug 18 02:18:27.418783521 (224h52m8.150051151s) [upload=234000]: Done uploading segments... Aug 18 02:18:27.418791666 (224h52m8.150059286s) [upload=234000]: Upload finished. err: metaclient: Too Many Requests
Duration: 392.181374ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
314.057896ms
FAIL (2025-08-18 02:36:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 314.170648ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X....X............................X......................] duration:
389.677516ms
FAIL (2025-08-18 02:36:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:18:27.415866899 (224h52m8.147134529s) [upload=234000]: Starting upload Aug 18 02:18:27.415904180 (224h52m8.1471718s) [upload=234000]: Done starting upload Aug 18 02:18:27.416025788 (224h52m8.147293418s) [upload=234000]: Uploading segments... Aug 18 02:18:27.416229702 (224h52m8.147497332s) [upload=234000]: Got next segment. Inline: false Aug 18 02:18:27.416259177 (224h52m8.147526807s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:18:27.416262984 (224h52m8.147530604s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:18:27.418773402 (224h52m8.150041033s) [upload=234000]: Next segment err: metaclient: Too Many Requests Aug 18 02:18:27.418783521 (224h52m8.150051151s) [upload=234000]: Done uploading segments... Aug 18 02:18:27.418791666 (224h52m8.150059286s) [upload=234000]: Upload finished. err: metaclient: Too Many Requests
Duration: 389.703364ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
160.027792ms
FAIL (2025-08-18 02:36:15 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 160.054392ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
262.600989ms
FAIL (2025-08-18 02:35:21 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 262.624452ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X....X............................X.....................] duration:
375.037896ms
FAIL (2025-08-18 02:35:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:18:27.415866899 (224h52m8.147134529s) [upload=234000]: Starting upload Aug 18 02:18:27.415904180 (224h52m8.1471718s) [upload=234000]: Done starting upload Aug 18 02:18:27.416025788 (224h52m8.147293418s) [upload=234000]: Uploading segments... Aug 18 02:18:27.416229702 (224h52m8.147497332s) [upload=234000]: Got next segment. Inline: false Aug 18 02:18:27.416259177 (224h52m8.147526807s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:18:27.416262984 (224h52m8.147530604s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:18:27.418773402 (224h52m8.150041033s) [upload=234000]: Next segment err: metaclient: Too Many Requests Aug 18 02:18:27.418783521 (224h52m8.150051151s) [upload=234000]: Done uploading segments... Aug 18 02:18:27.418791666 (224h52m8.150059286s) [upload=234000]: Upload finished. err: metaclient: Too Many Requests
Duration: 375.065228ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X....X............................X....................] duration:
380.670186ms
FAIL (2025-08-18 02:34:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:18:27.415866899 (224h52m8.147134529s) [upload=234000]: Starting upload Aug 18 02:18:27.415904180 (224h52m8.1471718s) [upload=234000]: Done starting upload Aug 18 02:18:27.416025788 (224h52m8.147293418s) [upload=234000]: Uploading segments... Aug 18 02:18:27.416229702 (224h52m8.147497332s) [upload=234000]: Got next segment. Inline: false Aug 18 02:18:27.416259177 (224h52m8.147526807s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:18:27.416262984 (224h52m8.147530604s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:18:27.418773402 (224h52m8.150041033s) [upload=234000]: Next segment err: metaclient: Too Many Requests Aug 18 02:18:27.418783521 (224h52m8.150051151s) [upload=234000]: Done uploading segments... Aug 18 02:18:27.418791666 (224h52m8.150059286s) [upload=234000]: Upload finished. err: metaclient: Too Many Requests
Duration: 380.689643ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
126.258352ms
FAIL (2025-08-18 02:34:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 02:31:43.938457411 (225h5m24.669725031s) [upload=234226]: Starting upload
Aug 18 02:31:43.938499440 (225h5m24.66976706s) [upload=234226]: Done starting upload
Aug 18 02:31:43.938540947 (225h5m24.669808578s) [upload=234226]: Uploading segments...
Aug 18 02:31:43.938570655 (225h5m24.669838285s) [upload=234226]: Got next segment. Inline: true
Aug 18 02:31:43.938574151 (225h5m24.669841771s) [upload=234226]: Waiting for error group managing segments...
Aug 18 02:31:43.938605921 (225h5m24.669873551s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 02:31:43.938609748 (225h5m24.669877368s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 02:31:43.938612223 (225h5m24.669879853s) [upload=234226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 02:31:43.998945652 (225h5m24.730213282s) [upload=234226]: Done uploading segments...
Aug 18 02:31:43.998960309 (225h5m24.730227939s) [upload=234226]: Upload finished. err: <nil>
Duration: 126.27869ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X....X............................X...................] duration:
363.431827ms
FAIL (2025-08-18 02:33:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 02:18:27.415866899 (224h52m8.147134529s) [upload=234000]: Starting upload Aug 18 02:18:27.415904180 (224h52m8.1471718s) [upload=234000]: Done starting upload Aug 18 02:18:27.416025788 (224h52m8.147293418s) [upload=234000]: Uploading segments... Aug 18 02:18:27.416229702 (224h52m8.147497332s) [upload=234000]: Got next segment. Inline: false Aug 18 02:18:27.416259177 (224h52m8.147526807s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 02:18:27.416262984 (224h52m8.147530604s) [upload=234000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 02:18:27.418773402 (224h52m8.150041033s) [upload=234000]: Next segment err: metaclient: Too Many Requests Aug 18 02:18:27.418783521 (224h52m8.150051151s) [upload=234000]: Done uploading segments... Aug 18 02:18:27.418791666 (224h52m8.150059286s) [upload=234000]: Upload finished. err: metaclient: Too Many Requests
Duration: 363.451995ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|