Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
979.098732ms
FAIL (2025-08-25 11:57:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 25 11:48:32.075903723 (402h22m12.807171372s) [upload=418307]: Starting upload
Aug 25 11:48:32.076015072 (402h22m12.807282732s) [upload=418307]: Done starting upload
Aug 25 11:48:32.076133023 (402h22m12.807400643s) [upload=418307]: Uploading segments...
Aug 25 11:48:32.076440052 (402h22m12.807707701s) [upload=418307]: Got next segment. Inline: false
Aug 25 11:48:32.076513229 (402h22m12.807780878s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 11:48:32.076525973 (402h22m12.807793622s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 11:48:32.108446176 (402h22m12.839713806s) [seg_pos={0 0}, upload=418307]: Begin upload segment...
Aug 25 11:48:32.108482945 (402h22m12.839750575s) [seg_pos={0 0}, upload=418307]: Done begin upload segment.
Aug 25 11:48:32.108500348 (402h22m12.839768008s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108514855 (402h22m12.839782475s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108846489 (402h22m12.840114119s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108855345 (402h22m12.840122975s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109086280 (402h22m12.84035391s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109360335 (402h22m12.840627966s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109598955 (402h22m12.840866585s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109837814 (402h22m12.841105444s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110052007 (402h22m12.841319637s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110283732 (402h22m12.841551352s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110551747 (402h22m12.841819377s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110806295 (402h22m12.842073945s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111061075 (402h22m12.842328705s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111323137 (402h22m12.842590767s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111537080 (402h22m12.84280471s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111780718 (402h22m12.843048339s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.112027152 (402h22m12.843294772s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.115011826 (402h22m12.846279457s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.186959611 (402h22m12.918227241s) [upload=418307]: Next returned nil segment
Aug 25 11:48:32.186970101 (402h22m12.918237721s) [upload=418307]: Waiting for error group managing segments...
Aug 25 11:48:32.196294261 (402h22m12.92756188s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.196620114 (402h22m12.927887744s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.198090630 (402h22m12.92935826s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.200444698 (402h22m12.931712318s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201437114 (402h22m12.932704734s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201824963 (402h22m12.933092594s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201885919 (402h22m12.933153539s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.202787154 (402h22m12.934054774s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.203257398 (402h22m12.934525018s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.205635481 (402h22m12.936903111s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.216972497 (402h22m12.948240127s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.221689199 (402h22m12.952956819s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.287006793 (402h22m13.018274413s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301972835 (402h22m13.033240455s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301999755 (402h22m13.033267385s) [seg_pos={0 0}, upload=418307]: Segment reached optimal threshold of 14 pieces.
Aug 25 11:48:32.304713500 (402h22m13.03598112s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection
Aug 25 11:48:32.304759626 (402h22m13.036027237s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: read tcp 5.161.89.252:35532->79.127.205.234:4612: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304772340 (402h22m13.03603996s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ttjngUh34tGJpCBgVCLfqrWwsdmd88XKWPrmaJrgkMu8htkKM): protocol: read tcp 5.161.89.252:27394->104.36.82.53:4123: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304797058 (402h22m13.036064678s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k72iHWdcnM2JKs7VPTQFQwmpQ835HmAP8KpXxjMbEy5QxfzG): protocol: read tcp 5.161.89.252:64712->79.127.205.246:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304804441 (402h22m13.036072062s) [seg_pos={0 0}, upload=418307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 11:48:32.304853163 (402h22m13.036120783s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 11:48:32.304856800 (402h22m13.03612442s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 11:48:32.566310632 (402h22m13.297578281s) [upload=418307]: Done uploading segments...
Aug 25 11:48:32.566362549 (402h22m13.297630209s) [upload=418307]: Upload finished. err: <nil>
Duration: 979.125793ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
1.688901446s
FAIL (2025-08-25 11:56:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 25 11:48:32.075903723 (402h22m12.807171372s) [upload=418307]: Starting upload
Aug 25 11:48:32.076015072 (402h22m12.807282732s) [upload=418307]: Done starting upload
Aug 25 11:48:32.076133023 (402h22m12.807400643s) [upload=418307]: Uploading segments...
Aug 25 11:48:32.076440052 (402h22m12.807707701s) [upload=418307]: Got next segment. Inline: false
Aug 25 11:48:32.076513229 (402h22m12.807780878s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 11:48:32.076525973 (402h22m12.807793622s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 11:48:32.108446176 (402h22m12.839713806s) [seg_pos={0 0}, upload=418307]: Begin upload segment...
Aug 25 11:48:32.108482945 (402h22m12.839750575s) [seg_pos={0 0}, upload=418307]: Done begin upload segment.
Aug 25 11:48:32.108500348 (402h22m12.839768008s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108514855 (402h22m12.839782475s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108846489 (402h22m12.840114119s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108855345 (402h22m12.840122975s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109086280 (402h22m12.84035391s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109360335 (402h22m12.840627966s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109598955 (402h22m12.840866585s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109837814 (402h22m12.841105444s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110052007 (402h22m12.841319637s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110283732 (402h22m12.841551352s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110551747 (402h22m12.841819377s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110806295 (402h22m12.842073945s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111061075 (402h22m12.842328705s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111323137 (402h22m12.842590767s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111537080 (402h22m12.84280471s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111780718 (402h22m12.843048339s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.112027152 (402h22m12.843294772s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.115011826 (402h22m12.846279457s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.186959611 (402h22m12.918227241s) [upload=418307]: Next returned nil segment
Aug 25 11:48:32.186970101 (402h22m12.918237721s) [upload=418307]: Waiting for error group managing segments...
Aug 25 11:48:32.196294261 (402h22m12.92756188s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.196620114 (402h22m12.927887744s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.198090630 (402h22m12.92935826s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.200444698 (402h22m12.931712318s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201437114 (402h22m12.932704734s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201824963 (402h22m12.933092594s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201885919 (402h22m12.933153539s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.202787154 (402h22m12.934054774s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.203257398 (402h22m12.934525018s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.205635481 (402h22m12.936903111s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.216972497 (402h22m12.948240127s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.221689199 (402h22m12.952956819s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.287006793 (402h22m13.018274413s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301972835 (402h22m13.033240455s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301999755 (402h22m13.033267385s) [seg_pos={0 0}, upload=418307]: Segment reached optimal threshold of 14 pieces.
Aug 25 11:48:32.304713500 (402h22m13.03598112s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection
Aug 25 11:48:32.304759626 (402h22m13.036027237s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: read tcp 5.161.89.252:35532->79.127.205.234:4612: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304772340 (402h22m13.03603996s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ttjngUh34tGJpCBgVCLfqrWwsdmd88XKWPrmaJrgkMu8htkKM): protocol: read tcp 5.161.89.252:27394->104.36.82.53:4123: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304797058 (402h22m13.036064678s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k72iHWdcnM2JKs7VPTQFQwmpQ835HmAP8KpXxjMbEy5QxfzG): protocol: read tcp 5.161.89.252:64712->79.127.205.246:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304804441 (402h22m13.036072062s) [seg_pos={0 0}, upload=418307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 11:48:32.304853163 (402h22m13.036120783s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 11:48:32.304856800 (402h22m13.03612442s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 11:48:32.566310632 (402h22m13.297578281s) [upload=418307]: Done uploading segments...
Aug 25 11:48:32.566362549 (402h22m13.297630209s) [upload=418307]: Upload finished. err: <nil>
Duration: 1.688928647s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X...............................................X...........] duration:
335.563693ms
FAIL (2025-08-25 11:56:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 25 11:48:32.075903723 (402h22m12.807171372s) [upload=418307]: Starting upload
Aug 25 11:48:32.076015072 (402h22m12.807282732s) [upload=418307]: Done starting upload
Aug 25 11:48:32.076133023 (402h22m12.807400643s) [upload=418307]: Uploading segments...
Aug 25 11:48:32.076440052 (402h22m12.807707701s) [upload=418307]: Got next segment. Inline: false
Aug 25 11:48:32.076513229 (402h22m12.807780878s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 11:48:32.076525973 (402h22m12.807793622s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 11:48:32.108446176 (402h22m12.839713806s) [seg_pos={0 0}, upload=418307]: Begin upload segment...
Aug 25 11:48:32.108482945 (402h22m12.839750575s) [seg_pos={0 0}, upload=418307]: Done begin upload segment.
Aug 25 11:48:32.108500348 (402h22m12.839768008s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108514855 (402h22m12.839782475s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108846489 (402h22m12.840114119s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108855345 (402h22m12.840122975s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109086280 (402h22m12.84035391s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109360335 (402h22m12.840627966s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109598955 (402h22m12.840866585s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109837814 (402h22m12.841105444s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110052007 (402h22m12.841319637s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110283732 (402h22m12.841551352s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110551747 (402h22m12.841819377s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110806295 (402h22m12.842073945s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111061075 (402h22m12.842328705s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111323137 (402h22m12.842590767s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111537080 (402h22m12.84280471s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111780718 (402h22m12.843048339s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.112027152 (402h22m12.843294772s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.115011826 (402h22m12.846279457s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.186959611 (402h22m12.918227241s) [upload=418307]: Next returned nil segment
Aug 25 11:48:32.186970101 (402h22m12.918237721s) [upload=418307]: Waiting for error group managing segments...
Aug 25 11:48:32.196294261 (402h22m12.92756188s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.196620114 (402h22m12.927887744s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.198090630 (402h22m12.92935826s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.200444698 (402h22m12.931712318s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201437114 (402h22m12.932704734s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201824963 (402h22m12.933092594s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201885919 (402h22m12.933153539s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.202787154 (402h22m12.934054774s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.203257398 (402h22m12.934525018s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.205635481 (402h22m12.936903111s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.216972497 (402h22m12.948240127s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.221689199 (402h22m12.952956819s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.287006793 (402h22m13.018274413s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301972835 (402h22m13.033240455s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301999755 (402h22m13.033267385s) [seg_pos={0 0}, upload=418307]: Segment reached optimal threshold of 14 pieces.
Aug 25 11:48:32.304713500 (402h22m13.03598112s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection
Aug 25 11:48:32.304759626 (402h22m13.036027237s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: read tcp 5.161.89.252:35532->79.127.205.234:4612: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304772340 (402h22m13.03603996s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ttjngUh34tGJpCBgVCLfqrWwsdmd88XKWPrmaJrgkMu8htkKM): protocol: read tcp 5.161.89.252:27394->104.36.82.53:4123: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304797058 (402h22m13.036064678s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k72iHWdcnM2JKs7VPTQFQwmpQ835HmAP8KpXxjMbEy5QxfzG): protocol: read tcp 5.161.89.252:64712->79.127.205.246:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304804441 (402h22m13.036072062s) [seg_pos={0 0}, upload=418307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 11:48:32.304853163 (402h22m13.036120783s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 11:48:32.304856800 (402h22m13.03612442s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 11:48:32.566310632 (402h22m13.297578281s) [upload=418307]: Done uploading segments...
Aug 25 11:48:32.566362549 (402h22m13.297630209s) [upload=418307]: Upload finished. err: <nil>
Duration: 335.581708ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X...............................................X..........] duration:
1.404674427s
FAIL (2025-08-25 11:55:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 25 11:48:32.075903723 (402h22m12.807171372s) [upload=418307]: Starting upload
Aug 25 11:48:32.076015072 (402h22m12.807282732s) [upload=418307]: Done starting upload
Aug 25 11:48:32.076133023 (402h22m12.807400643s) [upload=418307]: Uploading segments...
Aug 25 11:48:32.076440052 (402h22m12.807707701s) [upload=418307]: Got next segment. Inline: false
Aug 25 11:48:32.076513229 (402h22m12.807780878s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 11:48:32.076525973 (402h22m12.807793622s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 11:48:32.108446176 (402h22m12.839713806s) [seg_pos={0 0}, upload=418307]: Begin upload segment...
Aug 25 11:48:32.108482945 (402h22m12.839750575s) [seg_pos={0 0}, upload=418307]: Done begin upload segment.
Aug 25 11:48:32.108500348 (402h22m12.839768008s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108514855 (402h22m12.839782475s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108846489 (402h22m12.840114119s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108855345 (402h22m12.840122975s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109086280 (402h22m12.84035391s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109360335 (402h22m12.840627966s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109598955 (402h22m12.840866585s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109837814 (402h22m12.841105444s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110052007 (402h22m12.841319637s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110283732 (402h22m12.841551352s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110551747 (402h22m12.841819377s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110806295 (402h22m12.842073945s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111061075 (402h22m12.842328705s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111323137 (402h22m12.842590767s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111537080 (402h22m12.84280471s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111780718 (402h22m12.843048339s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.112027152 (402h22m12.843294772s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.115011826 (402h22m12.846279457s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.186959611 (402h22m12.918227241s) [upload=418307]: Next returned nil segment
Aug 25 11:48:32.186970101 (402h22m12.918237721s) [upload=418307]: Waiting for error group managing segments...
Aug 25 11:48:32.196294261 (402h22m12.92756188s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.196620114 (402h22m12.927887744s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.198090630 (402h22m12.92935826s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.200444698 (402h22m12.931712318s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201437114 (402h22m12.932704734s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201824963 (402h22m12.933092594s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201885919 (402h22m12.933153539s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.202787154 (402h22m12.934054774s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.203257398 (402h22m12.934525018s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.205635481 (402h22m12.936903111s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.216972497 (402h22m12.948240127s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.221689199 (402h22m12.952956819s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.287006793 (402h22m13.018274413s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301972835 (402h22m13.033240455s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301999755 (402h22m13.033267385s) [seg_pos={0 0}, upload=418307]: Segment reached optimal threshold of 14 pieces.
Aug 25 11:48:32.304713500 (402h22m13.03598112s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection
Aug 25 11:48:32.304759626 (402h22m13.036027237s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: read tcp 5.161.89.252:35532->79.127.205.234:4612: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304772340 (402h22m13.03603996s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ttjngUh34tGJpCBgVCLfqrWwsdmd88XKWPrmaJrgkMu8htkKM): protocol: read tcp 5.161.89.252:27394->104.36.82.53:4123: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304797058 (402h22m13.036064678s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k72iHWdcnM2JKs7VPTQFQwmpQ835HmAP8KpXxjMbEy5QxfzG): protocol: read tcp 5.161.89.252:64712->79.127.205.246:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304804441 (402h22m13.036072062s) [seg_pos={0 0}, upload=418307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 11:48:32.304853163 (402h22m13.036120783s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 11:48:32.304856800 (402h22m13.03612442s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 11:48:32.566310632 (402h22m13.297578281s) [upload=418307]: Done uploading segments...
Aug 25 11:48:32.566362549 (402h22m13.297630209s) [upload=418307]: Upload finished. err: <nil>
Duration: 1.404698121s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X...............................................X.........] duration:
383.059092ms
FAIL (2025-08-25 11:55:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 25 11:48:32.075903723 (402h22m12.807171372s) [upload=418307]: Starting upload
Aug 25 11:48:32.076015072 (402h22m12.807282732s) [upload=418307]: Done starting upload
Aug 25 11:48:32.076133023 (402h22m12.807400643s) [upload=418307]: Uploading segments...
Aug 25 11:48:32.076440052 (402h22m12.807707701s) [upload=418307]: Got next segment. Inline: false
Aug 25 11:48:32.076513229 (402h22m12.807780878s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 11:48:32.076525973 (402h22m12.807793622s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 11:48:32.108446176 (402h22m12.839713806s) [seg_pos={0 0}, upload=418307]: Begin upload segment...
Aug 25 11:48:32.108482945 (402h22m12.839750575s) [seg_pos={0 0}, upload=418307]: Done begin upload segment.
Aug 25 11:48:32.108500348 (402h22m12.839768008s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108514855 (402h22m12.839782475s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108846489 (402h22m12.840114119s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108855345 (402h22m12.840122975s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109086280 (402h22m12.84035391s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109360335 (402h22m12.840627966s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109598955 (402h22m12.840866585s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109837814 (402h22m12.841105444s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110052007 (402h22m12.841319637s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110283732 (402h22m12.841551352s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110551747 (402h22m12.841819377s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110806295 (402h22m12.842073945s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111061075 (402h22m12.842328705s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111323137 (402h22m12.842590767s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111537080 (402h22m12.84280471s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111780718 (402h22m12.843048339s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.112027152 (402h22m12.843294772s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.115011826 (402h22m12.846279457s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.186959611 (402h22m12.918227241s) [upload=418307]: Next returned nil segment
Aug 25 11:48:32.186970101 (402h22m12.918237721s) [upload=418307]: Waiting for error group managing segments...
Aug 25 11:48:32.196294261 (402h22m12.92756188s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.196620114 (402h22m12.927887744s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.198090630 (402h22m12.92935826s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.200444698 (402h22m12.931712318s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201437114 (402h22m12.932704734s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201824963 (402h22m12.933092594s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201885919 (402h22m12.933153539s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.202787154 (402h22m12.934054774s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.203257398 (402h22m12.934525018s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.205635481 (402h22m12.936903111s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.216972497 (402h22m12.948240127s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.221689199 (402h22m12.952956819s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.287006793 (402h22m13.018274413s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301972835 (402h22m13.033240455s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301999755 (402h22m13.033267385s) [seg_pos={0 0}, upload=418307]: Segment reached optimal threshold of 14 pieces.
Aug 25 11:48:32.304713500 (402h22m13.03598112s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection
Aug 25 11:48:32.304759626 (402h22m13.036027237s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: read tcp 5.161.89.252:35532->79.127.205.234:4612: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304772340 (402h22m13.03603996s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ttjngUh34tGJpCBgVCLfqrWwsdmd88XKWPrmaJrgkMu8htkKM): protocol: read tcp 5.161.89.252:27394->104.36.82.53:4123: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304797058 (402h22m13.036064678s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k72iHWdcnM2JKs7VPTQFQwmpQ835HmAP8KpXxjMbEy5QxfzG): protocol: read tcp 5.161.89.252:64712->79.127.205.246:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304804441 (402h22m13.036072062s) [seg_pos={0 0}, upload=418307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 11:48:32.304853163 (402h22m13.036120783s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 11:48:32.304856800 (402h22m13.03612442s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 11:48:32.566310632 (402h22m13.297578281s) [upload=418307]: Done uploading segments...
Aug 25 11:48:32.566362549 (402h22m13.297630209s) [upload=418307]: Upload finished. err: <nil>
Duration: 383.084228ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X...............................................X........] duration:
2.540803857s
FAIL (2025-08-25 11:54:59 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 25 11:48:32.075903723 (402h22m12.807171372s) [upload=418307]: Starting upload
Aug 25 11:48:32.076015072 (402h22m12.807282732s) [upload=418307]: Done starting upload
Aug 25 11:48:32.076133023 (402h22m12.807400643s) [upload=418307]: Uploading segments...
Aug 25 11:48:32.076440052 (402h22m12.807707701s) [upload=418307]: Got next segment. Inline: false
Aug 25 11:48:32.076513229 (402h22m12.807780878s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 11:48:32.076525973 (402h22m12.807793622s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 11:48:32.108446176 (402h22m12.839713806s) [seg_pos={0 0}, upload=418307]: Begin upload segment...
Aug 25 11:48:32.108482945 (402h22m12.839750575s) [seg_pos={0 0}, upload=418307]: Done begin upload segment.
Aug 25 11:48:32.108500348 (402h22m12.839768008s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108514855 (402h22m12.839782475s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108846489 (402h22m12.840114119s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108855345 (402h22m12.840122975s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109086280 (402h22m12.84035391s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109360335 (402h22m12.840627966s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109598955 (402h22m12.840866585s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109837814 (402h22m12.841105444s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110052007 (402h22m12.841319637s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110283732 (402h22m12.841551352s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110551747 (402h22m12.841819377s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110806295 (402h22m12.842073945s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111061075 (402h22m12.842328705s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111323137 (402h22m12.842590767s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111537080 (402h22m12.84280471s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111780718 (402h22m12.843048339s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.112027152 (402h22m12.843294772s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.115011826 (402h22m12.846279457s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.186959611 (402h22m12.918227241s) [upload=418307]: Next returned nil segment
Aug 25 11:48:32.186970101 (402h22m12.918237721s) [upload=418307]: Waiting for error group managing segments...
Aug 25 11:48:32.196294261 (402h22m12.92756188s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.196620114 (402h22m12.927887744s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.198090630 (402h22m12.92935826s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.200444698 (402h22m12.931712318s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201437114 (402h22m12.932704734s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201824963 (402h22m12.933092594s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201885919 (402h22m12.933153539s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.202787154 (402h22m12.934054774s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.203257398 (402h22m12.934525018s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.205635481 (402h22m12.936903111s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.216972497 (402h22m12.948240127s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.221689199 (402h22m12.952956819s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.287006793 (402h22m13.018274413s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301972835 (402h22m13.033240455s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301999755 (402h22m13.033267385s) [seg_pos={0 0}, upload=418307]: Segment reached optimal threshold of 14 pieces.
Aug 25 11:48:32.304713500 (402h22m13.03598112s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection
Aug 25 11:48:32.304759626 (402h22m13.036027237s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: read tcp 5.161.89.252:35532->79.127.205.234:4612: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304772340 (402h22m13.03603996s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ttjngUh34tGJpCBgVCLfqrWwsdmd88XKWPrmaJrgkMu8htkKM): protocol: read tcp 5.161.89.252:27394->104.36.82.53:4123: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304797058 (402h22m13.036064678s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k72iHWdcnM2JKs7VPTQFQwmpQ835HmAP8KpXxjMbEy5QxfzG): protocol: read tcp 5.161.89.252:64712->79.127.205.246:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304804441 (402h22m13.036072062s) [seg_pos={0 0}, upload=418307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 11:48:32.304853163 (402h22m13.036120783s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 11:48:32.304856800 (402h22m13.03612442s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 11:48:32.566310632 (402h22m13.297578281s) [upload=418307]: Done uploading segments...
Aug 25 11:48:32.566362549 (402h22m13.297630209s) [upload=418307]: Upload finished. err: <nil>
Duration: 2.540830899s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
161.457351ms
FAIL (2025-08-25 11:54:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 161.476507ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X...............................................X.......] duration:
1.899379981s
FAIL (2025-08-25 11:54:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 25 11:48:32.075903723 (402h22m12.807171372s) [upload=418307]: Starting upload
Aug 25 11:48:32.076015072 (402h22m12.807282732s) [upload=418307]: Done starting upload
Aug 25 11:48:32.076133023 (402h22m12.807400643s) [upload=418307]: Uploading segments...
Aug 25 11:48:32.076440052 (402h22m12.807707701s) [upload=418307]: Got next segment. Inline: false
Aug 25 11:48:32.076513229 (402h22m12.807780878s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 11:48:32.076525973 (402h22m12.807793622s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 11:48:32.108446176 (402h22m12.839713806s) [seg_pos={0 0}, upload=418307]: Begin upload segment...
Aug 25 11:48:32.108482945 (402h22m12.839750575s) [seg_pos={0 0}, upload=418307]: Done begin upload segment.
Aug 25 11:48:32.108500348 (402h22m12.839768008s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108514855 (402h22m12.839782475s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108846489 (402h22m12.840114119s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108855345 (402h22m12.840122975s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109086280 (402h22m12.84035391s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109360335 (402h22m12.840627966s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109598955 (402h22m12.840866585s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109837814 (402h22m12.841105444s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110052007 (402h22m12.841319637s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110283732 (402h22m12.841551352s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110551747 (402h22m12.841819377s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110806295 (402h22m12.842073945s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111061075 (402h22m12.842328705s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111323137 (402h22m12.842590767s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111537080 (402h22m12.84280471s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111780718 (402h22m12.843048339s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.112027152 (402h22m12.843294772s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.115011826 (402h22m12.846279457s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.186959611 (402h22m12.918227241s) [upload=418307]: Next returned nil segment
Aug 25 11:48:32.186970101 (402h22m12.918237721s) [upload=418307]: Waiting for error group managing segments...
Aug 25 11:48:32.196294261 (402h22m12.92756188s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.196620114 (402h22m12.927887744s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.198090630 (402h22m12.92935826s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.200444698 (402h22m12.931712318s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201437114 (402h22m12.932704734s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201824963 (402h22m12.933092594s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201885919 (402h22m12.933153539s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.202787154 (402h22m12.934054774s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.203257398 (402h22m12.934525018s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.205635481 (402h22m12.936903111s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.216972497 (402h22m12.948240127s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.221689199 (402h22m12.952956819s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.287006793 (402h22m13.018274413s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301972835 (402h22m13.033240455s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301999755 (402h22m13.033267385s) [seg_pos={0 0}, upload=418307]: Segment reached optimal threshold of 14 pieces.
Aug 25 11:48:32.304713500 (402h22m13.03598112s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection
Aug 25 11:48:32.304759626 (402h22m13.036027237s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: read tcp 5.161.89.252:35532->79.127.205.234:4612: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304772340 (402h22m13.03603996s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ttjngUh34tGJpCBgVCLfqrWwsdmd88XKWPrmaJrgkMu8htkKM): protocol: read tcp 5.161.89.252:27394->104.36.82.53:4123: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304797058 (402h22m13.036064678s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k72iHWdcnM2JKs7VPTQFQwmpQ835HmAP8KpXxjMbEy5QxfzG): protocol: read tcp 5.161.89.252:64712->79.127.205.246:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304804441 (402h22m13.036072062s) [seg_pos={0 0}, upload=418307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 11:48:32.304853163 (402h22m13.036120783s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 11:48:32.304856800 (402h22m13.03612442s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 11:48:32.566310632 (402h22m13.297578281s) [upload=418307]: Done uploading segments...
Aug 25 11:48:32.566362549 (402h22m13.297630209s) [upload=418307]: Upload finished. err: <nil>
Duration: 1.899425095s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
134.541874ms
FAIL (2025-08-25 11:54:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 134.570238ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X...............................................X......] duration:
1.43518004s
FAIL (2025-08-25 11:53:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 25 11:48:32.075903723 (402h22m12.807171372s) [upload=418307]: Starting upload
Aug 25 11:48:32.076015072 (402h22m12.807282732s) [upload=418307]: Done starting upload
Aug 25 11:48:32.076133023 (402h22m12.807400643s) [upload=418307]: Uploading segments...
Aug 25 11:48:32.076440052 (402h22m12.807707701s) [upload=418307]: Got next segment. Inline: false
Aug 25 11:48:32.076513229 (402h22m12.807780878s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 11:48:32.076525973 (402h22m12.807793622s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 11:48:32.108446176 (402h22m12.839713806s) [seg_pos={0 0}, upload=418307]: Begin upload segment...
Aug 25 11:48:32.108482945 (402h22m12.839750575s) [seg_pos={0 0}, upload=418307]: Done begin upload segment.
Aug 25 11:48:32.108500348 (402h22m12.839768008s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108514855 (402h22m12.839782475s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108846489 (402h22m12.840114119s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108855345 (402h22m12.840122975s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109086280 (402h22m12.84035391s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109360335 (402h22m12.840627966s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109598955 (402h22m12.840866585s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109837814 (402h22m12.841105444s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110052007 (402h22m12.841319637s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110283732 (402h22m12.841551352s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110551747 (402h22m12.841819377s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110806295 (402h22m12.842073945s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111061075 (402h22m12.842328705s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111323137 (402h22m12.842590767s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111537080 (402h22m12.84280471s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111780718 (402h22m12.843048339s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.112027152 (402h22m12.843294772s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.115011826 (402h22m12.846279457s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.186959611 (402h22m12.918227241s) [upload=418307]: Next returned nil segment
Aug 25 11:48:32.186970101 (402h22m12.918237721s) [upload=418307]: Waiting for error group managing segments...
Aug 25 11:48:32.196294261 (402h22m12.92756188s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.196620114 (402h22m12.927887744s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.198090630 (402h22m12.92935826s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.200444698 (402h22m12.931712318s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201437114 (402h22m12.932704734s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201824963 (402h22m12.933092594s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201885919 (402h22m12.933153539s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.202787154 (402h22m12.934054774s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.203257398 (402h22m12.934525018s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.205635481 (402h22m12.936903111s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.216972497 (402h22m12.948240127s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.221689199 (402h22m12.952956819s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.287006793 (402h22m13.018274413s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301972835 (402h22m13.033240455s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301999755 (402h22m13.033267385s) [seg_pos={0 0}, upload=418307]: Segment reached optimal threshold of 14 pieces.
Aug 25 11:48:32.304713500 (402h22m13.03598112s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection
Aug 25 11:48:32.304759626 (402h22m13.036027237s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: read tcp 5.161.89.252:35532->79.127.205.234:4612: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304772340 (402h22m13.03603996s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ttjngUh34tGJpCBgVCLfqrWwsdmd88XKWPrmaJrgkMu8htkKM): protocol: read tcp 5.161.89.252:27394->104.36.82.53:4123: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304797058 (402h22m13.036064678s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k72iHWdcnM2JKs7VPTQFQwmpQ835HmAP8KpXxjMbEy5QxfzG): protocol: read tcp 5.161.89.252:64712->79.127.205.246:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304804441 (402h22m13.036072062s) [seg_pos={0 0}, upload=418307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 11:48:32.304853163 (402h22m13.036120783s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 11:48:32.304856800 (402h22m13.03612442s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 11:48:32.566310632 (402h22m13.297578281s) [upload=418307]: Done uploading segments...
Aug 25 11:48:32.566362549 (402h22m13.297630209s) [upload=418307]: Upload finished. err: <nil>
Duration: 1.435197783s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
352.50555ms
FAIL (2025-08-25 11:53:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 352.530978ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X..X........................................................] duration:
292.808063ms
FAIL (2025-08-25 11:52:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 292.83241ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X...............................................X.....] duration:
1.33909586s
FAIL (2025-08-25 11:52:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 25 11:48:32.075903723 (402h22m12.807171372s) [upload=418307]: Starting upload
Aug 25 11:48:32.076015072 (402h22m12.807282732s) [upload=418307]: Done starting upload
Aug 25 11:48:32.076133023 (402h22m12.807400643s) [upload=418307]: Uploading segments...
Aug 25 11:48:32.076440052 (402h22m12.807707701s) [upload=418307]: Got next segment. Inline: false
Aug 25 11:48:32.076513229 (402h22m12.807780878s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 11:48:32.076525973 (402h22m12.807793622s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 11:48:32.108446176 (402h22m12.839713806s) [seg_pos={0 0}, upload=418307]: Begin upload segment...
Aug 25 11:48:32.108482945 (402h22m12.839750575s) [seg_pos={0 0}, upload=418307]: Done begin upload segment.
Aug 25 11:48:32.108500348 (402h22m12.839768008s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108514855 (402h22m12.839782475s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108846489 (402h22m12.840114119s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108855345 (402h22m12.840122975s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109086280 (402h22m12.84035391s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109360335 (402h22m12.840627966s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109598955 (402h22m12.840866585s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109837814 (402h22m12.841105444s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110052007 (402h22m12.841319637s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110283732 (402h22m12.841551352s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110551747 (402h22m12.841819377s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110806295 (402h22m12.842073945s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111061075 (402h22m12.842328705s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111323137 (402h22m12.842590767s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111537080 (402h22m12.84280471s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111780718 (402h22m12.843048339s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.112027152 (402h22m12.843294772s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.115011826 (402h22m12.846279457s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.186959611 (402h22m12.918227241s) [upload=418307]: Next returned nil segment
Aug 25 11:48:32.186970101 (402h22m12.918237721s) [upload=418307]: Waiting for error group managing segments...
Aug 25 11:48:32.196294261 (402h22m12.92756188s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.196620114 (402h22m12.927887744s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.198090630 (402h22m12.92935826s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.200444698 (402h22m12.931712318s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201437114 (402h22m12.932704734s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201824963 (402h22m12.933092594s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201885919 (402h22m12.933153539s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.202787154 (402h22m12.934054774s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.203257398 (402h22m12.934525018s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.205635481 (402h22m12.936903111s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.216972497 (402h22m12.948240127s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.221689199 (402h22m12.952956819s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.287006793 (402h22m13.018274413s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301972835 (402h22m13.033240455s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301999755 (402h22m13.033267385s) [seg_pos={0 0}, upload=418307]: Segment reached optimal threshold of 14 pieces.
Aug 25 11:48:32.304713500 (402h22m13.03598112s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection
Aug 25 11:48:32.304759626 (402h22m13.036027237s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: read tcp 5.161.89.252:35532->79.127.205.234:4612: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304772340 (402h22m13.03603996s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ttjngUh34tGJpCBgVCLfqrWwsdmd88XKWPrmaJrgkMu8htkKM): protocol: read tcp 5.161.89.252:27394->104.36.82.53:4123: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304797058 (402h22m13.036064678s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k72iHWdcnM2JKs7VPTQFQwmpQ835HmAP8KpXxjMbEy5QxfzG): protocol: read tcp 5.161.89.252:64712->79.127.205.246:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304804441 (402h22m13.036072062s) [seg_pos={0 0}, upload=418307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 11:48:32.304853163 (402h22m13.036120783s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 11:48:32.304856800 (402h22m13.03612442s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 11:48:32.566310632 (402h22m13.297578281s) [upload=418307]: Done uploading segments...
Aug 25 11:48:32.566362549 (402h22m13.297630209s) [upload=418307]: Upload finished. err: <nil>
Duration: 1.33912266s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X..X.......................................................] duration:
212.956448ms
FAIL (2025-08-25 11:51:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 212.978468ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X...............................................X....] duration:
2.3175591s
FAIL (2025-08-25 11:51:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 25 11:48:32.075903723 (402h22m12.807171372s) [upload=418307]: Starting upload
Aug 25 11:48:32.076015072 (402h22m12.807282732s) [upload=418307]: Done starting upload
Aug 25 11:48:32.076133023 (402h22m12.807400643s) [upload=418307]: Uploading segments...
Aug 25 11:48:32.076440052 (402h22m12.807707701s) [upload=418307]: Got next segment. Inline: false
Aug 25 11:48:32.076513229 (402h22m12.807780878s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 11:48:32.076525973 (402h22m12.807793622s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 11:48:32.108446176 (402h22m12.839713806s) [seg_pos={0 0}, upload=418307]: Begin upload segment...
Aug 25 11:48:32.108482945 (402h22m12.839750575s) [seg_pos={0 0}, upload=418307]: Done begin upload segment.
Aug 25 11:48:32.108500348 (402h22m12.839768008s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108514855 (402h22m12.839782475s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108846489 (402h22m12.840114119s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108855345 (402h22m12.840122975s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109086280 (402h22m12.84035391s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109360335 (402h22m12.840627966s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109598955 (402h22m12.840866585s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109837814 (402h22m12.841105444s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110052007 (402h22m12.841319637s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110283732 (402h22m12.841551352s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110551747 (402h22m12.841819377s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110806295 (402h22m12.842073945s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111061075 (402h22m12.842328705s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111323137 (402h22m12.842590767s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111537080 (402h22m12.84280471s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111780718 (402h22m12.843048339s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.112027152 (402h22m12.843294772s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.115011826 (402h22m12.846279457s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.186959611 (402h22m12.918227241s) [upload=418307]: Next returned nil segment
Aug 25 11:48:32.186970101 (402h22m12.918237721s) [upload=418307]: Waiting for error group managing segments...
Aug 25 11:48:32.196294261 (402h22m12.92756188s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.196620114 (402h22m12.927887744s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.198090630 (402h22m12.92935826s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.200444698 (402h22m12.931712318s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201437114 (402h22m12.932704734s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201824963 (402h22m12.933092594s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201885919 (402h22m12.933153539s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.202787154 (402h22m12.934054774s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.203257398 (402h22m12.934525018s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.205635481 (402h22m12.936903111s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.216972497 (402h22m12.948240127s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.221689199 (402h22m12.952956819s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.287006793 (402h22m13.018274413s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301972835 (402h22m13.033240455s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301999755 (402h22m13.033267385s) [seg_pos={0 0}, upload=418307]: Segment reached optimal threshold of 14 pieces.
Aug 25 11:48:32.304713500 (402h22m13.03598112s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection
Aug 25 11:48:32.304759626 (402h22m13.036027237s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: read tcp 5.161.89.252:35532->79.127.205.234:4612: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304772340 (402h22m13.03603996s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ttjngUh34tGJpCBgVCLfqrWwsdmd88XKWPrmaJrgkMu8htkKM): protocol: read tcp 5.161.89.252:27394->104.36.82.53:4123: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304797058 (402h22m13.036064678s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k72iHWdcnM2JKs7VPTQFQwmpQ835HmAP8KpXxjMbEy5QxfzG): protocol: read tcp 5.161.89.252:64712->79.127.205.246:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304804441 (402h22m13.036072062s) [seg_pos={0 0}, upload=418307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 11:48:32.304853163 (402h22m13.036120783s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 11:48:32.304856800 (402h22m13.03612442s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 11:48:32.566310632 (402h22m13.297578281s) [upload=418307]: Done uploading segments...
Aug 25 11:48:32.566362549 (402h22m13.297630209s) [upload=418307]: Upload finished. err: <nil>
Duration: 2.317593805s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X..X......................................................] duration:
350.653856ms
FAIL (2025-08-25 11:50:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 350.694984ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.......X...............................................X...] duration:
1.644775239s
FAIL (2025-08-25 11:50:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 25 11:48:32.075903723 (402h22m12.807171372s) [upload=418307]: Starting upload
Aug 25 11:48:32.076015072 (402h22m12.807282732s) [upload=418307]: Done starting upload
Aug 25 11:48:32.076133023 (402h22m12.807400643s) [upload=418307]: Uploading segments...
Aug 25 11:48:32.076440052 (402h22m12.807707701s) [upload=418307]: Got next segment. Inline: false
Aug 25 11:48:32.076513229 (402h22m12.807780878s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 11:48:32.076525973 (402h22m12.807793622s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 11:48:32.108446176 (402h22m12.839713806s) [seg_pos={0 0}, upload=418307]: Begin upload segment...
Aug 25 11:48:32.108482945 (402h22m12.839750575s) [seg_pos={0 0}, upload=418307]: Done begin upload segment.
Aug 25 11:48:32.108500348 (402h22m12.839768008s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108514855 (402h22m12.839782475s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108846489 (402h22m12.840114119s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108855345 (402h22m12.840122975s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109086280 (402h22m12.84035391s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109360335 (402h22m12.840627966s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109598955 (402h22m12.840866585s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109837814 (402h22m12.841105444s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110052007 (402h22m12.841319637s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110283732 (402h22m12.841551352s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110551747 (402h22m12.841819377s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110806295 (402h22m12.842073945s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111061075 (402h22m12.842328705s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111323137 (402h22m12.842590767s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111537080 (402h22m12.84280471s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111780718 (402h22m12.843048339s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.112027152 (402h22m12.843294772s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.115011826 (402h22m12.846279457s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.186959611 (402h22m12.918227241s) [upload=418307]: Next returned nil segment
Aug 25 11:48:32.186970101 (402h22m12.918237721s) [upload=418307]: Waiting for error group managing segments...
Aug 25 11:48:32.196294261 (402h22m12.92756188s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.196620114 (402h22m12.927887744s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.198090630 (402h22m12.92935826s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.200444698 (402h22m12.931712318s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201437114 (402h22m12.932704734s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201824963 (402h22m12.933092594s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201885919 (402h22m12.933153539s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.202787154 (402h22m12.934054774s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.203257398 (402h22m12.934525018s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.205635481 (402h22m12.936903111s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.216972497 (402h22m12.948240127s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.221689199 (402h22m12.952956819s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.287006793 (402h22m13.018274413s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301972835 (402h22m13.033240455s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301999755 (402h22m13.033267385s) [seg_pos={0 0}, upload=418307]: Segment reached optimal threshold of 14 pieces.
Aug 25 11:48:32.304713500 (402h22m13.03598112s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection
Aug 25 11:48:32.304759626 (402h22m13.036027237s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: read tcp 5.161.89.252:35532->79.127.205.234:4612: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304772340 (402h22m13.03603996s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ttjngUh34tGJpCBgVCLfqrWwsdmd88XKWPrmaJrgkMu8htkKM): protocol: read tcp 5.161.89.252:27394->104.36.82.53:4123: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304797058 (402h22m13.036064678s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k72iHWdcnM2JKs7VPTQFQwmpQ835HmAP8KpXxjMbEy5QxfzG): protocol: read tcp 5.161.89.252:64712->79.127.205.246:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304804441 (402h22m13.036072062s) [seg_pos={0 0}, upload=418307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 11:48:32.304853163 (402h22m13.036120783s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 11:48:32.304856800 (402h22m13.03612442s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 11:48:32.566310632 (402h22m13.297578281s) [upload=418307]: Done uploading segments...
Aug 25 11:48:32.566362549 (402h22m13.297630209s) [upload=418307]: Upload finished. err: <nil>
Duration: 1.64480237s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.......X...............................................X..] duration:
1.153034493s
FAIL (2025-08-25 11:50:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 25 11:48:32.075903723 (402h22m12.807171372s) [upload=418307]: Starting upload
Aug 25 11:48:32.076015072 (402h22m12.807282732s) [upload=418307]: Done starting upload
Aug 25 11:48:32.076133023 (402h22m12.807400643s) [upload=418307]: Uploading segments...
Aug 25 11:48:32.076440052 (402h22m12.807707701s) [upload=418307]: Got next segment. Inline: false
Aug 25 11:48:32.076513229 (402h22m12.807780878s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 11:48:32.076525973 (402h22m12.807793622s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 11:48:32.108446176 (402h22m12.839713806s) [seg_pos={0 0}, upload=418307]: Begin upload segment...
Aug 25 11:48:32.108482945 (402h22m12.839750575s) [seg_pos={0 0}, upload=418307]: Done begin upload segment.
Aug 25 11:48:32.108500348 (402h22m12.839768008s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108514855 (402h22m12.839782475s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108846489 (402h22m12.840114119s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108855345 (402h22m12.840122975s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109086280 (402h22m12.84035391s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109360335 (402h22m12.840627966s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109598955 (402h22m12.840866585s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109837814 (402h22m12.841105444s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110052007 (402h22m12.841319637s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110283732 (402h22m12.841551352s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110551747 (402h22m12.841819377s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110806295 (402h22m12.842073945s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111061075 (402h22m12.842328705s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111323137 (402h22m12.842590767s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111537080 (402h22m12.84280471s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111780718 (402h22m12.843048339s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.112027152 (402h22m12.843294772s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.115011826 (402h22m12.846279457s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.186959611 (402h22m12.918227241s) [upload=418307]: Next returned nil segment
Aug 25 11:48:32.186970101 (402h22m12.918237721s) [upload=418307]: Waiting for error group managing segments...
Aug 25 11:48:32.196294261 (402h22m12.92756188s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.196620114 (402h22m12.927887744s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.198090630 (402h22m12.92935826s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.200444698 (402h22m12.931712318s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201437114 (402h22m12.932704734s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201824963 (402h22m12.933092594s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201885919 (402h22m12.933153539s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.202787154 (402h22m12.934054774s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.203257398 (402h22m12.934525018s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.205635481 (402h22m12.936903111s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.216972497 (402h22m12.948240127s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.221689199 (402h22m12.952956819s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.287006793 (402h22m13.018274413s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301972835 (402h22m13.033240455s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301999755 (402h22m13.033267385s) [seg_pos={0 0}, upload=418307]: Segment reached optimal threshold of 14 pieces.
Aug 25 11:48:32.304713500 (402h22m13.03598112s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection
Aug 25 11:48:32.304759626 (402h22m13.036027237s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: read tcp 5.161.89.252:35532->79.127.205.234:4612: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304772340 (402h22m13.03603996s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ttjngUh34tGJpCBgVCLfqrWwsdmd88XKWPrmaJrgkMu8htkKM): protocol: read tcp 5.161.89.252:27394->104.36.82.53:4123: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304797058 (402h22m13.036064678s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k72iHWdcnM2JKs7VPTQFQwmpQ835HmAP8KpXxjMbEy5QxfzG): protocol: read tcp 5.161.89.252:64712->79.127.205.246:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304804441 (402h22m13.036072062s) [seg_pos={0 0}, upload=418307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 11:48:32.304853163 (402h22m13.036120783s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 11:48:32.304856800 (402h22m13.03612442s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 11:48:32.566310632 (402h22m13.297578281s) [upload=418307]: Done uploading segments...
Aug 25 11:48:32.566362549 (402h22m13.297630209s) [upload=418307]: Upload finished. err: <nil>
Duration: 1.153083946s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X..X.....................................................] duration:
486.666928ms
FAIL (2025-08-25 11:50:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 486.68901ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.......X...............................................X.] duration:
1.955829055s
FAIL (2025-08-25 11:49:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 25 11:48:32.075903723 (402h22m12.807171372s) [upload=418307]: Starting upload
Aug 25 11:48:32.076015072 (402h22m12.807282732s) [upload=418307]: Done starting upload
Aug 25 11:48:32.076133023 (402h22m12.807400643s) [upload=418307]: Uploading segments...
Aug 25 11:48:32.076440052 (402h22m12.807707701s) [upload=418307]: Got next segment. Inline: false
Aug 25 11:48:32.076513229 (402h22m12.807780878s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 11:48:32.076525973 (402h22m12.807793622s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 11:48:32.108446176 (402h22m12.839713806s) [seg_pos={0 0}, upload=418307]: Begin upload segment...
Aug 25 11:48:32.108482945 (402h22m12.839750575s) [seg_pos={0 0}, upload=418307]: Done begin upload segment.
Aug 25 11:48:32.108500348 (402h22m12.839768008s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108514855 (402h22m12.839782475s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108846489 (402h22m12.840114119s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108855345 (402h22m12.840122975s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109086280 (402h22m12.84035391s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109360335 (402h22m12.840627966s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109598955 (402h22m12.840866585s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109837814 (402h22m12.841105444s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110052007 (402h22m12.841319637s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110283732 (402h22m12.841551352s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110551747 (402h22m12.841819377s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110806295 (402h22m12.842073945s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111061075 (402h22m12.842328705s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111323137 (402h22m12.842590767s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111537080 (402h22m12.84280471s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111780718 (402h22m12.843048339s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.112027152 (402h22m12.843294772s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.115011826 (402h22m12.846279457s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.186959611 (402h22m12.918227241s) [upload=418307]: Next returned nil segment
Aug 25 11:48:32.186970101 (402h22m12.918237721s) [upload=418307]: Waiting for error group managing segments...
Aug 25 11:48:32.196294261 (402h22m12.92756188s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.196620114 (402h22m12.927887744s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.198090630 (402h22m12.92935826s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.200444698 (402h22m12.931712318s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201437114 (402h22m12.932704734s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201824963 (402h22m12.933092594s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201885919 (402h22m12.933153539s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.202787154 (402h22m12.934054774s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.203257398 (402h22m12.934525018s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.205635481 (402h22m12.936903111s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.216972497 (402h22m12.948240127s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.221689199 (402h22m12.952956819s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.287006793 (402h22m13.018274413s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301972835 (402h22m13.033240455s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301999755 (402h22m13.033267385s) [seg_pos={0 0}, upload=418307]: Segment reached optimal threshold of 14 pieces.
Aug 25 11:48:32.304713500 (402h22m13.03598112s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection
Aug 25 11:48:32.304759626 (402h22m13.036027237s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: read tcp 5.161.89.252:35532->79.127.205.234:4612: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304772340 (402h22m13.03603996s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ttjngUh34tGJpCBgVCLfqrWwsdmd88XKWPrmaJrgkMu8htkKM): protocol: read tcp 5.161.89.252:27394->104.36.82.53:4123: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304797058 (402h22m13.036064678s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k72iHWdcnM2JKs7VPTQFQwmpQ835HmAP8KpXxjMbEy5QxfzG): protocol: read tcp 5.161.89.252:64712->79.127.205.246:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304804441 (402h22m13.036072062s) [seg_pos={0 0}, upload=418307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 11:48:32.304853163 (402h22m13.036120783s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 11:48:32.304856800 (402h22m13.03612442s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 11:48:32.566310632 (402h22m13.297578281s) [upload=418307]: Done uploading segments...
Aug 25 11:48:32.566362549 (402h22m13.297630209s) [upload=418307]: Upload finished. err: <nil>
Duration: 1.955849964s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X..X....................................................] duration:
173.903773ms
FAIL (2025-08-25 11:49:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 173.928139ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X.......X...............................................X] duration:
618.503571ms
FAIL (2025-08-25 11:48:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 25 11:48:32.075903723 (402h22m12.807171372s) [upload=418307]: Starting upload
Aug 25 11:48:32.076015072 (402h22m12.807282732s) [upload=418307]: Done starting upload
Aug 25 11:48:32.076133023 (402h22m12.807400643s) [upload=418307]: Uploading segments...
Aug 25 11:48:32.076440052 (402h22m12.807707701s) [upload=418307]: Got next segment. Inline: false
Aug 25 11:48:32.076513229 (402h22m12.807780878s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 11:48:32.076525973 (402h22m12.807793622s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 11:48:32.108446176 (402h22m12.839713806s) [seg_pos={0 0}, upload=418307]: Begin upload segment...
Aug 25 11:48:32.108482945 (402h22m12.839750575s) [seg_pos={0 0}, upload=418307]: Done begin upload segment.
Aug 25 11:48:32.108500348 (402h22m12.839768008s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108514855 (402h22m12.839782475s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108846489 (402h22m12.840114119s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.108855345 (402h22m12.840122975s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109086280 (402h22m12.84035391s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109360335 (402h22m12.840627966s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109598955 (402h22m12.840866585s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.109837814 (402h22m12.841105444s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110052007 (402h22m12.841319637s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110283732 (402h22m12.841551352s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110551747 (402h22m12.841819377s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.110806295 (402h22m12.842073945s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111061075 (402h22m12.842328705s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111323137 (402h22m12.842590767s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111537080 (402h22m12.84280471s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.111780718 (402h22m12.843048339s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.112027152 (402h22m12.843294772s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.115011826 (402h22m12.846279457s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Uploading piece...
Aug 25 11:48:32.186959611 (402h22m12.918227241s) [upload=418307]: Next returned nil segment
Aug 25 11:48:32.186970101 (402h22m12.918237721s) [upload=418307]: Waiting for error group managing segments...
Aug 25 11:48:32.196294261 (402h22m12.92756188s) [noise=true , address=79.127.219.51:4202 , piece_id=52U27KJB6ZTWDWMEZOEHJTAUIUZPWDEHYJ37LRE4MKV7LKZNPHGA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.196620114 (402h22m12.927887744s) [noise=true , address=77.90.31.10:4546 , piece_id=4PCTEZ45RUAL4DSANRSZ2NP3THQAS32BXBR2BGKXAXREWCGPKH2Q, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.198090630 (402h22m12.92935826s) [noise=true , address=104.36.82.5:4855 , piece_id=RSSZAY4ILETO2KZ42NZZOID4WX6LNQUPYYQTJZMBQWNZEPN2RLEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.200444698 (402h22m12.931712318s) [noise=true , address=104.36.82.6:4908 , piece_id=ZNHIINQDXN4KNFWAG6KI7YPZXYZLBNB2GAH7M35DGAXNEIF5BUAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201437114 (402h22m12.932704734s) [noise=true , address=104.36.82.14:4238 , piece_id=5COZZCY6XLI2RWM3DN6GGDXZORR3YUGB4XAEY6DNSM6XBRCPYQPA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201824963 (402h22m12.933092594s) [noise=true , address=104.36.82.54:4179 , piece_id=GQE63RP67TUG7IEXJ2VGOD2CYME4GQ5LTUR4N4FPLVLKWJVAHONQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.201885919 (402h22m12.933153539s) [noise=true , address=45.91.116.4:4961 , piece_id=HAJEMTAFSNCVACZ6D4S6B2W7NDYBCHH7YG4P24W5I2YSAE3W4MLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.202787154 (402h22m12.934054774s) [noise=true , address=104.36.82.41:4776 , piece_id=FEHF2QFJRPALCBG2DYHFLD7A7GON3AMWZ5MOZYQLJPHYIHQNGCDA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.203257398 (402h22m12.934525018s) [noise=true , address=104.36.82.4:4818 , piece_id=FJGL2FZLRY3DM7RJIY7QZDPFKVGDIMHU2IFTPO7JMWHTWPUGZPMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.205635481 (402h22m12.936903111s) [noise=true , address=104.36.82.7:4939 , piece_id=IRO4JWAMC44G3ABRHPP6RAMBTGTGRVVOW6OWGK4XXV7BBSD65AEA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.216972497 (402h22m12.948240127s) [noise=true , address=104.36.82.23:4452 , piece_id=IPPYOYYXQOVZAJPFW2NLDB4RSYFEHVJ2EUMYE5OIQP65732UEISA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.221689199 (402h22m12.952956819s) [noise=true , address=104.36.82.9:4008 , piece_id=NC7TXZ4ZSPH7OIB5CTN5OX3M7PTAYVFONAIFN26DJ5L3552WQF3A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.287006793 (402h22m13.018274413s) [noise=true , address=77.90.31.18:4818 , piece_id=VHH4KYQI4OGKCB7SOPZI7QN3FRCWYWDO6YT6NB3NIZTLYSGGWSMQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301972835 (402h22m13.033240455s) [noise=true , address=104.36.82.60:4343 , piece_id=H6BKRWECXFBWNOEBCM5FEJHREYOH4LDAQUA3CQUZLB7OOTTKLNAA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: <nil>
Aug 25 11:48:32.301999755 (402h22m13.033267385s) [seg_pos={0 0}, upload=418307]: Segment reached optimal threshold of 14 pieces.
Aug 25 11:48:32.304713500 (402h22m13.03598112s) [noise=true , address=79.127.201.215:4346 , piece_id=YZN4QNLFBMUS3HBD4XIKLMOZ7YU7K34R2C2PV5P3SY2T3EKJLFLA, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:50102->79.127.201.215:4346: use of closed network connection
Aug 25 11:48:32.304759626 (402h22m13.036027237s) [noise=true , address=79.127.205.234:4612 , piece_id=DM2PAO4FMSXLP7D2AUUDCHZQTXQ2RNPVBLEYGQP73RWI4AAR5MOQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eaRHaH3C7fnNUtd3fhXi1QtJ3oFMUwR1wCN1eE6xAetrit3Ee): protocol: read tcp 5.161.89.252:35532->79.127.205.234:4612: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304772340 (402h22m13.03603996s) [noise=true , address=104.36.82.53:4123 , piece_id=3RIOFXPJL5I4RYLAQLEM4H2ZJ54ATSTQIHLGDOLIFWEXDZBTON4A, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ttjngUh34tGJpCBgVCLfqrWwsdmd88XKWPrmaJrgkMu8htkKM): protocol: read tcp 5.161.89.252:27394->104.36.82.53:4123: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304797058 (402h22m13.036064678s) [noise=true , address=79.127.205.246:4268 , piece_id=MNJ5JLSAEPMH6OEOFYZ3BSA54LI6S64F2V6RY73YTKOFCR44YJLQ, seg_pos={0 0}, upload=418307]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k72iHWdcnM2JKs7VPTQFQwmpQ835HmAP8KpXxjMbEy5QxfzG): protocol: read tcp 5.161.89.252:64712->79.127.205.246:4268: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 11:48:32.304804441 (402h22m13.036072062s) [seg_pos={0 0}, upload=418307]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 25 11:48:32.304853163 (402h22m13.036120783s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 11:48:32.304856800 (402h22m13.03612442s) [upload=418307]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 11:48:32.566310632 (402h22m13.297578281s) [upload=418307]: Done uploading segments...
Aug 25 11:48:32.566362549 (402h22m13.297630209s) [upload=418307]: Upload finished. err: <nil>
Duration: 618.522006ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X..X...................................................] duration:
416.159679ms
FAIL (2025-08-25 11:48:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 416.190788ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X.......X...............................................] duration:
496.973911ms
FAIL (2025-08-25 11:47:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:10:30.601834978 (401h44m11.333102628s) [upload=417644]: Starting upload Aug 25 11:10:30.601939706 (401h44m11.333207356s) [upload=417644]: Done starting upload Aug 25 11:10:30.602093996 (401h44m11.333361646s) [upload=417644]: Uploading segments... Aug 25 11:10:30.602319080 (401h44m11.33358674s) [upload=417644]: Got next segment. Inline: false Aug 25 11:10:30.602379082 (401h44m11.333646733s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:10:30.602399932 (401h44m11.333667582s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 11:10:30.664307758 (401h44m11.395575398s) [upload=417644]: Next segment err: metaclient: Too Many Requests Aug 25 11:10:30.664326734 (401h44m11.395594364s) [upload=417644]: Done uploading segments... Aug 25 11:10:30.664342863 (401h44m11.395610503s) [upload=417644]: Upload finished. err: metaclient: Too Many Requests
Duration: 497.001895ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X..X..................................................] duration:
211.001579ms
FAIL (2025-08-25 11:47:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 211.113989ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X.......X..............................................] duration:
909.913802ms
FAIL (2025-08-25 11:46:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:10:30.601834978 (401h44m11.333102628s) [upload=417644]: Starting upload Aug 25 11:10:30.601939706 (401h44m11.333207356s) [upload=417644]: Done starting upload Aug 25 11:10:30.602093996 (401h44m11.333361646s) [upload=417644]: Uploading segments... Aug 25 11:10:30.602319080 (401h44m11.33358674s) [upload=417644]: Got next segment. Inline: false Aug 25 11:10:30.602379082 (401h44m11.333646733s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:10:30.602399932 (401h44m11.333667582s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 11:10:30.664307758 (401h44m11.395575398s) [upload=417644]: Next segment err: metaclient: Too Many Requests Aug 25 11:10:30.664326734 (401h44m11.395594364s) [upload=417644]: Done uploading segments... Aug 25 11:10:30.664342863 (401h44m11.395610503s) [upload=417644]: Upload finished. err: metaclient: Too Many Requests
Duration: 909.932828ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X.......X.............................................] duration:
803.102368ms
FAIL (2025-08-25 11:46:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:10:30.601834978 (401h44m11.333102628s) [upload=417644]: Starting upload Aug 25 11:10:30.601939706 (401h44m11.333207356s) [upload=417644]: Done starting upload Aug 25 11:10:30.602093996 (401h44m11.333361646s) [upload=417644]: Uploading segments... Aug 25 11:10:30.602319080 (401h44m11.33358674s) [upload=417644]: Got next segment. Inline: false Aug 25 11:10:30.602379082 (401h44m11.333646733s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:10:30.602399932 (401h44m11.333667582s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 11:10:30.664307758 (401h44m11.395575398s) [upload=417644]: Next segment err: metaclient: Too Many Requests Aug 25 11:10:30.664326734 (401h44m11.395594364s) [upload=417644]: Done uploading segments... Aug 25 11:10:30.664342863 (401h44m11.395610503s) [upload=417644]: Upload finished. err: metaclient: Too Many Requests
Duration: 803.129841ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X..X.................................................] duration:
179.100762ms
FAIL (2025-08-25 11:46:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 179.128324ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X..X................................................] duration:
171.919524ms
FAIL (2025-08-25 11:45:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 171.945062ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X.......X............................................] duration:
1.065866322s
FAIL (2025-08-25 11:45:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:10:30.601834978 (401h44m11.333102628s) [upload=417644]: Starting upload Aug 25 11:10:30.601939706 (401h44m11.333207356s) [upload=417644]: Done starting upload Aug 25 11:10:30.602093996 (401h44m11.333361646s) [upload=417644]: Uploading segments... Aug 25 11:10:30.602319080 (401h44m11.33358674s) [upload=417644]: Got next segment. Inline: false Aug 25 11:10:30.602379082 (401h44m11.333646733s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:10:30.602399932 (401h44m11.333667582s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 11:10:30.664307758 (401h44m11.395575398s) [upload=417644]: Next segment err: metaclient: Too Many Requests Aug 25 11:10:30.664326734 (401h44m11.395594364s) [upload=417644]: Done uploading segments... Aug 25 11:10:30.664342863 (401h44m11.395610503s) [upload=417644]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.065886781s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X.......X...........................................] duration:
2.08911435s
FAIL (2025-08-25 11:44:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:10:30.601834978 (401h44m11.333102628s) [upload=417644]: Starting upload Aug 25 11:10:30.601939706 (401h44m11.333207356s) [upload=417644]: Done starting upload Aug 25 11:10:30.602093996 (401h44m11.333361646s) [upload=417644]: Uploading segments... Aug 25 11:10:30.602319080 (401h44m11.33358674s) [upload=417644]: Got next segment. Inline: false Aug 25 11:10:30.602379082 (401h44m11.333646733s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:10:30.602399932 (401h44m11.333667582s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 11:10:30.664307758 (401h44m11.395575398s) [upload=417644]: Next segment err: metaclient: Too Many Requests Aug 25 11:10:30.664326734 (401h44m11.395594364s) [upload=417644]: Done uploading segments... Aug 25 11:10:30.664342863 (401h44m11.395610503s) [upload=417644]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.089149827s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X..X...............................................] duration:
223.970232ms
FAIL (2025-08-25 11:44:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 223.988987ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X..X..............................................] duration:
261.568567ms
FAIL (2025-08-25 11:43:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 261.597253ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X.......X..........................................] duration:
712.498719ms
FAIL (2025-08-25 11:43:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:10:30.601834978 (401h44m11.333102628s) [upload=417644]: Starting upload Aug 25 11:10:30.601939706 (401h44m11.333207356s) [upload=417644]: Done starting upload Aug 25 11:10:30.602093996 (401h44m11.333361646s) [upload=417644]: Uploading segments... Aug 25 11:10:30.602319080 (401h44m11.33358674s) [upload=417644]: Got next segment. Inline: false Aug 25 11:10:30.602379082 (401h44m11.333646733s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:10:30.602399932 (401h44m11.333667582s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 11:10:30.664307758 (401h44m11.395575398s) [upload=417644]: Next segment err: metaclient: Too Many Requests Aug 25 11:10:30.664326734 (401h44m11.395594364s) [upload=417644]: Done uploading segments... Aug 25 11:10:30.664342863 (401h44m11.395610503s) [upload=417644]: Upload finished. err: metaclient: Too Many Requests
Duration: 712.528435ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X..X.............................................] duration:
258.403272ms
FAIL (2025-08-25 11:43:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 258.430924ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X..X............................................] duration:
460.618097ms
FAIL (2025-08-25 11:42:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 460.64077ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X.......X.........................................] duration:
2.107879959s
FAIL (2025-08-25 11:42:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:10:30.601834978 (401h44m11.333102628s) [upload=417644]: Starting upload Aug 25 11:10:30.601939706 (401h44m11.333207356s) [upload=417644]: Done starting upload Aug 25 11:10:30.602093996 (401h44m11.333361646s) [upload=417644]: Uploading segments... Aug 25 11:10:30.602319080 (401h44m11.33358674s) [upload=417644]: Got next segment. Inline: false Aug 25 11:10:30.602379082 (401h44m11.333646733s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:10:30.602399932 (401h44m11.333667582s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 11:10:30.664307758 (401h44m11.395575398s) [upload=417644]: Next segment err: metaclient: Too Many Requests Aug 25 11:10:30.664326734 (401h44m11.395594364s) [upload=417644]: Done uploading segments... Aug 25 11:10:30.664342863 (401h44m11.395610503s) [upload=417644]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.107904314s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X..X...........................................] duration:
172.043747ms
FAIL (2025-08-25 11:41:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 172.064848ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X.......X........................................] duration:
353.999523ms
FAIL (2025-08-25 11:41:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:10:30.601834978 (401h44m11.333102628s) [upload=417644]: Starting upload Aug 25 11:10:30.601939706 (401h44m11.333207356s) [upload=417644]: Done starting upload Aug 25 11:10:30.602093996 (401h44m11.333361646s) [upload=417644]: Uploading segments... Aug 25 11:10:30.602319080 (401h44m11.33358674s) [upload=417644]: Got next segment. Inline: false Aug 25 11:10:30.602379082 (401h44m11.333646733s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:10:30.602399932 (401h44m11.333667582s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 11:10:30.664307758 (401h44m11.395575398s) [upload=417644]: Next segment err: metaclient: Too Many Requests Aug 25 11:10:30.664326734 (401h44m11.395594364s) [upload=417644]: Done uploading segments... Aug 25 11:10:30.664342863 (401h44m11.395610503s) [upload=417644]: Upload finished. err: metaclient: Too Many Requests
Duration: 354.020593ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X..X..........................................] duration:
160.831267ms
FAIL (2025-08-25 11:41:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 160.859229ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X.......X.......................................] duration:
1.779259151s
FAIL (2025-08-25 11:40:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:10:30.601834978 (401h44m11.333102628s) [upload=417644]: Starting upload Aug 25 11:10:30.601939706 (401h44m11.333207356s) [upload=417644]: Done starting upload Aug 25 11:10:30.602093996 (401h44m11.333361646s) [upload=417644]: Uploading segments... Aug 25 11:10:30.602319080 (401h44m11.33358674s) [upload=417644]: Got next segment. Inline: false Aug 25 11:10:30.602379082 (401h44m11.333646733s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:10:30.602399932 (401h44m11.333667582s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 11:10:30.664307758 (401h44m11.395575398s) [upload=417644]: Next segment err: metaclient: Too Many Requests Aug 25 11:10:30.664326734 (401h44m11.395594364s) [upload=417644]: Done uploading segments... Aug 25 11:10:30.664342863 (401h44m11.395610503s) [upload=417644]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.779285271s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X.......X......................................] duration:
614.269308ms
FAIL (2025-08-25 11:40:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:10:30.601834978 (401h44m11.333102628s) [upload=417644]: Starting upload Aug 25 11:10:30.601939706 (401h44m11.333207356s) [upload=417644]: Done starting upload Aug 25 11:10:30.602093996 (401h44m11.333361646s) [upload=417644]: Uploading segments... Aug 25 11:10:30.602319080 (401h44m11.33358674s) [upload=417644]: Got next segment. Inline: false Aug 25 11:10:30.602379082 (401h44m11.333646733s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:10:30.602399932 (401h44m11.333667582s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 11:10:30.664307758 (401h44m11.395575398s) [upload=417644]: Next segment err: metaclient: Too Many Requests Aug 25 11:10:30.664326734 (401h44m11.395594364s) [upload=417644]: Done uploading segments... Aug 25 11:10:30.664342863 (401h44m11.395610503s) [upload=417644]: Upload finished. err: metaclient: Too Many Requests
Duration: 614.289998ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X..X.........................................] duration:
271.750146ms
FAIL (2025-08-25 11:39:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 271.768621ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X.......X.....................................] duration:
1.607414227s
FAIL (2025-08-25 11:39:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:10:30.601834978 (401h44m11.333102628s) [upload=417644]: Starting upload Aug 25 11:10:30.601939706 (401h44m11.333207356s) [upload=417644]: Done starting upload Aug 25 11:10:30.602093996 (401h44m11.333361646s) [upload=417644]: Uploading segments... Aug 25 11:10:30.602319080 (401h44m11.33358674s) [upload=417644]: Got next segment. Inline: false Aug 25 11:10:30.602379082 (401h44m11.333646733s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:10:30.602399932 (401h44m11.333667582s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 11:10:30.664307758 (401h44m11.395575398s) [upload=417644]: Next segment err: metaclient: Too Many Requests Aug 25 11:10:30.664326734 (401h44m11.395594364s) [upload=417644]: Done uploading segments... Aug 25 11:10:30.664342863 (401h44m11.395610503s) [upload=417644]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.607435547s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X..X........................................] duration:
138.253148ms
FAIL (2025-08-25 11:39:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 138.276972ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X.......X....................................] duration:
1.651078349s
FAIL (2025-08-25 11:39:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:10:30.601834978 (401h44m11.333102628s) [upload=417644]: Starting upload Aug 25 11:10:30.601939706 (401h44m11.333207356s) [upload=417644]: Done starting upload Aug 25 11:10:30.602093996 (401h44m11.333361646s) [upload=417644]: Uploading segments... Aug 25 11:10:30.602319080 (401h44m11.33358674s) [upload=417644]: Got next segment. Inline: false Aug 25 11:10:30.602379082 (401h44m11.333646733s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:10:30.602399932 (401h44m11.333667582s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 11:10:30.664307758 (401h44m11.395575398s) [upload=417644]: Next segment err: metaclient: Too Many Requests Aug 25 11:10:30.664326734 (401h44m11.395594364s) [upload=417644]: Done uploading segments... Aug 25 11:10:30.664342863 (401h44m11.395610503s) [upload=417644]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.651105762s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X..X.......................................] duration:
475.666121ms
FAIL (2025-08-25 11:39:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 475.689103ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X..X......................................] duration:
140.436014ms
FAIL (2025-08-25 11:38:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 140.458336ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X.......X...................................] duration:
1.498071492s
FAIL (2025-08-25 11:38:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:10:30.601834978 (401h44m11.333102628s) [upload=417644]: Starting upload Aug 25 11:10:30.601939706 (401h44m11.333207356s) [upload=417644]: Done starting upload Aug 25 11:10:30.602093996 (401h44m11.333361646s) [upload=417644]: Uploading segments... Aug 25 11:10:30.602319080 (401h44m11.33358674s) [upload=417644]: Got next segment. Inline: false Aug 25 11:10:30.602379082 (401h44m11.333646733s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:10:30.602399932 (401h44m11.333667582s) [upload=417644]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 11:10:30.664307758 (401h44m11.395575398s) [upload=417644]: Next segment err: metaclient: Too Many Requests Aug 25 11:10:30.664326734 (401h44m11.395594364s) [upload=417644]: Done uploading segments... Aug 25 11:10:30.664342863 (401h44m11.395610503s) [upload=417644]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.498095647s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X..X.....................................] duration:
168.736058ms
FAIL (2025-08-25 11:38:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 11:11:43.909686851 (401h45m24.64095451s) [upload=417663]: Starting upload Aug 25 11:11:43.909758234 (401h45m24.641025884s) [upload=417663]: Done starting upload Aug 25 11:11:43.909841732 (401h45m24.641109382s) [upload=417663]: Uploading segments... Aug 25 11:11:43.909880875 (401h45m24.641148526s) [upload=417663]: Got next segment. Inline: true Aug 25 11:11:43.909886455 (401h45m24.641154106s) [upload=417663]: Waiting for error group managing segments... Aug 25 11:11:43.909933214 (401h45m24.641200875s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 11:11:43.909938464 (401h45m24.641206115s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 11:11:43.909942212 (401h45m24.641209861s) [upload=417663]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 11:11:43.918135678 (401h45m24.649403298s) [upload=417663]: Done uploading segments... Aug 25 11:11:43.918146999 (401h45m24.649414629s) [upload=417663]: Upload finished. err: metaclient: Too Many Requests
Duration: 168.766495ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|