Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 626935 reports (Page 12054 of 12539)
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration: 
570.981932ms
remote: 
"tcp:136.0.77.2:443"
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-08-16 14:52:51 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 571.001749ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)
antiblip: 
1 out of 60 is failed (threshold=6) [..........................................X.................]
duration: 
322.595337ms
target: 
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-08-16 14:52:46 UTC) 
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp 136.0.77.2:443: i/o timeout
Duration: 322.613922ms edge linksharing bgp ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [..............................X.............................]
duration: 
5.562194238s
FAIL (2025-08-16 14:52:43 UTC) 
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 5.562218245s core uplink ap1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip: 
1 out of 60 is failed (threshold=3) [........................................X...................]
duration: 
868.319949ms
FAIL (2025-08-16 14:52:30 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 136.0.77.2:443: i/o timeout
Duration: 868.340667ms edge authservice http bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
3 out of 60 is failed (threshold=3) [..........X........X.......................................X]
duration: 
2.939079588s
FAIL (2025-08-16 14:52:22 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e8ae5e3fdb26c9d879fb081d43f97620737d61beed6526e8174dc65e36111097 != before 7182062fe3a24b5fdd7f6838b7b9e79a496c12c8af8307e1c3e59f5936ed12c6
======LOGS======
Aug 16 14:52:19.103509896 (189h25m59.834777537s) [upload=197114]: Starting upload
Aug 16 14:52:19.103572634 (189h25m59.834840264s) [upload=197114]: Done starting upload
Aug 16 14:52:19.103657164 (189h25m59.834924794s) [upload=197114]: Uploading segments...
Aug 16 14:52:19.103979330 (189h25m59.83524697s) [upload=197114]: Got next segment. Inline: false
Aug 16 14:52:19.104021048 (189h25m59.835288678s) [upload=197114]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 14:52:19.104026909 (189h25m59.835294539s) [upload=197114]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 14:52:19.724072138 (189h26m0.455339768s) [seg_pos={0 0}, upload=197114]: Begin upload segment...
Aug 16 14:52:19.724105262 (189h26m0.455372892s) [seg_pos={0 0}, upload=197114]: Done begin upload segment.
Aug 16 14:52:19.724132923 (189h26m0.455400553s) [noise=true , address=79.127.220.97:4393   , piece_id=UOW3EGQPWBDNRIYQMJY7VZIDEPW2FQZ2QFF4FMA2PATYTOBHQIQA, seg_pos={0 0}, upload=197114]: Uploading piece...
Aug 16 14:52:19.724173149 (189h26m0.455440769s) [noise=true , address=77.90.31.16:4761     , piece_id=JU3LNPUQXNVTENRCRJM7WP5657OSN5FEACC54V7RPWDK6GVYSWHQ, seg_pos={0 0}, upload=197114]: Uploading piece...
Aug 16 14:52:19.724415225 (189h26m0.455682855s) [noise=true , address=104.36.82.3:4769     , piece_id=JLN22ZPSWFW3K76WR2KVY7HJ6CERAGPOUB2SVEAB2RHBYAK2O7AA, seg_pos={0 0}, upload=197114]: Uploading piece...
Aug 16 14:52:19.724496006 (189h26m0.455763626s) [noise=true , address=104.36.82.8:4003     , piece_id=ZX7RNHJHPGSF35UI7EHO2IBV5MVYJJ3WIT243VYMMPPVYPLFWYUA, seg_pos={0 0}, upload=197114]: Uploading piece...
Aug 16 14:52:19.724632102 (189h26m0.455899723s) [noise=true , address=156.146.43.225:4468  , piece_id=E7GZX3E5V6UWYMJENFTUFS77RPP52EAKBEKV6FDRK4L52CSX3XIA, seg_pos={0 0}, upload=197114]: Uploading piece...
Aug 16 14:52:19.724817100 (189h26m0.45608473s) [noise=true , address=77.90.31.14:4690     , piece_id=7SMDHMQDQ6KYMUMPSOTGLNNVOLWE6ZMPSJJ5ZNZQT4AFZJE33INQ, seg_pos={0 0}, upload=197114]: Uploading piece...
Aug 16 14:52:19.724890359 (189h26m0.456157989s) [noise=true , address=77.90.31.21:4905     , piece_id=43AJ7V4Z5GUS6VPY2ZODCPGFH7TEOM24JXBJPY4HA6ZIVBHSNPUQ, seg_pos={0 0}, upload=197114]: Uploading piece...
Aug 16 14:52:19.725090515 (189h26m0.456358145s) [noise=true , address=104.36.82.58:4269    , piece_id=OICP5WYQKX4OQV4MBVB5AD72AYYDOVR2NWB4ZA6QO4GFXFEVZCFQ, seg_pos={0 0}, upload=197114]: Uploading piece...
Aug 16 14:52:19.725103129 (189h26m0.456370759s) [noise=true , address=45.91.116.8:4072     , piece_id=JX4SL37ZUBQNS37ODAKBVZCMI7ITBMHOQFJRGT5RVEYCR5ZXUXUQ, seg_pos={0 0}, upload=197114]: Uploading piece...
Aug 16 14:52:19.725329616 (189h26m0.456597246s) [noise=true , address=104.36.82.23:4449    , piece_id=FIGFVIHGMO4RV4KYBPA5PYVXA2TXUDI5Q4IK4GNY2JMPYXT6D3HQ, seg_pos={0 0}, upload=197114]: Uploading piece...
Aug 16 14:52:19.725388667 (189h26m0.456656286s) [noise=true , address=104.36.82.59:4309    , piece_id=VUPIJQVH2LWWGFHL4BEL4QRQ5JKAQZUV544YW2ISETELGHJMXKDQ, seg_pos={0 0}, upload=197114]: Uploading piece...
Aug 16 14:52:19.725533419 (189h26m0.456801049s) [noise=true , address=104.36.82.60:4362    , piece_id=SZXJ4HINGWWNF3U2434SRHHLJY245SJDV5HXOEM55BQKHZ2UGBYA, seg_pos={0 0}, upload=197114]: Uploading piece...
Aug 16 14:52:19.725650450 (189h26m0.45691808s) [noise=true , address=79.127.205.246:4282  , piece_id=IESDHR657HY2BI35QBG5HJIOKXVMYPAGNZ7K5O5FYRNZDLQD7QMQ, seg_pos={0 0}, upload=197114]: Uploading piece...
Aug 16 14:52:19.725768001 (189h26m0.457035631s) [noise=true , address=104.36.82.5:4843     , piece_id=OVKW7RDZJ4UQPIKAK5YDZGITWS2SGYBXGJFDYTT43Q3DJBBUN4XQ, seg_pos={0 0}, upload=197114]: Uploading piece...
Aug 16 14:52:19.725961765 (189h26m0.457229395s) [noise=true , address=104.36.82.44:4900    , piece_id=WF6RI35XL5J6AZOZIUUGQ4CRZEEMZGQ5XI67K5KBV3XAW3PVIIGA, seg_pos={0 0}, upload=197114]: Uploading piece...
Aug 16 14:52:19.725975481 (189h26m0.457243111s) [noise=true , address=79.127.201.215:4354  , piece_id=QCUQYTDVE7RJTUCMCHP4ZJVVONCE7IN3WKIWHAHI5VBYZGFUUB6A, seg_pos={0 0}, upload=197114]: Uploading piece...
Aug 16 14:52:19.726203661 (189h26m0.457471291s) [noise=true , address=77.90.31.10:4529     , piece_id=H3QJMBXC4ZSSGP5VXAZFGAVUESH7WO5B2TJOTFPJGMEJUPMADQMQ, seg_pos={0 0}, upload=197114]: Uploading piece...
Aug 16 14:52:19.726227135 (189h26m0.457494755s) [noise=true , address=104.36.82.39:4729    , piece_id=7MY727HHRZOFMMUAGSJF7Q3MP7ZMP5U2QHSHG54OOJGEPG3SQDRQ, seg_pos={0 0}, upload=197114]: Uploading piece...
Aug 16 14:52:19.811341810 (189h26m0.54260944s) [upload=197114]: Next returned nil segment
Aug 16 14:52:19.811354172 (189h26m0.542621803s) [upload=197114]: Waiting for error group managing segments...
Aug 16 14:52:19.841078582 (189h26m0.572346201s) [noise=true , address=104.36.82.23:4449    , piece_id=FIGFVIHGMO4RV4KYBPA5PYVXA2TXUDI5Q4IK4GNY2JMPYXT6D3HQ, seg_pos={0 0}, upload=197114]: Done uploading piece. err: <nil>
Aug 16 14:52:19.858573821 (189h26m0.589841441s) [noise=true , address=104.36.82.59:4309    , piece_id=VUPIJQVH2LWWGFHL4BEL4QRQ5JKAQZUV544YW2ISETELGHJMXKDQ, seg_pos={0 0}, upload=197114]: Done uploading piece. err: <nil>
Aug 16 14:52:19.862997227 (189h26m0.594264847s) [noise=true , address=104.36.82.39:4729    , piece_id=7MY727HHRZOFMMUAGSJF7Q3MP7ZMP5U2QHSHG54OOJGEPG3SQDRQ, seg_pos={0 0}, upload=197114]: Done uploading piece. err: <nil>
Aug 16 14:52:19.863274369 (189h26m0.594541989s) [noise=true , address=104.36.82.5:4843     , piece_id=OVKW7RDZJ4UQPIKAK5YDZGITWS2SGYBXGJFDYTT43Q3DJBBUN4XQ, seg_pos={0 0}, upload=197114]: Done uploading piece. err: <nil>
Aug 16 14:52:19.867505252 (189h26m0.598772872s) [noise=true , address=104.36.82.60:4362    , piece_id=SZXJ4HINGWWNF3U2434SRHHLJY245SJDV5HXOEM55BQKHZ2UGBYA, seg_pos={0 0}, upload=197114]: Done uploading piece. err: <nil>
Aug 16 14:52:19.873932991 (189h26m0.605200621s) [noise=true , address=77.90.31.16:4761     , piece_id=JU3LNPUQXNVTENRCRJM7WP5657OSN5FEACC54V7RPWDK6GVYSWHQ, seg_pos={0 0}, upload=197114]: Done uploading piece. err: <nil>
Aug 16 14:52:19.879096951 (189h26m0.610364581s) [noise=true , address=104.36.82.3:4769     , piece_id=JLN22ZPSWFW3K76WR2KVY7HJ6CERAGPOUB2SVEAB2RHBYAK2O7AA, seg_pos={0 0}, upload=197114]: Done uploading piece. err: <nil>
Aug 16 14:52:19.885814204 (189h26m0.617081855s) [noise=true , address=77.90.31.10:4529     , piece_id=H3QJMBXC4ZSSGP5VXAZFGAVUESH7WO5B2TJOTFPJGMEJUPMADQMQ, seg_pos={0 0}, upload=197114]: Done uploading piece. err: <nil>
Aug 16 14:52:19.889272162 (189h26m0.620539813s) [noise=true , address=79.127.220.97:4393   , piece_id=UOW3EGQPWBDNRIYQMJY7VZIDEPW2FQZ2QFF4FMA2PATYTOBHQIQA, seg_pos={0 0}, upload=197114]: Done uploading piece. err: <nil>
Aug 16 14:52:19.964470162 (189h26m0.695737792s) [noise=true , address=156.146.43.225:4468  , piece_id=E7GZX3E5V6UWYMJENFTUFS77RPP52EAKBEKV6FDRK4L52CSX3XIA, seg_pos={0 0}, upload=197114]: Done uploading piece. err: <nil>
Aug 16 14:52:20.005225434 (189h26m0.736493064s) [noise=true , address=45.91.116.8:4072     , piece_id=JX4SL37ZUBQNS37ODAKBVZCMI7ITBMHOQFJRGT5RVEYCR5ZXUXUQ, seg_pos={0 0}, upload=197114]: Done uploading piece. err: <nil>
Aug 16 14:52:20.011807352 (189h26m0.743074972s) [noise=true , address=77.90.31.14:4690     , piece_id=7SMDHMQDQ6KYMUMPSOTGLNNVOLWE6ZMPSJJ5ZNZQT4AFZJE33INQ, seg_pos={0 0}, upload=197114]: Done uploading piece. err: <nil>
Aug 16 14:52:20.121793641 (189h26m0.853061271s) [noise=true , address=77.90.31.21:4905     , piece_id=43AJ7V4Z5GUS6VPY2ZODCPGFH7TEOM24JXBJPY4HA6ZIVBHSNPUQ, seg_pos={0 0}, upload=197114]: Done uploading piece. err: <nil>
Aug 16 14:52:20.202637939 (189h26m0.933905569s) [noise=true , address=79.127.201.215:4354  , piece_id=QCUQYTDVE7RJTUCMCHP4ZJVVONCE7IN3WKIWHAHI5VBYZGFUUB6A, seg_pos={0 0}, upload=197114]: Done uploading piece. err: <nil>
Aug 16 14:52:20.202662736 (189h26m0.933930356s) [seg_pos={0 0}, upload=197114]: Segment reached optimal threshold of 14 pieces.
Aug 16 14:52:20.202827826 (189h26m0.934095446s) [noise=true , address=79.127.205.246:4282  , piece_id=IESDHR657HY2BI35QBG5HJIOKXVMYPAGNZ7K5O5FYRNZDLQD7QMQ, seg_pos={0 0}, upload=197114]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1h57yhefx9MHNAFXV3CZAzTopF5v61K6SyEdXh9HqjxndPw1mm): protocol: expected piece hash; context canceled; EOF
Aug 16 14:52:20.203030869 (189h26m0.934298499s) [noise=true , address=104.36.82.8:4003     , piece_id=ZX7RNHJHPGSF35UI7EHO2IBV5MVYJJ3WIT243VYMMPPVYPLFWYUA, seg_pos={0 0}, upload=197114]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qTLdkqYYRGs1fpm8ZP17cGxPUYJCrspBwffuGbd6JbwcsRf65): protocol: read tcp 5.161.89.252:64642->104.36.82.8:4003: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 14:52:20.203125407 (189h26m0.934393037s) [noise=true , address=104.36.82.44:4900    , piece_id=WF6RI35XL5J6AZOZIUUGQ4CRZEEMZGQ5XI67K5KBV3XAW3PVIIGA, seg_pos={0 0}, upload=197114]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R8K65zsCspu7W2oAnvtpz7zEsQFkDG1e5BAp6faQYMQrkh4oQ): protocol: read tcp 5.161.89.252:13254->104.36.82.44:4900: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 14:52:20.203159962 (189h26m0.934427583s) [noise=true , address=104.36.82.58:4269    , piece_id=OICP5WYQKX4OQV4MBVB5AD72AYYDOVR2NWB4ZA6QO4GFXFEVZCFQ, seg_pos={0 0}, upload=197114]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B63jT3ne2EnUiH7eRFWMpjzdirh6u7PwprmTUmDHPquoQwgk9): protocol: read tcp 5.161.89.252:12194->104.36.82.58:4269: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 16 14:52:20.203185851 (189h26m0.934453471s) [seg_pos={0 0}, upload=197114]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 14:52:20.203268415 (189h26m0.934536046s) [upload=197114]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 14:52:20.203272493 (189h26m0.934540123s) [upload=197114]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 14:52:21.365073094 (189h26m2.096340724s) [upload=197114]: Done uploading segments...
Aug 16 14:52:21.365087601 (189h26m2.096355231s) [upload=197114]: Upload finished. err: <nil>
Duration: 2.939100938s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration: 
237.507466ms
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-08-16 14:52:05 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp 136.0.77.2:443: i/o timeout
Duration: 237.538535ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [...............................X............................]
duration: 
5.099153417s
FAIL (2025-08-16 14:52:02 UTC) 
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 5.099174557s core uplink ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration: 
835.82131ms
remote: 
"tcp:136.0.77.2:443"
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-08-16 14:52:02 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 835.838933ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
5 out of 60 is failed (threshold=3) [..............X......................X...........X...X..X...]
duration: 
1.817423003s
FAIL (2025-08-16 14:51:58 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 93e83844f0545d255d23ce134094b01ecd22f97b094c8b6e9808f4fe8fd94c2c != before 6987c690b5e1e4ccb4aadc322401d516ab1c737bc495edfcd34e2c852c8bed07
======LOGS======
Aug 16 14:48:51.003160402 (189h22m31.734428032s) [upload=197055]: Starting upload
Aug 16 14:48:51.003221758 (189h22m31.734489388s) [upload=197055]: Done starting upload
Aug 16 14:48:51.003258486 (189h22m31.734526126s) [upload=197055]: Uploading segments...
Aug 16 14:48:51.003299023 (189h22m31.734566642s) [upload=197055]: Got next segment. Inline: true
Aug 16 14:48:51.003303751 (189h22m31.734571381s) [upload=197055]: Waiting for error group managing segments...
Aug 16 14:48:51.003334459 (189h22m31.734602089s) [upload=197055]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 14:48:51.003338096 (189h22m31.734605726s) [upload=197055]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 16 14:48:51.003340961 (189h22m31.734608591s) [upload=197055]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 14:48:54.144458810 (189h22m34.87572644s) [upload=197055]: Done uploading segments...
Aug 16 14:48:54.144469129 (189h22m34.875736759s) [upload=197055]: Upload finished. err: <nil>
Duration: 1.817444834s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip: 
1 out of 60 is failed (threshold=3) [...........................................X................]
duration: 
559.12886ms
FAIL (2025-08-16 14:51:53 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 136.0.77.2:443: i/o timeout
Duration: 559.148758ms edge authservice http bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [...........X........X.......................................]
duration: 
3.47828552s
FAIL (2025-08-16 14:51:51 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 16 14:23:10.478810879 (188h56m51.210078499s) [upload=196616]: Starting upload
Aug 16 14:23:10.478872666 (188h56m51.210140316s) [upload=196616]: Done starting upload
Aug 16 14:23:10.478932628 (188h56m51.210200259s) [upload=196616]: Uploading segments...
Aug 16 14:23:10.479197186 (188h56m51.210464816s) [upload=196616]: Got next segment. Inline: false
Aug 16 14:23:10.479224900 (188h56m51.21049252s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 14:23:10.479228587 (188h56m51.210496217s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 14:23:10.481835968 (188h56m51.213103598s) [upload=196616]: Next segment err: metaclient: Too Many Requests
Aug 16 14:23:10.481847289 (188h56m51.213114909s) [upload=196616]: Done uploading segments...
Aug 16 14:23:10.481872918 (188h56m51.213140538s) [upload=196616]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.478308163s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration: 
2.445793908s
FAIL (2025-08-16 14:51:45 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.445811883s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)
antiblip: 
1 out of 60 is failed (threshold=6) [...........................................X................]
duration: 
335.218028ms
target: 
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-08-16 14:51:40 UTC) 
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp 136.0.77.2:443: i/o timeout
Duration: 335.241543ms edge linksharing bgp ap1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip: 
1 out of 60 is failed (threshold=3) [............................................X...............]
duration: 
595.428773ms
FAIL (2025-08-16 14:51:33 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 136.0.77.2:443: i/o timeout
Duration: 595.447527ms edge authservice http bgp eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [................................X...........................]
duration: 
6.604743115s
FAIL (2025-08-16 14:51:22 UTC) 
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 6.604770707s core uplink ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [...........................................X................]
duration: 
113.577348ms
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-08-16 14:51:22 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp 136.0.77.2:443: i/o timeout
Duration: 113.595262ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
1 out of 60 is failed (threshold=3) [...........................................X................]
duration: 
1.814843785s
FAIL (2025-08-16 14:51:22 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 1.814862188s core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip: 
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration: 
878.160996ms
FAIL (2025-08-16 14:51:17 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 136.0.77.2:443: i/o timeout
Duration: 878.185762ms edge authservice http bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [............X........X......................................]
duration: 
9.51632845s
FAIL (2025-08-16 14:51:07 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 16 14:23:10.478810879 (188h56m51.210078499s) [upload=196616]: Starting upload
Aug 16 14:23:10.478872666 (188h56m51.210140316s) [upload=196616]: Done starting upload
Aug 16 14:23:10.478932628 (188h56m51.210200259s) [upload=196616]: Uploading segments...
Aug 16 14:23:10.479197186 (188h56m51.210464816s) [upload=196616]: Got next segment. Inline: false
Aug 16 14:23:10.479224900 (188h56m51.21049252s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 14:23:10.479228587 (188h56m51.210496217s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 14:23:10.481835968 (188h56m51.213103598s) [upload=196616]: Next segment err: metaclient: Too Many Requests
Aug 16 14:23:10.481847289 (188h56m51.213114909s) [upload=196616]: Done uploading segments...
Aug 16 14:23:10.481872918 (188h56m51.213140538s) [upload=196616]: Upload finished. err: metaclient: Too Many Requests
Duration: 9.51634935s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip: 
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration: 
877.657575ms
FAIL (2025-08-16 14:51:00 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 136.0.77.2:443: i/o timeout
Duration: 877.677824ms edge authservice http bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
5 out of 60 is failed (threshold=3) [...............X......................X...........X...X..X..]
duration: 
3.123901303s
FAIL (2025-08-16 14:50:59 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 93e83844f0545d255d23ce134094b01ecd22f97b094c8b6e9808f4fe8fd94c2c != before 6987c690b5e1e4ccb4aadc322401d516ab1c737bc495edfcd34e2c852c8bed07
======LOGS======
Aug 16 14:48:51.003160402 (189h22m31.734428032s) [upload=197055]: Starting upload
Aug 16 14:48:51.003221758 (189h22m31.734489388s) [upload=197055]: Done starting upload
Aug 16 14:48:51.003258486 (189h22m31.734526126s) [upload=197055]: Uploading segments...
Aug 16 14:48:51.003299023 (189h22m31.734566642s) [upload=197055]: Got next segment. Inline: true
Aug 16 14:48:51.003303751 (189h22m31.734571381s) [upload=197055]: Waiting for error group managing segments...
Aug 16 14:48:51.003334459 (189h22m31.734602089s) [upload=197055]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 14:48:51.003338096 (189h22m31.734605726s) [upload=197055]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 16 14:48:51.003340961 (189h22m31.734608591s) [upload=197055]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 14:48:54.144458810 (189h22m34.87572644s) [upload=197055]: Done uploading segments...
Aug 16 14:48:54.144469129 (189h22m34.875736759s) [upload=197055]: Upload finished. err: <nil>
Duration: 3.123914468s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [...........................................X................]
duration: 
788.539986ms
remote: 
"tcp:136.0.77.2:443"
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-08-16 14:50:59 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 788.577525ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)
antiblip: 
1 out of 60 is failed (threshold=6) [............................................X...............]
duration: 
325.421479ms
target: 
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-08-16 14:50:55 UTC) 
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp 136.0.77.2:443: i/o timeout
Duration: 325.439835ms edge linksharing bgp ap1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip: 
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration: 
519.742766ms
FAIL (2025-08-16 14:50:53 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 136.0.77.2:443: i/o timeout
Duration: 519.76665ms edge authservice http bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [............................................X...............]
duration: 
553.872417ms
remote: 
"tcp:136.0.77.2:443"
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-08-16 14:50:34 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 553.893096ms edge gateway vhost bgp ap1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
1 out of 60 is failed (threshold=3) [............................................X...............]
duration: 
1.687425387s
FAIL (2025-08-16 14:50:29 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 1.687440785s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [............................................X...............]
duration: 
114.272146ms
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-08-16 14:50:26 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp 136.0.77.2:443: i/o timeout
Duration: 114.288926ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration: 
6.866379724s
FAIL (2025-08-16 14:50:22 UTC) 
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 6.866404741s core uplink ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration: 
782.170939ms
remote: 
"tcp:136.0.77.2:443"
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-08-16 14:49:57 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 782.192278ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
5 out of 60 is failed (threshold=3) [................X......................X...........X...X..X.]
duration: 
9.271338021s
FAIL (2025-08-16 14:49:55 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 93e83844f0545d255d23ce134094b01ecd22f97b094c8b6e9808f4fe8fd94c2c != before 6987c690b5e1e4ccb4aadc322401d516ab1c737bc495edfcd34e2c852c8bed07
======LOGS======
Aug 16 14:48:51.003160402 (189h22m31.734428032s) [upload=197055]: Starting upload
Aug 16 14:48:51.003221758 (189h22m31.734489388s) [upload=197055]: Done starting upload
Aug 16 14:48:51.003258486 (189h22m31.734526126s) [upload=197055]: Uploading segments...
Aug 16 14:48:51.003299023 (189h22m31.734566642s) [upload=197055]: Got next segment. Inline: true
Aug 16 14:48:51.003303751 (189h22m31.734571381s) [upload=197055]: Waiting for error group managing segments...
Aug 16 14:48:51.003334459 (189h22m31.734602089s) [upload=197055]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 14:48:51.003338096 (189h22m31.734605726s) [upload=197055]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 16 14:48:51.003340961 (189h22m31.734608591s) [upload=197055]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 14:48:54.144458810 (189h22m34.87572644s) [upload=197055]: Done uploading segments...
Aug 16 14:48:54.144469129 (189h22m34.875736759s) [upload=197055]: Upload finished. err: <nil>
Duration: 9.271384659s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip: 
1 out of 60 is failed (threshold=3) [...........................................X................]
duration: 
872.303829ms
FAIL (2025-08-16 14:49:54 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 136.0.77.2:443: i/o timeout
Duration: 872.348982ms edge authservice http bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)
antiblip: 
1 out of 60 is failed (threshold=6) [.............................................X..............]
duration: 
324.987333ms
target: 
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-08-16 14:49:53 UTC) 
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp 136.0.77.2:443: i/o timeout
Duration: 325.013903ms edge linksharing bgp ap1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip: 
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration: 
539.875442ms
FAIL (2025-08-16 14:49:52 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 136.0.77.2:443: i/o timeout
Duration: 539.946626ms edge authservice http bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [.............X........X.....................................]
duration: 
4.318663584s
FAIL (2025-08-16 14:49:50 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 16 14:23:10.478810879 (188h56m51.210078499s) [upload=196616]: Starting upload
Aug 16 14:23:10.478872666 (188h56m51.210140316s) [upload=196616]: Done starting upload
Aug 16 14:23:10.478932628 (188h56m51.210200259s) [upload=196616]: Uploading segments...
Aug 16 14:23:10.479197186 (188h56m51.210464816s) [upload=196616]: Got next segment. Inline: false
Aug 16 14:23:10.479224900 (188h56m51.21049252s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 14:23:10.479228587 (188h56m51.210496217s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 14:23:10.481835968 (188h56m51.213103598s) [upload=196616]: Next segment err: metaclient: Too Many Requests
Aug 16 14:23:10.481847289 (188h56m51.213114909s) [upload=196616]: Done uploading segments...
Aug 16 14:23:10.481872918 (188h56m51.213140538s) [upload=196616]: Upload finished. err: metaclient: Too Many Requests
Duration: 4.31868334s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration: 
1.727429818s
FAIL (2025-08-16 14:49:40 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 1.727450296s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration: 
786.332917ms
remote: 
"tcp:136.0.77.2:443"
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-08-16 14:49:20 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 786.37666ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration: 
113.775905ms
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-08-16 14:49:19 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp 136.0.77.2:443: i/o timeout
Duration: 113.798099ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)
antiblip: 
1 out of 60 is failed (threshold=6) [..............................................X.............]
duration: 
307.191473ms
target: 
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-08-16 14:49:19 UTC) 
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp 136.0.77.2:443: i/o timeout
Duration: 307.208044ms edge linksharing bgp ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration: 
5.061957311s
FAIL (2025-08-16 14:49:10 UTC) 
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 5.061977738s core uplink ap1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip: 
1 out of 60 is failed (threshold=3) [...............................................X............]
duration: 
548.706129ms
FAIL (2025-08-16 14:49:02 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 136.0.77.2:443: i/o timeout
Duration: 548.737688ms edge authservice http bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration: 
114.814218ms
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-08-16 14:49:01 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp 136.0.77.2:443: i/o timeout
Duration: 114.835056ms edge gateway vhost bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip: 
1 out of 60 is failed (threshold=3) [............................................X...............]
duration: 
893.236496ms
FAIL (2025-08-16 14:48:57 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 136.0.77.2:443: i/o timeout
Duration: 893.253679ms edge authservice http bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [..............X........X....................................]
duration: 
4.036643246s
FAIL (2025-08-16 14:48:56 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 16 14:23:10.478810879 (188h56m51.210078499s) [upload=196616]: Starting upload
Aug 16 14:23:10.478872666 (188h56m51.210140316s) [upload=196616]: Done starting upload
Aug 16 14:23:10.478932628 (188h56m51.210200259s) [upload=196616]: Uploading segments...
Aug 16 14:23:10.479197186 (188h56m51.210464816s) [upload=196616]: Got next segment. Inline: false
Aug 16 14:23:10.479224900 (188h56m51.21049252s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 14:23:10.479228587 (188h56m51.210496217s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 14:23:10.481835968 (188h56m51.213103598s) [upload=196616]: Next segment err: metaclient: Too Many Requests
Aug 16 14:23:10.481847289 (188h56m51.213114909s) [upload=196616]: Done uploading segments...
Aug 16 14:23:10.481872918 (188h56m51.213140538s) [upload=196616]: Upload finished. err: metaclient: Too Many Requests
Duration: 4.036676548s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip: 
5 out of 60 is failed (threshold=3) [.................X......................X...........X...X..X]
duration: 
3.676173756s
FAIL (2025-08-16 14:48:54 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 93e83844f0545d255d23ce134094b01ecd22f97b094c8b6e9808f4fe8fd94c2c != before 6987c690b5e1e4ccb4aadc322401d516ab1c737bc495edfcd34e2c852c8bed07
======LOGS======
Aug 16 14:48:51.003160402 (189h22m31.734428032s) [upload=197055]: Starting upload
Aug 16 14:48:51.003221758 (189h22m31.734489388s) [upload=197055]: Done starting upload
Aug 16 14:48:51.003258486 (189h22m31.734526126s) [upload=197055]: Uploading segments...
Aug 16 14:48:51.003299023 (189h22m31.734566642s) [upload=197055]: Got next segment. Inline: true
Aug 16 14:48:51.003303751 (189h22m31.734571381s) [upload=197055]: Waiting for error group managing segments...
Aug 16 14:48:51.003334459 (189h22m31.734602089s) [upload=197055]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 14:48:51.003338096 (189h22m31.734605726s) [upload=197055]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 16 14:48:51.003340961 (189h22m31.734608591s) [upload=197055]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 14:48:54.144458810 (189h22m34.87572644s) [upload=197055]: Done uploading segments...
Aug 16 14:48:54.144469129 (189h22m34.875736759s) [upload=197055]: Upload finished. err: <nil>
Duration: 3.676193315s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration: 
2.327016224s
FAIL (2025-08-16 14:48:31 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 2.327031753s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)
antiblip: 
1 out of 60 is failed (threshold=6) [...............................................X............]
duration: 
311.437386ms
target: 
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt
FAIL (2025-08-16 14:48:23 UTC) 
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp 136.0.77.2:443: i/o timeout
Duration: 311.461933ms edge linksharing bgp ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip: 
1 out of 60 is failed (threshold=3) [...................................X........................]
duration: 
7.876147741s
FAIL (2025-08-16 14:48:16 UTC) 
orbiter warning: operation: DownloadObject
uplink: metaclient: context deadline exceeded
Duration: 7.876168791s core uplink ap1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)
antiblip: 
1 out of 60 is failed (threshold=3) [................................................X...........]
duration: 
575.077706ms
FAIL (2025-08-16 14:48:16 UTC) 
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 136.0.77.2:443: i/o timeout
Duration: 575.098155ms edge authservice http bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [...............X........X...................................]
duration: 
2.541885228s
FAIL (2025-08-16 14:48:14 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 16 14:23:10.478810879 (188h56m51.210078499s) [upload=196616]: Starting upload
Aug 16 14:23:10.478872666 (188h56m51.210140316s) [upload=196616]: Done starting upload
Aug 16 14:23:10.478932628 (188h56m51.210200259s) [upload=196616]: Uploading segments...
Aug 16 14:23:10.479197186 (188h56m51.210464816s) [upload=196616]: Got next segment. Inline: false
Aug 16 14:23:10.479224900 (188h56m51.21049252s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 14:23:10.479228587 (188h56m51.210496217s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 14:23:10.481835968 (188h56m51.213103598s) [upload=196616]: Next segment err: metaclient: Too Many Requests
Aug 16 14:23:10.481847289 (188h56m51.213114909s) [upload=196616]: Done uploading segments...
Aug 16 14:23:10.481872918 (188h56m51.213140538s) [upload=196616]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.541911949s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip: 
1 out of 60 is failed (threshold=3) [...............................................X............]
duration: 
764.964741ms
remote: 
"tcp:136.0.77.2:443"
target: 
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-08-16 14:48:12 UTC) 
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 764.98538ms edge gateway vhost bgp ap1