Author Topic: SpaceX Falcon 9 v1.1 CRS-3 Splashdown Video Repair Task Thread  (Read 915972 times)

Offline Asmegin

  • Member
  • Posts: 35
  • Canada
  • Liked: 21
  • Likes Given: 3
Took a quick try at Frameset 92 - holy smokes. This section is brutal  ;D I just tried to align the legs for now, to see them finish unfolding and the engine firing up.

Having a problem though... It seems after corrections to certain p-frames, the editor stops updating. For example, using the following:

Quote
FRAME0:X:54419:00,X:53655:00,0:0:550,14:0:-2:0:0:0:0:12:-6,2:5:14749,
39:7:-1,18:9:27558,25:12:39009,29:12:-1,17:13:42121,18:13:42526,10:14:-1,
18:14:47626,26:14:-2:0:0:0:0:8:-6,30:14:50837,1:15:-1,5:15:51900,9:15:-1,
21:15:53655,27:16:61466,42:19:-1,43:19:83153,43:20:-1,1:21:90585,11:22:-1,
17:23:105394,22:24:-1,23:24:111581,0:27:-1,25:27:125621,28:28:-1,3:29:140154=
FRAME1:1:10:17471=FRAME2:11:12:10850,1:28:48285=FRAME3:2:12:21895,
17:15:34992,0:16:38893,6:27:73094=FRAME4:0:0:1335,0:19:47777=FRAME5:0:4:9064=
FRAME6:6:8:16348,0:14:29164=FRAME7:0:10:18385=FRAME8:0:16:34639=
FRAME9:0:4:7002=FRAME10:2:11:25555,15:11:41494,0:24:-1=FRAME11:0:6:88170,
0:7:10335=FRAME13:16:11:20288,0:14:29710=FRAME14:0:16:26506=
FRAME16:0:9:-1,16:11:11103,0:14:17752,18:14:18288,0:16:25394=FRAME17:1:8:11380=
FRAME19:0:0:1234

The slider stops changing the image after Frame 102. Deleting 99-101 fixes it, but I can't figure out why. I am still able to view the isolate frames all the way up to Frame 111 though.

« Last Edit: 05/22/2014 03:37 AM by Asmegin »

Offline PaulNY

  • Member
  • Posts: 3
  • NY
  • Liked: 1
  • Likes Given: 0
Wow you guys are making awesome progress!!!!

I know we are trying to replace bad mmb with good mmb. So would it be useful to document the XY and POS of good mmb's? I am thinking if we can map out what we know to be good, figuring out what to replace the bad with may be easier.
Welcome to the forum PaulNY!

From what I understand your idea is to catalog good macro blocks in all the frames. Good as in decided by human beings not by some algorithm I assume.

This may be of some use. I'm not sure. We sort of implicitly rely on our vision to detect good vs bad blocks. We also have a nice feature in the online tool that highlights all error-macroblocks in a frame. There are still plenty of non-error-blocks left that look "bad", but we don't know if they are easily repairable or are really bad. We usually judge their "badness" by the destruction they cause to other blocks.

So depending on what you think 1. what the criteria of "bad" is, or even multiple classes of bad and 2. how you think we can deal with those kinds of "badness", your idea might have some value.

Maybe you can try to "fertilize" your ideas a little bit so it becomes more clear if we can use it. :)

Regards,

arnezami

PS. We refer to mmb as "modify macro block". I believe when you say mmb you actually ment to say "macro block".

Unfortunately work has kept me away for a few days, but let me try to explain my idea more.

Lets say I look at I frame 8. MB 1 (0:0) looks right and is blue water. If we can document the position of this MB in the frame, then lets say some MB (x,y) looks bad and we think it's water we could try replacing it with a known value of a good water MB instead of trying to guess. If we can document all the know good and bad MB values in the I frames, then we can then target our repairs more. I feel like when trying to make a repair the majority of the time I spend is guessing MB pos values or the pos to try a invert / flip.

Maybe I am missing something, but if this is where other people spend a lot of time to it would be great if we could create a way to collaborate on this more and optimize the process.

If we can't document known good or bad positions, maybe we could create a DB of recommended or non recommended pos values for each MB to try and optimize the process.  For example if I try to fix / replace MB (X:Y) and try these 400 values that don't work. If I can document that I can save the next guy from trying the same thing.

Offline mvpel

  • Full Member
  • ****
  • Posts: 1124
  • New Hampshire
  • Liked: 1295
  • Likes Given: 1686
Off-topic: Good luck to people who used to make a living out of repairing video files...I guess customers might no longer accept "a 50% chance of recovering one or two frames" as an answer after seeing the latest gifs from this video :))

They  could always point out to the customers that it's taken 40 years to restore the stained glass windows at Sainte Chapelle. I wonder how much the magnificent work over the past month or so would have cost at a mere $20 per hour... :D

"Ugly programs are like ugly suspension bridges: they're much more liable to collapse than pretty ones, because the way humans (especially engineer-humans) perceive beauty is intimately related to our ability to process and understand complexity. A language that makes it hard to write elegant code makes it hard to write good code." - Eric S. Raymond

Offline mvpel

  • Full Member
  • ****
  • Posts: 1124
  • New Hampshire
  • Liked: 1295
  • Likes Given: 1686
Lets say I look at I frame 8. MB 1 (0:0) looks right and is blue water. If we can document the position of this MB in the frame, then lets say some MB (x,y) looks bad and we think it's water we could try replacing it with a known value of a good water MB instead of trying to guess.

Is this a situation where the encoding mechanisms of MPEG-4 would get in the way? As I understand it, MB(x,y) will depend on inputs from MB(x-1,y) or MB(x,y-1), and if you try to drop it in bit-for-bit elsewhere in the image, it won't look the same because what's feeding it won't be the same. Someone more conversant with the encoding can shed some more light on this.
"Ugly programs are like ugly suspension bridges: they're much more liable to collapse than pretty ones, because the way humans (especially engineer-humans) perceive beauty is intimately related to our ability to process and understand complexity. A language that makes it hard to write elegant code makes it hard to write good code." - Eric S. Raymond

Offline meadows.st

  • Full Member
  • *
  • Posts: 152
  • Vancouver BC, Canada
  • Liked: 88
  • Likes Given: 3710
@PaulNY, theshadow27 created something similar to the "bad/good" marking but it was based on ffmpeg errors and other attributes of each mb.  I agree that @mvpel is correct that a direct substitution of a "good" mb for a "bad" one would create scrambled results but I like where you are going on attempting to prevent duplication of effort.

Ok, first try at auto-marking bad MBs based on ffmpeg log output and primitive analysis.

Blocks which were reported as errors by ffmpeg (modified, with debug on) are marked black. Internally, this tracks:
  --  the -1 and -2 override blocks from MBM,
  -- dc clipped at
  -- ac-tex at
  -- dquant at
  -- stuffing at
  -- Error at MB
although these are all painted black as the colors were confusing.

Blocks that were NOT reported as errors but probably are bad are translucent red.
   -- currently tests for the block having less than 5 individual colors.



Next step is to begin (hopefully) intelligent mutation of the MBM string to achieve a better overall score. Sample image is of frame 4 with saliva_sweet MBMs (from wiki).


Edit: Here's the Java source if anyone else wants to play. http://pastebin.com/bKgzCRqD The mammoth inner class at the bottom is for writing the animated gif :)
A little rudder far from the rocks is a lot better than a lot of rudder close to the rocks. L. David Marquet

Offline dorkmo

  • Full Member
  • ****
  • Posts: 677
  • Liked: 306
  • Likes Given: 810
frame 82 and 85 is where the party starts. the iframe before needs a lot of help though :/

my first very bad attempt.
FRAME0:4:1:-1,5:1:-1,20:1:5838,34:2:-1,3:3:-1,0:6:24132,20:10:-1,43:17:66647,
0:18:66647,17:18:-1,32:18:70700,34:18:-1,26:19:75020,31:19:76540=FRAME10:4:16:-1,
18:16:30362=FRAME13:13:15:25802
« Last Edit: 05/22/2014 04:15 AM by dorkmo »

Offline mhenderson

  • Member
  • Posts: 69
  • USA
  • Liked: 101
  • Likes Given: 18
I am not sure what the process / protocol is for posting -mmb results to the progress wiki, so I will leave it here and let you guys do your magic. 

I put **hundreds** of hours into trying to coax detail out of frame 209. My inner voice tells me that a flash of lightning took out wide swaths of the transport stream. These frames are probably the moment of contact with the water, the legs seem to disappear ... but that could be my fault, too. ;) Perhaps someone else with mohr wikid skillz can do these frames better justice.

I am so proud of this team. As I watch the work in progress I see that really difficult stuff gets done right away. Impossible stuff takes a few hours.

Offline Asmegin

  • Member
  • Posts: 35
  • Canada
  • Liked: 21
  • Likes Given: 3
I am not sure what the process / protocol is for posting -mmb results to the progress wiki, so I will leave it here and let you guys do your magic. 

I put **hundreds** of hours into trying to coax detail out of frame 209. My inner voice tells me that a flash of lightning took out wide swaths of the transport stream. These frames are probably the moment of contact with the water, the legs seem to disappear ... but that could be my fault, too. ;) Perhaps someone else with mohr wikid skillz can do these frames better justice.

I am so proud of this team. As I watch the work in progress I see that really difficult stuff gets done right away. Impossible stuff takes a few hours.

I noticed you only used -1's for everything. This removed all of the good stuff as well ie the plume. Don't worry about stray pixels and stuff for now. Just try to match as much detail as possible like the exhaust, the legs, the body of the rocket etc. Isolate each p-frame and look for anything recognizable, and use the furthest point possible place the object (if that makes sense). The first few P-Frames of 209 look decent and probably only need minor cleaning :) It only gets really bad @ 212.
« Last Edit: 05/22/2014 04:38 AM by Asmegin »

Offline michaelni

  • Member
  • Posts: 28
  • Liked: 23
  • Likes Given: 0
Hi all
i updated github with some bugfixes and new features for P frames
-1 and -2 should now work like they do for I frames and allow messing with DC values
-3 results in a skiped block (this is what -1 was effectively before it worked so you have to replace -1 by -3 in old mmbs for P frames)
-4 makes it a inter MB with 1 motion vector

example:
24:10:-4:1:1
30:20:-3

Offline mvpel

  • Full Member
  • ****
  • Posts: 1124
  • New Hampshire
  • Liked: 1295
  • Likes Given: 1686
My inner voice tells me that a flash of lightning took out wide swaths of the transport stream. These frames are probably the moment of contact with the water,

Would the exhaust plume be ionized and able to discharge static to ground, or would you need one of these?



Static Electricity and Aircraft - by Katia Gigliotti
Quote
The accumulation of electrostatic charge, generating during flight on the outer surfaces of aircraft and inside aircraft piping systems, cannot be considered as an immediate danger for flight safety, but it has to be seriously prevented to avoid upset in flight communications and risks of explosion in fuel areas or during refueling operations.
"Ugly programs are like ugly suspension bridges: they're much more liable to collapse than pretty ones, because the way humans (especially engineer-humans) perceive beauty is intimately related to our ability to process and understand complexity. A language that makes it hard to write elegant code makes it hard to write good code." - Eric S. Raymond

Offline mhenderson

  • Member
  • Posts: 69
  • USA
  • Liked: 101
  • Likes Given: 18
@Asmegin.  Thank you, I suspected the -1 were a blunt instrument. I will take another crack at this tomorrow night.

Offline wronkiew

  • Full Member
  • *
  • Posts: 186
  • 34.502327, -116.971697
  • Liked: 105
  • Likes Given: 121
@Asmegin.  Thank you, I suspected the -1 were a blunt instrument. I will take another crack at this tomorrow night.

I am also working on this set, so be sure to grab my mmbs from the wiki (http://spacexlanding.wikispaces.com/Frames+209-228). I look forward to seeing what you find!

Offline arnezami

  • Full Member
  • **
  • Posts: 282
  • Liked: 262
  • Likes Given: 345

Online Chris Bergin

Tweet by Elon: 8)

https://twitter.com/elonmusk/status/469356919979655168



Was woken up by my e-mail notifications acting like an alarm clock! ;D

That's the recognition you guys absolutely deserve for such fine work on this. Well done again!

Offline edfishel

  • Full Member
  • *
  • Posts: 150
  • Liked: 19
  • Likes Given: 66
I loved the Musk recognition of your work NSF and was sure to re-tweet it! ;)

Offline Jester

  • Administrator
  • Senior Member
  • *****
  • Posts: 6931
  • SpaceShip Earth
  • Liked: 3091
  • Likes Given: 112
Wish I had time to help out, but stuck playing with our spacecrafts.

very impressive job guys !
« Last Edit: 05/22/2014 07:31 AM by Jester »

Online Oersted

  • Member
  • Full Member
  • ****
  • Posts: 847
  • Liked: 447
  • Likes Given: 264
Great encouragement of this TEAM EFFORT. Makes no sense to single out individuals, because no individual could have gotten this far on his own. And that's why it has been cool to follow the cooperation. Anyway, it is probably better to keep the eyes on the ball and focus on the remaining work than to start throwing congrats around. They will arrive in due course!

Offline FutureSpaceTourist

  • Senior Member
  • *****
  • Posts: 5690
  • UK
    • Plan 28
  • Liked: 4969
  • Likes Given: 1392
The attention this is getting is very well deserved. Hopefully Elon's tweet will drive even more traffic to NSF  :)

For a new visitor it may not be obvious where to look for this thread? Could there be a non-L2 "What's popular" link from the home page or something?

Offline FutureSpaceTourist

  • Senior Member
  • *****
  • Posts: 5690
  • UK
    • Plan 28
  • Liked: 4969
  • Likes Given: 1392
Currently this thread is the 27th most read SpaceX thread

But  I just noticed it's first for likes  8)

Approaching a 1,000 likes on the thread, can't be many threads on any topic that have reached that milestone!

[Edit: drat, actually currently 2nd, SpaceX lawsuit thread has a few more ... but I suspect not for too long]
« Last Edit: 05/22/2014 08:26 AM by FutureSpaceTourist »

Offline Garrett

  • Full Member
  • ****
  • Posts: 1106
  • France
  • Liked: 104
  • Likes Given: 74
Tweet by Elon: 8)
https://twitter.com/elonmusk/status/469356919979655168
Was woken up by my e-mail notifications acting like an alarm clock! ;D
That's the recognition you guys absolutely deserve for such fine work on this. Well done again!

A massive well done to all involved! Now, get back to work ;)
- "Nothing shocks me. I'm a scientist." - Indiana Jones

Tags: