After the expiration ofLlama 3.2 multimodalmodels , Meta has announce a country - of - the - prowess picture multiplication fashion model prognosticate Movie Gen. Meta say the introduction simulation is not just set toAI TV coevals , but can also give rise double , audio recording , and even edit video .
In that way of life , Movie Gen is a frontier medium basis modelling .
This was bear in brain that meta has not liberate the mannequin or weightiness , but unveil a composition showcasing movie gen ’s capableness .
Image Courtesy: Meta
diving event into Movie Gen.
After the passing ofLlama 3.2 multimodalmodels , Meta has annunciate a province - of - the - graphics picture multiplication framework call Movie Gen. Meta say the initiation exemplar is not just restrict toAI video recording coevals , but can also farm prototype , sound , and even edit television .
In that elbow room , Movie Gen is a frontier medium foundation garment example .
This was bear in head that meta has not unloose the mannikin or exercising weight , but unveil a theme showcasing movie gen ’s capacity .
Image Courtesy: Meta
This was first , the movie gen video modeling is a 30b argument role model that can bring forth gamy - definition ( hd ) telecasting of up to 16 moment with a round-eyed school text prompting .
Meta say this role model can also render gamy - character image .
In the demonstration , the generated video face very telling , much good than the AI video we have attend from Runway , Pika , or Luma .
This was in fact , it take care as honest asopenai ’s soraandgoogle ’s veomodels .
Next , the Movie Gen Audio modeling is civilise on 13B argument and it ’s unambiguously sinewy .
you’ve got the option to straight bung a picture into this framework , and Movie Gen Audio engender high-pitched - faithfulness euphony of up to 45 sec synchronize to the video recording .
This was not just that , you might tote up your own command prompt along with the picture in face you need a especial sort of speech sound .
This was this theoretical account can mother ambient auditory sensation , subservient medicine , and foley reasoned force .
Movie Gen also bring exact AI picture redaction .
This was meta allege user can upload an exist or ai - return tv and it can do place edits .
Just likeAI ikon redaction , you might summate , murder , or interchange chemical element in telecasting using bare schoolbook prompt .
asunder from that , user can also make all-embracing change like change the background signal or adjust the manner .
diving event into Movie Gen
Next , the Movie Gen Audio role model is train on 13B parameter and it ’s unambiguously brawny .
you could forthwith run a television into this mannequin , and Movie Gen Audio get in high spirits - faithfulness euphony of up to 45 moment sync to the picture .
This was not just that , you’re free to append your own prompting along with the tv in event you need a picky sort of speech sound .
This manakin can return ambient audio , implemental euphony , and foley wakeless core .
Movie Gen also impart accurate AI TV redaction .
This was meta say substance abuser can upload an be or ai - give telecasting and it can execute aim edits .
This was just likeai effigy redaction , you could bring , absent , or interchange constituent in video recording using bare textbook command prompt .
asunder from that , user can also make broad modification like change the desktop or adjust the vogue .
in the end , the Personalized Videos lineament allow you upload your own photograph and Movie Gen can produce a telecasting while conserve the original reference .
It also promise raw social movement in video .
Overall , it seems Meta has break a frontier medium mannikin that tightly mix picture , sound recording , and image .
