Upvote Upvoted 23 Downvote Downvoted
1 2
someone interpolate PREM - by CUBE using AI
posted in Videos
1
#1
0 Frags +

someone interpolate PREM - by CUBE into 60fps using AI.
i dont have the hardware required to run this program

i think you need a recent nvidia graphics card

heres the application: https://grisk.itch.io/dain-app

heres the source video for PREM - by CUBE thats linked in the frag vid's youtube description:
http://tinyurl.com/CUBE-premmovie

someone interpolate PREM - by CUBE into 60fps using AI.
i dont have the hardware required to run this program

i think you need a recent nvidia graphics card

heres the application: https://grisk.itch.io/dain-app

heres the source video for PREM - by CUBE thats linked in the frag vid's youtube description:
http://tinyurl.com/CUBE-premmovie
2
#2
-19 Frags +

please do not do this 60 fps interpolated videos look god awful

please do not do this 60 fps interpolated videos look god awful
3
#3
2 Frags +
2Melonplease do not do this 60 fps interpolated videos look god awful

have you seen examples of this new method? looks good to me

edit: look at this example https://www.youtube.com/watch?v=sFN9dzw0qH8

[quote=2Melon]please do not do this 60 fps interpolated videos look god awful[/quote]
have you seen examples of this new method? looks good to me

edit: look at this example https://www.youtube.com/watch?v=sFN9dzw0qH8
4
#4
5 Frags +

i will do it tonight. i think a 2080 should be able to do it?

i will do it tonight. i think a 2080 should be able to do it?
5
#5
newbie.tf
16 Frags +

Trying to do this now. Will let y'all know if it doesn't work.

https://i.imgur.com/QcaJ8M5.png

E: lol it sounds like my gfx card is about to take flight
E2: apparently my 16 core w/ good nvidia card SPECIFICALLY BUILT TO EDIT AND RENDER VIDEO does not meet requirements for cuda memory without making the split up sections tiny. glhf @carter

Trying to do this now. Will let y'all know if it doesn't work.

[img]https://i.imgur.com/QcaJ8M5.png[/img]

E: lol it sounds like my gfx card is about to take flight
E2: apparently my 16 core w/ good nvidia card SPECIFICALLY BUILT TO EDIT AND RENDER VIDEO does not meet requirements for cuda memory without making the split up sections tiny. glhf @carter
6
#6
0 Frags +
KevinIsPwnglhf @carter

what are your specs before i bother?

also, do you have any idea how big the chunks would need to be split up into? I might be able to queue them and run it overnight

[quote=KevinIsPwn]glhf @carter[/quote]

what are your specs before i bother?

also, do you have any idea how big the chunks would need to be split up into? I might be able to queue them and run it overnight
7
#7
newbie.tf
0 Frags +
carterKevinIsPwnglhf @carter
what are your specs before i bother?

also, do you have any idea how big the chunks would need to be split up into? I might be able to queue them and run it overnight

My bottleneck is definitely GPU, I have a 970 w 4gb. 32gb ram

[quote=carter][quote=KevinIsPwn]glhf @carter[/quote]

what are your specs before i bother?

also, do you have any idea how big the chunks would need to be split up into? I might be able to queue them and run it overnight[/quote]
My bottleneck is definitely GPU, I have a 970 w 4gb. 32gb ram
8
#8
2 Frags +

After waiting 20 mins for the frames to be split to the default size I'm getting a 40 hour estimate.

This is with 8gb 1070ti, i7 6700 and ddr3 ram

After waiting 20 mins for the frames to be split to the default size I'm getting a 40 hour estimate.

This is with 8gb 1070ti, i7 6700 and ddr3 ram
9
#9
3 Frags +

So far so good, still splitting the video into frames, but its spitting them out at about 30-50 files per second, so depending on what the rest of the process entails this seems completely doable. will update later

edit: i now have 18,000ish images but the program is telling me I need 10-11gb minimum VRAM to render it in 720p. anyone with a quadro station wanna have a crack at it?

So far so good, still splitting the video into frames, but its spitting them out at about 30-50 files per second, so depending on what the rest of the process entails this seems completely doable. will update later

edit: i now have 18,000ish images but the program is telling me I need 10-11gb minimum VRAM to render it in 720p. anyone with a quadro station wanna have a crack at it?
10
#10
-38 Frags +

is a old fragmovie really worth all of this effort lol

is a old fragmovie really worth all of this effort lol
11
#11
45 Frags +
CitroMaindis a old fragmovie really worth all of this effort lol

blasphemy

[quote=CitroMaind]is a old fragmovie really worth all of this effort lol[/quote]
blasphemy
12
#12
serveme.tf
22 Frags +

https://i.imgur.com/XE54J8C.png

The coils in this workstation are making some interesting sounds....

[img]https://i.imgur.com/XE54J8C.png[/img]

The coils in this workstation are making some interesting sounds....
13
#13
59 Frags +
CitroMaindis a old fragmovie really worth all of this effort lol

at this point its less about the video and more about who can flex the most powerful machine

[quote=CitroMaind]is a old fragmovie really worth all of this effort lol[/quote]


at this point its less about the video and more about who can flex the most powerful machine
14
#14
2 Frags +

i am now very excited to see this video in 60fps

i am now very excited to see this video in 60fps
15
#15
11 Frags +

I have access to a v100 for a week, I might do it tonight.

I have access to a v100 for a week, I might do it tonight.
16
#16
2 Frags +

seems like rly cool technology but not gonna lie, there really needs to be a way for it to adapt and recognize cut transitions cuz they look kinda shit (go to 0.25 speed in the lego example and you can see instead of just going between one scene and the other it like blooms out sort of)

in the example video there's a bit of artifacting too where it doesn't quite interpolate it correctly, would be curious to see how it does with tf2 but my guess is it might be harder to do than these super simple stop motion shots and result in more errors

seems like rly cool technology but not gonna lie, there really needs to be a way for it to adapt and recognize cut transitions cuz they look kinda shit (go to 0.25 speed in the lego example and you can see instead of just going between one scene and the other it like blooms out sort of)

in the example video there's a bit of artifacting too where it doesn't quite interpolate it correctly, would be curious to see how it does with tf2 but my guess is it might be harder to do than these super simple stop motion shots and result in more errors
17
#17
serveme.tf
45 Frags +
bearodactylin the example video there's a bit of artifacting too where it doesn't quite interpolate it correctly, would be curious to see how it does with tf2 but my guess is it might be harder to do than these super simple stop motion shots and result in more errors

The AI really fails at the PREM intro, but the 60FPS video overall looks quite nice, hard to watch the 30FPS version again. The killfeed looks a little weird with certain movements and the crosshair goes wonky every now and then too, specifically when rocket jumping.

I've sent CUBE the finished 60FPS version and asked for his approval to share it here.

[quote=bearodactyl]in the example video there's a bit of artifacting too where it doesn't quite interpolate it correctly, would be curious to see how it does with tf2 but my guess is it might be harder to do than these super simple stop motion shots and result in more errors[/quote]

The AI [url=http://fakkelbrigade.eu/i/mpc-hc64_SgQUj0tY0F.png]really fails at the PREM intro[/url], but the 60FPS video overall looks quite nice, hard to watch the 30FPS version again. The killfeed looks a little weird with certain movements and [url=http://fakkelbrigade.eu/i/mpc-hc64_JqtqyKrc3G.png]the crosshair goes wonky[/url] every now and then too, specifically when rocket jumping.

I've sent CUBE the finished 60FPS version and asked for his approval to share it here.
18
#18
whitelist.tf
2 Frags +

So this AI smoothing is better than butterflow, or at least with a better result over speed?

Apparently doesn't take too long on a GTX970 with the aforementioned tool, it just doesn't have audio, so that's easily fixed with mkvtoolnix/ffmpeg cli

---
Ran a 60fps one, also doing a 120fps one for comparison, if arie gets permission from cube and shares his file could use ffmpeg to tile them so you can compare side by side.

Update: The 60fps one is fine, the 120fps has a super jittery crosshair on movement, the slomo SFMs look super good though

So this AI smoothing is better than [url=https://github.com/dthpham/butterflow]butterflow[/url], or at least with a better result over speed?

Apparently doesn't take too long on a GTX970 with the aforementioned tool, it just doesn't have audio, so that's easily fixed with mkvtoolnix/ffmpeg cli

---
Ran a 60fps one, also doing a 120fps one for comparison, if arie gets permission from cube and shares his file could use ffmpeg to tile them so you can compare side by side.

Update: The 60fps one is fine, the 120fps has a super jittery crosshair on movement, the slomo SFMs look super good though
19
#19
17 Frags +

cube hurry up and say yes

cube hurry up and say yes
20
#20
14 Frags +

bumping every 3 days until i watch the video

bumping every 3 days until i watch the video
21
#21
3 Frags +

just unlist it :)

just unlist it :)
22
#22
serveme.tf
47 Frags +

Enjoy, if you have to watch on Youtube, use 1440p60 due to Youtube's bitrates.

https://www.youtube.com/watch?v=906spinekm0

Download

Enjoy, if you have to watch on Youtube, use 1440p60 due to Youtube's bitrates.

[youtube]https://www.youtube.com/watch?v=906spinekm0[/youtube]

[url=http://fakkelbrigade.eu/arie/60fps_PREM_by_CUBE_1440p_audio.mkv]Download[/url]
23
#23
8 Frags +
ArieEnjoy, if you have to watch on Youtube, use 1440p60 due to Youtube's bitrates.

https://www.youtube.com/watch?v=906spinekm0

Download

holy fuck you are insane man

[quote=Arie]Enjoy, if you have to watch on Youtube, use 1440p60 due to Youtube's bitrates.

[youtube]https://www.youtube.com/watch?v=906spinekm0[/youtube]

[url=http://fakkelbrigade.eu/arie/60fps_PREM_by_CUBE_1440p_audio.mkv]Download[/url][/quote]
holy fuck you are insane man
24
#24
3 Frags +
ArieEnjoy, if you have to watch on Youtube, use 1440p60 due to Youtube's bitrates.

https://www.youtube.com/watch?v=906spinekm0

Download

that's actually amazing

[quote=Arie]Enjoy, if you have to watch on Youtube, use 1440p60 due to Youtube's bitrates.

[youtube]https://www.youtube.com/watch?v=906spinekm0[/youtube]

[url=http://fakkelbrigade.eu/arie/60fps_PREM_by_CUBE_1440p_audio.mkv]Download[/url][/quote]
that's actually amazing
25
#25
5 Frags +

damn i didn't expect it to be so good, gj

damn i didn't expect it to be so good, gj
26
#26
whitelist.tf
6 Frags +

So that's upscaled from 720p to 1440p and doubled the frame-rate, impressive!

Rip the crosshair flicker and occasional issue with killfeed, but insane that this was even possible!

So that's upscaled from 720p to 1440p and doubled the frame-rate, impressive!

Rip the crosshair flicker and occasional issue with killfeed, but insane that this was even possible!
27
#27
3 Frags +

downloading this rn

edit: wow

downloading this rn

edit: wow
28
#28
1 Frags +

id love to see a ton of old frag movies interpolated and restored

https://youtu.be/wDwu4uNTZc4 next?

id love to see a ton of old frag movies interpolated and restored

https://youtu.be/wDwu4uNTZc4 next?
29
#29
whitelist.tf
3 Frags +
loafeid love to see a ton of old frag movies interpolated and restored (Pop Culture - by Cla next

The original video upload has a download link in the description, which is dead unfortunately.

However IGMDB has a 720p 30fps upload!

[quote=loafe]id love to see a ton of old frag movies interpolated and restored ([url=https://youtu.be/wDwu4uNTZc4]Pop Culture - by Cla[/url] next[/quote]
The [url=https://www.youtube.com/watch?v=Ii4mWZRLHH4]original video upload[/url] has a download link in the description, which is dead unfortunately.

However [url=https://www.igmdb.org/?m=1763]IGMDB[/url] has a 720p 30fps upload!
30
#30
serveme.tf
16 Frags +
loafeid love to see a ton of old frag movies interpolated and restored

https://youtu.be/wDwu4uNTZc4 next?
Wiethoofdloafeid love to see a ton of old frag movies interpolated and restored (Pop Culture - by Cla nextThe original video upload has a download link in the description, which is dead unfortunately.

However IGMDB has a 720p 30fps upload!

Cheers for that link Wiethoofd.

https://www.youtube.com/watch?v=iwRc-BWAhws

Download

[quote=loafe]id love to see a ton of old frag movies interpolated and restored

https://youtu.be/wDwu4uNTZc4 next?[/quote]
[quote=Wiethoofd][quote=loafe]id love to see a ton of old frag movies interpolated and restored ([url=https://youtu.be/wDwu4uNTZc4]Pop Culture - by Cla[/url] next[/quote]
The [url=https://www.youtube.com/watch?v=Ii4mWZRLHH4]original video upload[/url] has a download link in the description, which is dead unfortunately.

However [url=https://www.igmdb.org/?m=1763]IGMDB[/url] has a 720p 30fps upload![/quote]

Cheers for that link Wiethoofd.

[youtube]https://www.youtube.com/watch?v=iwRc-BWAhws[/youtube]

[url=http://fakkelbrigade.eu/arie/60_FPS_PopCulture_1440p.mkv]Download[/url]
1 2
Please sign in through STEAM to post a comment.