Raspberry Pi based video gear

wednesdayayay · June 3, 2020, 12:01pm

This is a wiki feel free to add by editing this post

Hardware to get you started

raspberry pi 3b
USB keyboard
microsd card
MIDI controller - korg nanokontrol 2 or 1 work well
USB thumb drive
USB camera - this is what I use works across the devices
USB input device - this one works across all devices for me
composite output cable - this isn’t the one I bought but I can’t seem to find it anymore sometimes you may have to use the red output instead of the yellow if you are having trouble
raspberry pi power supply - look for 5.25v or else you’ll end up seeing the low power lightning bolt show up on the RPI

General setup overview

all the githubs will have information about how to put together your synth
essentially you will be doing one of two things

1 Slower

download an image
burn it onto a microSD card
put microSD card into your RPI
plug hardware (webcam, keyboard, output etc…) into RPI
turn it on
play

this can take a long time depending on your internet provider as the file is at least a couple gigs

2 Faster

after having already done #1 previously
download source from github to RPI
put download in the myapps folder of openframeworks
“cd” to openframeworks folder where app resides via terminal
“make” via terminal
“make run” via terminal

you can also setup a .sh script like this in order to cut out the last three steps of 2

you could setup the above script to move the download for you too. I’ll have to mess with that and double check it but will post it up here once I do. If that works then you’ll be able to cut out the last four steps of 2

and then setup a .sh like this to keep on the desktop to facilitate easy switching between apps

@respirator

Scrawl

scrawl5

Scrawl is a standalone RGBA shape generator/positioner/video painting/slit scanner with MIDI/keyboard and mouse control for the Raspberry Pi (currently using 3b+(old hardware version)/3b).

if you are loading the latest image it will include several other apps installed (all also listed here) with .sh files on the desktop to switch between them (press escape to get to the desktop once it has booted)

github
new tutorial
old tutorials
instagram
Image compressed (mac) (says spread.iso instead of scrawl.iso)
Image non compressed (windows)

Spread

this colorizer was originally based off one from R_E_C_U_R it has grown considerably now!

the format moving forward is two multi mode colorizers mixed via video mixer with many modes

image file is the same as scrawl for now just press escape once booted and switch to spread via the spread.sh file on the desktop

@andrei_jay

Spectral_Mesh

a scan processing inspired video resynthesizer for the waaave pool rpi distro

Waaave_pool

waaavepool_splashscreen_final
a port of video_waaaves to raspberry pi

Chromatic_aberration1_the_search_for_sasquatch

a helpful 4 band colorizer/solarizer specially optimized for filming bigfoot

SUPER_HAECKEL_ADVENTURES_64

A superformula based freeware video synth for the waaave_pool raspberry pi distro

Phosphorm

an audio visual synthesizers optimized for x-y oscilloscope displays for the waaave pool distro

@melt_dream

Strange loop

The Strange Loop is a digital feedback processor based on openFrameworks and the Raspberry Pi.

github
Etsy
instagram not all related

@cyberboy666

r_e_c_u_r

an open diy py/pi based video sampler

Recurboy

a pi0 video-instrument designed for diy workshops

ofxPiMapper

projection mapping software that runs on the Raspberry Pi

Super Pikix Pi

A software to mix videos on the Raspberri Pi computer

bzzzbz

video synthesizer that dynamically reacts to an audio input to create images and visuals that can be manipulated for integrated audio-visual performances.

github

outoftunewolf · March 28, 2021, 7:22am

I want to teach my class how to build a pi based synth this next school year. The plan is to set up the students with a starter pack and i’m trying to decide which Rasp Pi to use. Which pi is the most versatile? Thanks

wednesdayayay · March 28, 2021, 9:46am

in the build guid it shows which pi (3b) to use the rp4 does not work with openframeworks at least last time I checked.
so if you are wanting to use any of this stuff you don’t have much of a choice on which pi to use
have you built any of these yet?

outoftunewolf · March 28, 2021, 10:01am

i had read this but wanted to make sure from the more experienced crowd that it was still the case. Thanks

jmsiener · April 3, 2021, 4:41am

This is a fantastic bunch of links, thank you for compiling and documenting; A++++

Random question that I feel like fits in this thread, would one of these CSI-HDMI bridge modules work as an HDMI in lieu of a camera? Has anyone tried that combo?

I’ve been digging r_e_c_u_r plus I have a fates running eyesy and I’m thinking it would be cool to get fates as input. Love the camera but I feel like I can only stare at my face for so long.

cyberboy666 · April 3, 2021, 7:14am

hi @jmsiener - i have one of those hdmi to csi bridges, but havnt tried it yet (with recur)… maybe it works , or can be added in future updates. also there are quite cheap hdmi to usb dongles that many people are using as input into rpi (including recur) , or composite to usb ones like easycaps also work as video input , although bit glitchy

cata · April 25, 2021, 3:29pm

I’m glad I read through this! I’ve only got a few Raspberry Pi 4’s laying around so I would have wasted a bunch of time trying to figure out why they wouldn’t work

wednesdayayay · April 25, 2021, 4:01pm

I haven’t looked into running openframeworks on the RPI in a while I know plenty of smart people are trying to make it happen.

rpis are so rad

andrei_jay · April 25, 2021, 8:41pm

to be clear, most oF stuff works great on pi 4, the issuee is with gl stuff which renders shaders a bit of a wormhole to work with. unfortunately shaders are kind of the killer app of doing video processing on pis

almostnotquite · May 27, 2021, 10:42pm

Hey… I am trying to use the Rpi image for Scrawl, Spread, Spectral_Mesh etc. but when I run the .sh files to run anything other than Scrawl it runs in a small window not fullscreen - what am I doing wrong? Is it because I’m using HDMI?

wednesdayayay · May 28, 2021, 12:59am

It may be. I’ve never tried using the HDMI out instead of composite

almostnotquite · May 28, 2021, 6:59am

My CRT is in storage at the moment so I’ll have to give it a go when I can get that out. Unless anybody has a suggestion for getting the others to open the same size as scrawl?

zawa · August 23, 2022, 5:12pm

Recently became aware that resources exist to put together a DIY version of Critteri & Guitari’s EYESY video synth using a Raspberry Pi 4. (PIESY? DIYesy?) It’s the same OS, so all the functionality of the original should be there. Just needs a PiSound hat for audio input and a midi controller for adjusting parameters.

The EYESY’s always been something I’ve wanted to get my hands on but haven’t been able to afford, so this should be a fun build. I think many people here would dig knowing that this info is out there:

cyberboy666 · August 23, 2022, 5:23pm

@zawa that is awesome thanks for sharing !

zawa · August 23, 2022, 5:36pm

Here’s another guide for the PIESY build which features a much cheaper AudioInjector sound module instead of the PiSound (~$23 vs ~$100). Probably the way to go for the most affordable EYESY.

TubularCorporation · August 24, 2022, 3:01am

I should see about getting this running with a HifiBerry DAC+ADC, since that’s what I have. The raw output of the Eyesy has always looked kind of samey and uninspiring to me, TBH (and I’m sure there’s plenty of potential for more interesting stuff, I’m jsut talking about the demos I’ve seen), but it would be useful as an input source into the whole network of parallel feedback loops and things my setup’s built around.

zawa · August 25, 2022, 3:38pm

I should see about getting this running with a HifiBerry DAC+ADC, since that’s what I have.

Would also be interested in this potential compatibility, as well as if there’s any performance differences of running EYESY OS on a Pi3 versus a 4, since I’ve got a spare VSERPI unit with a HiFiberry hat already on it and would save me from buying an audio hat for my 4. Shame that it’s still such a pain to find new Pis in general, gotta make some decisions about how to best use the handful I’ve got. Agreed that the EYESY on it’s own isn’t that impressive from the demos, but as a tool for mixing in audio reactive shapes and patterns and stuff, it has cool utility for holding down some dynamic elements during live shows while part of a larger chain.

Hopefully the lower barrier to entry with DIY builds will enable a more active community of people sharing custom patches and stuff. That’s honestly the most exciting part about the EYESY to me.

TubularCorporation · August 25, 2022, 5:16pm

I think the Hifiberry hat should work on the Pi4. That’s my plan for now, anyway - take it off of the Pi3 that I was running AutoWaaave on (I’m probably going to use a different VSERPI program on it for a while, and if I reallyneed audio reactivity the audio input on the capture dongle works well enough even if it’s noticeably less responsive than when I use the Hifiberry) and the Pi 4 is going to be a multi-use thing that I can swap cards on depending on what I need it for.

I don’t see any reason why the Hifiberry WOULDN’T work, as far as I can tell from skimming the links above, the audio interface part of it just boils down to “set up your interface according to the manufacturer’s instructions, and then disable the Pi’s onboard audio and make usre your interface is the default.” I’ve got a buch of stuff to get out of the way before I have time for that, but hopefully in 2 or 3 weeks I’ll sit down and see what I can do. If I like it enough, maybe I’ll track down an Arduino Nano and make a little USB controlelr that copies the layout of the official Eyesy, rather than using a Nanokontrol where 75% of the controls aren’t even necessary.

zawa · August 25, 2022, 6:57pm

Also trying to think of adequate solutions for a midi controller that doesn’t use more space than it needs to. Was thinking about trying my hand at remapping the knobs on a Korg Kaoss DJ that I don’t use much anymore. Haven’t ever tried going in there and messing with MIDI CCs on any device except a NanoKontrol 2 so not sure if it’d actually work but here’s to hoping that the kaoss pad on it might be useful for implementing some crazy fx with a PIESY, at the very least on the audio reactive end if it’s too much of a pain to automate the kaoss touchpad presets to send MIDI out commands.

jmsiener · August 25, 2022, 7:54pm

I always used a 16n for midi control with Eyesy on my fates. Easy to remap, big ol faders, easy to remember what’s assigned where.