Rpi camera IMX477

Back to ricbot

Using openCV and IMX477 Pi camera in Debian tixie

From Claude:

Install:

sudo apt install gstreamer1.0-libcamera gstreamer1.0-plugins-base gstreamer1.0-plugins-good libopencv-dev gstreamer1.0-tools

Test with

gst-inspect-1.0 libcamerasrc
gst-launch-1.0 libcamerasrc ! videoconvert ! autovideosink

Gives

local@Sofia:~/svn/ricbot/cam_mqtt/build $ gst-launch-1.0 libcamerasrc ! videoconvert ! autovideosink
Setting pipeline to PAUSED ...
[2:52:21.505489976] [22408]  INFO Camera camera_manager.cpp:340 libcamera v0.7.2+rpt20260817
[2:52:21.516320790] [22419]  INFO RPI pisp.cpp:725 libpisp version v1.7.0 07-08-2026 (09:22:13)
[2:52:21.526665459] [22419]  INFO IPAProxy ipa_proxy.cpp:184 Using tuning file /usr/share/libcamera/ipa/rpi/pisp/imx477.json
[2:52:21.534459901] [22419]  INFO Camera camera_manager.cpp:223 Adding camera '/base/axi/pcie@1000120000/rp1/i2c@80000/imx477@1a' for pipeline handler rpi/pisp
[2:52:21.534487012] [22419]  INFO RPI pisp.cpp:1186 Registered camera /base/axi/pcie@1000120000/rp1/i2c@80000/imx477@1a to CFE  device /dev/media0 and ISP device /dev/media2 using PiSP variant BCM2712_C0
Pipeline is live and does not need PREROLL ...
Got context from element 'autovideosink0': gst.gl.GLDisplay=context, gst.gl.GLDisplay=(GstGLDisplay)"\(GstGLDisplayGBM\)\  gldisplaygbm0";
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
[2:52:21.535126582] [22419]  WARN V4L2 v4l2_pixelformat.cpp:346 Unsupported V4L2 pixel format Nc30
[2:52:21.535149841] [22419]  WARN V4L2 v4l2_pixelformat.cpp:346 Unsupported V4L2 pixel format Nc12
New clock: GstSystemClock
[2:52:22.074110521] [22422]  INFO Camera camera.cpp:1216 configuring streams: (0) 1332x990-SBGGR16/RAW
INFO:
../src/gstreamer/gstlibcamerasrc.cpp(617): gst_libcamera_src_negotiate (): /GstPipeline:pipeline0/GstLibcameraSrc:libcamerasrc0:
CameraConfiguration::validate() returned CameraConfiguration::Adjusted
[2:52:22.074298279] [22419]  INFO RPI pisp.cpp:1502 Sensor: /base/axi/pcie@1000120000/rp1/i2c@80000/imx477@1a - Selected sensor   format: 1332x990-SBGGR12_1X12/RAW - Selected CFE format: 1332x990-BYR2/RAW
ERROR: from element /GstPipeline:pipeline0/GstLibcameraSrc:libcamerasrc0: Internal data stream error.
Additional debug info:
../src/gstreamer/gstlibcamerasrc.cpp(903): gst_libcamera_src_task_enter (): /GstPipeline:pipeline0/GstLibcameraSrc:libcamerasrc0:
streaming stopped, reason not-negotiated (-4)
Execution ended after 0:00:00.539478398
Setting pipeline to NULL ...
Freeing pipeline ...

Supported modes

Printout, when starting rpicam-vid (requesting 2028:1520 resolution):

Mode selection for 2028:1520:12:P(2)
   SRGGB10_CSI2P,1332x990/120.496 - Score: 3456.22
   SRGGB10_CSI2P,2028x1080/74.7384 - Score: 2083.84
   SRGGB10_CSI2P,2028x1520/53.7663 - Score: 1000
   SRGGB10_CSI2P,4056x2160/19.5821 - Score: 1870.84
   SRGGB10_CSI2P,4056x3040/14.0015 - Score: 1887
   SRGGB12_CSI2P,1332x990/101.678 - Score: 2456.22
   SRGGB12_CSI2P,2028x1080/62.8141 - Score: 1083.84
   SRGGB12_CSI2P,2028x1520/45.1855 - Score: 0
   SRGGB12_CSI2P,4056x2160/16.3889 - Score: 870.838
   SRGGB12_CSI2P,4056x3040/11.7185 - Score: 887
   SRGGB8,1332x990/147.907 - Score: 4456.22
   SRGGB8,2028x1080/92.2679 - Score: 3083.84
   SRGGB8,2028x1520/66.379 - Score: 2000
   SRGGB8,4056x2160/24.3214 - Score: 2870.84
   SRGGB8,4056x3040/17.3907 - Score: 2887