Extreme camera jitter on iPhone 14 Pro on iOS 16?

Kang-An · November 11, 2022, 6:26am

The camera feed is extremely jittery when using the new iPhone 14 Pro on iOS 16. This is with the standard AR Camera that’s included in the prefab provided by ARDK. I have no issues with this on an iPhone 12 Pro running iOS 15 as well as all android phones. Has anyone else experienced this?

My guess is that it’s constantly alternating between images from 2 different cameras on the iPhone 14 Pro, because the angle of the image keeps changing

There’s an open issue on Unity’s AR Foundation github that has a similar description of this problem, and for that it seems like it affects iPhone 12 Pro as well on iOS 16. Though there are conflicting reports…

Link to issue: When running on iOS 16 the camera feed is unstable (shaky and jittery) when multi-threaded rendering is enabled · Issue #988 · Unity-Technologies/arfoundation-samples · GitHub

github.com/Unity-Technologies/arfoundation-samples

When running on iOS 16 the camera feed is unstable (shaky and jittery) when multi-threaded rendering is enabled

opened 03:21AM - 16 Jun 22 UTC

AdamBursill-SV

bug fixed arkit

**Unity bug report case number** CASE IN-7240 **Describe the bug** When run…ning on iOS 16 the camera feed is unstable (shaky and jittery) when multi-threaded rendering is enabled **To Reproduce** Steps to reproduce the behavior: Enable multi-threaded rendering and build this samples repo branch 4.1 to an iPhone 12 Pro Max running iOS 16. Open the simple AR scene and start scanning around to generate a few planes, if the camera feed is still stable at this point, lower the application and reopen it. Then the camera feed will go bananas. **Expected behavior** I would expect the camera feed to be stable and usable like previous versions of iOS. **Actual behavior** The camera feed is jumpy and jittery, also when in this state pressing the return button will crash the app. **Smartphone (please complete the following information):** - Device: iPhone 12 Pro Max, also reproduced with iPhone 11 and iPad Pro M1 however they seemed to require more geometry to get into this strange state - OS: iOS 16 - Unity version: 2020.3.35f1 - ARFoundation version: 4.1.10

rob_link · November 11, 2022, 5:56pm

Hello @Kang-An!

This is a known issue as of the 2.3.0 release, and you can resolve the jittery camera feed by navigating to Project Settings > Player > Other Settings and disabling Multithreaded Rendering.

Additionally, you may want to keep an eye on our release notes page here to stay up to date with the latest features and fixes.

Kang-An · November 15, 2022, 4:15am

@rob_link hi rob thanks for the workaround. It does solve my problem for now. Am I right to say that a fix for this should come in future ARDK updates?

rob_link · November 15, 2022, 6:58pm

Yes, the issue of a jittery camera when multithreaded rendering is enabled should be addressed in a future ARDK release.