Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

ARKit and AVCamera simultaneously

Tags:

arkit

As there is no autofocus in ARKit, I wanted to load ARKit in a view that is half the screen and second half will have AVFoundation -> AVCamera. Is it possible to load AVCamera and ARKit simultaneously in same app? Thanks.

like image 240
RadhikaRao Avatar asked Dec 09 '17 04:12

RadhikaRao


People also ask

Does ARKit work with front camera?

Regarding the front-facing camera: in short, no. ARKit offers two basic kinds of AR experience: World Tracking ( ARWorldTrackingConfiguration ), using the back-facing camera, where a user looks "through" the device at an augmented view of the world around them.

Does ARKit use LiDAR?

Overview. On a fourth-generation iPad Pro running iPad OS 13.4 or later, ARKit uses the LiDAR Scanner to create a polygonal model of the physical environment.

Why is ARKit better than the alternatives?

So ultimately the reason ARKit is better is because Apple could afford to do the work to tightly couple the VIO algorithms to the sensors and spend *a lot* of time calibrating them to eliminate errors / uncertainty in the pose calculations.

Do I need an Apple developer account for ARKit?

Before we dive into Unity… Step 1: If you don't already have one, you'll need to create an Apple ID. You can do that here. Step 2: Now you'll need to get Apple's developer tool Xcode, which enables ARKit to do its job. You need version 9 or higher.

What is ARKit 6 4K video?

ARKit 6 introduces the option to capture a 4K video feed using the back camera during an ARKit session. 4K video is perfect for apps that integrate virtual and real-world content together for video creation, such as social media, professional video editing, and film production apps. Requires iPhone 11 or later or iPad Pro (5th generation).

How do I use ARKit 3 features?

To use ARKit 3.0 Features you need to upgrade to ARFoundation 2.2 and upgrade your ARKit packages as well. Keep in mind that since your post XCode and iOS have since had beta updates to beta 5. Also I was incorrect when I stated the latest update to iOS is beta 5 because it's beta 6 now. XCode has remained the same however.

How does ARKit work on the iPhone 12?

AR content realistically passes behind and in front of people in the real world, making AR experiences more immersive while also enabling green-screen-style effects in almost any environment. Depth estimation improves on iPhone 12, iPhone 12 Pro, and iPad Pro in all apps built with ARKit, without any code changes.

How does arlightestimation work in ARKit?

ARKit makes the decision of what form of light estimation to use based on the current ARConfiguration in use. If you use an ARWorldTrackingConfiguration then you will get the standard light estimation values. See ARLightEstimation in the ARKit Docs.


1 Answers

Nope.

ARKit uses AVCapture internally (as explained in the WWDC talk introducing ARKit). Only one AVCaptureSession can be running at a time, so if you run your own capture session it’ll suspend ARKit’s session (and break tracking).

Update: However, in iOS 11.3 (aka "ARKit 1.5"), ARKit enables autofocus by default, and you can choose to disable it with the isAutoFocusEnabled option.

like image 189
rickster Avatar answered Jan 03 '23 23:01

rickster