Add QR Code Scanning to ARKit in real-time

I need ARKit to be able to detect an image to create anchor for SceneKit scene and ALSO scan for QR Codes using Vision framework. The QR Code will deliver a string value that will be used to update the image texture in the scene.

1. use ARKit to detect an image (see [login to view URL]) and

2. use that as an anchor for a basic SceneKit Scene (see [login to view URL]) AND

3. use the Vision framework to also scan a QR Code (VNDetectBarcodesRequest) to update the texture image in the scene with its payload value. QR COde reads [login to view URL] then the texture displayed will be [login to view URL] if it reads [login to view URL] it will display texture [login to view URL] on SceneKit Plane. (see ImageForDetection for QR Code placed next to ARTracking image).

Currently i have it coded to create an anchor for the ARKit image and display a scenekit file/scene with the same name, but need to be able to dynamically display different images depending on the QR code. (see [login to view URL])

I have attached a screenshot showing an example image that could be used - there would be a larger image used for the ARkit image detection, and a QR code within or beside it - so if you scan the image the scene will pop up right away, but if you zoom in closer to the QR code, it will update the scene image texture. (See additional screenshot showing scene kit scene with Diffuse image texture).

Apple has a good demo app showing vision being used in realtime with ARKit - but it's being used for image classification and not Barcode Detection (qr).

[login to view URL]

This shows partial implementation of Vision QR Code reader in ARKit, but I don't want to use QR Code for image tracking or image anchors - only to deliver string value from QR Code payload: [login to view URL]

Apple Xcode ARKit Mobile App Development Swift

Project ID: #18697928

About the project