Questions tagged [arkit]
Apple ARKit is Augmented Reality SDK introduced in iOS 11.0, which integrates the iOS or visionOS device RGB camera data, Motion Sensor data and LiDAR Scanner data to produce robust AR experiences.
3,302
questions
0
votes
0
answers
7
views
Plane Detection for L-shaped surfaces In Unity using ARKit
I want to use ARKit in unity to do plane detection with an IPhone. The goal is to use this in a classroom and identify the surfaces of the tables. I set up everything in unity and wrote a script to ...
1
vote
1
answer
108
views
How to know user's position in Surrounding Space in visionOS
Working on user position tracking in visionOS within Immersive Space. Any insights or tips to navigate this? Docs seem elusive at the moment. I searched and found queryPose but Xcode throws error.
...
1
vote
1
answer
124
views
Can't find/implement a Experience.rcproject (Reality Composer) in my RealityKit project
I need to create a .rcproject file to implement 3D models for my application.
When I create a file with the Augmented Reality template in Xcode, it was supposed to have 3 files:
AppDelegate.swift;
...
1
vote
0
answers
39
views
Flutter/ARKit - Show node on GPS location
Would like to show object on GPS location using ARKit in Flutter. I get my position from Geolocator.getCurrentPosition. Then I calculate distance and bearing also using Geolocator
double distance = ...
0
votes
0
answers
39
views
FPS drop in RealityKit while updating the ModelEntity's position
I have a performance issue when updating ModelEntity's position.
There are two models with the same parent:
arView.scene.add(anchorEntity)
anchorEntity.addChild(firstModel)
anchorEntity.addChild(...
0
votes
0
answers
12
views
In Swift and ARKit is it possible to create a 2D object with an non-smooth edge programmatically?
This may be a silly question so be kind. I've been messing around with ARKit and I'm able to create objects programmatically like circles, squares, rectangles, etc. I'm wondering if it's possible to ...
1
vote
1
answer
83
views
In Reality Composer, how can I stop a sound?
Say I have 2 buttons, each triggers a piece of music.
How do I have Button A stop the music that was triggered by Button B and vice versa?
Not seeing the option for Sound, Music, or Ambience.
0
votes
0
answers
16
views
How to load ARWorldMap from different positions?
Here's what I need to achieve: The user must scan and save their rooms with some AR objects. Then, upon relaunch, the application needs to automatically restore the ARSession with the properly ...
-1
votes
0
answers
25
views
Initializer for conditional binding must have Optional type, not 'SCNNode' ARKit
//ARFace geometry update
func renderer(_ renderer: SCNSceneRenderer, didUpdate node: SCNNode, for anchor: ARAnchor) {
guard let faceAnchor = anchor as? ARFaceAnchor,
let ...
0
votes
0
answers
19
views
How to capture image when Face detect in centre with ARKit in iOS swift?
I have used ARKit with ARFaceTrackingConfiguration to detect face using below code
let configuration = ARFaceTrackingConfiguration()
configuration.isLightEstimationEnabled = true
...
-1
votes
1
answer
117
views
How to author a Reality File?
How do we author a Reality File like the ones under "Examples with animations" at https://developer.apple.com/augmented-reality/quick-look/ ??
For example, "The Hab" : https://...
0
votes
0
answers
49
views
SCNSceneRendererDelegate Update function not called from UI thread in MAUI
In MAUI, I am trying to do a HitTest in the Update function of the SCNSceneRendererDelegate class.
The problem is that the Update function is called from a background thread which results in a UIKit ...
1
vote
1
answer
49
views
ARCore in "orientation-only" mode
I am working in water environment where there is no possibility to use tracking proprerly.
In ARKit I could set AROrientationTrackingConfiguration instead of ARWorldTrackingConfiguration to switch to ...
0
votes
1
answer
78
views
How can I use a SceneKit Mesh in RealityKit?
I have SceneKit code that generates 3D Meshes stored as SCNGeometry objects:
geometry = SCNGeometry(sources: [vertexSource, normalSource, texCoordSource], elements: elements)
I am porting my code to ...
0
votes
0
answers
50
views
Read GLB file with Draco and MeshCompression extensions
I want to read .glb file it has compressed file from .gltf, GLTF file was reading from GLTFScenekit and GLTFKit2 libraries. But after compressed to glb it wasn't reading and getting crashed.showing ...
0
votes
0
answers
24
views
ARKit and SwiftUI - Performance Overlay Issue
I'm trying to get started with ARKit in SwiftUI. But I'm unable to turn off this text that appears over the View. Does anyone know what the name of this text is and how I can toggle it off? It doesn't ...
0
votes
0
answers
38
views
iOS ArKit Tracking - the whole scene is drifting away
I'm using ArKit with Metal in my ios app without other frameworks like ARSCN. Sometimes the whole scene is drifting away, then it sort of comes back but far from the original place. I don't see this ...
0
votes
1
answer
77
views
Assign 2d Virtual image to SCNShape drawn using bezierpath
I have the drawBtn to draw sphere on the plane , then i have the lineNode , that continuously updates the line position according to the user camera so that they might know where they want to add ...
0
votes
0
answers
64
views
The AR malfunctions when I change tabs
I'm encountering an issue with ARView, where it seems to be malfunctioning when I switch between tabs in my application. I've implemented ARView in my project, and it works perfectly until I change ...
0
votes
0
answers
43
views
How to calculate the dimensions of the 3D object from MeshAnchor.Geometry?
From the Apple visionOS ARKit scene reconstruction, we can get the geometry of the 3D objects: MeshAnchor.Geometry.
I have tried calculating the bounding box of it but had no success.
How could we ...
0
votes
0
answers
30
views
Finding device heading with ARKit and ARGeoTrackingConfiguration
I am working on an app where I need to orient a custom view depending on the device heading. I am using ARKit and ARSCNView with the ARGeoTrackingConfiguration in order to overlay my custom view in ...
0
votes
0
answers
27
views
How do we delete our apps "Data & Documents" when developing on Unreal Engine for iOS?
We published an app for iOS which accidentally stores a ton of photos in "Data & Documents". The app is live on the App Store, but currently the only way for a user to delete this bloat ...
1
vote
0
answers
61
views
How to trigger scene custom behaviour in Xcode 15
I'm working on an AR App. With Reality Composer and Xcode 14 I was triggering custom behaviours from with just:
myScene.notifications.myBox.post()
called from
let myScene = try! Experience.loadBox()
...
0
votes
0
answers
57
views
SceneKit SCNMaterial transparency texture doesn't work properly with physicallyBased lighting model
I have an IOS ARKit/Scenekit view, I have an SCNMaterial like this:
material = SCNMaterial()
material.diffuse.contents = UIColor(.blue)
material.transparent.contents = "art.scnassets/transTex.png&...
1
vote
0
answers
43
views
Convert ARDepthData to AVDepthData with float32 or depth32 disparity
I want to create a 3D model with Photogrammetry Session. It's working fine with AVCaptureSession with Depth Data. But I want to capture a series of frames from ARKit and sceneDepth which is of type ...
1
vote
0
answers
41
views
I want to show a specific AR marker on a specified location(latitude,longitude)
I am using arcore_flutter_plugin: ^0.1.0 , flutter to develop the application. I am able to display basic 3d shapes on my screen but I am not able to display the marker fixed to a geolocation(lat,long)...
0
votes
1
answer
88
views
How to Implement Modular Animation Chunks in RealityKit/ARKit for Efficient Animation Blending?
I am working on an AR application using RealityKit and ARKit where I need to implement character animations that are highly modular. The goal is to break down complex motions into smaller, reusable ...
0
votes
2
answers
84
views
PhysicallyBasedMaterial always render specular/shine
I'm messing around with RealityKit's new custom material to write my own fragment/surface shader. Everything's okay and I can finally write my own shader to render my procedural vfx on a simple plane ...
0
votes
0
answers
23
views
how to Assign Image to Custom Drawn SCNShape
I have drawn some 2D spheres and added them in the Nodes Array, then I used cylinderNodes to connect the sphere Nodes, It forms a Closed Shape. What I want here is to assign an image to this closed ...
0
votes
0
answers
47
views
Collision handling between the entity and the real environment in RealityKit
I'm trying to achieve a similar behaviour to the native AR preview app on iOS when you can place an object and once you move or rotate it, it automatically detects the obstacles and gives you a haptic ...
1
vote
0
answers
28
views
Detect object touching or blocking front sensors on iPhone—without using camera
I’m looking to detect when an object is blocking the front sensor region on an iPhone. I have identified a potential solution that uses the front-facing camera to determine overall average luminance (...
3
votes
1
answer
170
views
SceneKit/ARKit - Rendering a depth map of scene?
I have a scene containing SCNNode models, and a camera.
I'd like to generate a depth map render of my scene (from perspective of camera) - something like this:
How can this be achieved? Currently ...
0
votes
0
answers
50
views
How to get the physical size - width,height of captured image?
I'm using ARKit and need to count physical size of captured image, for now I'm only have distance from camera to object.
One of my idea was to have Max top point and Max bottom so then with hitTest I ...
0
votes
0
answers
51
views
ARKit or RealityKit – How can we detect a real world object to make an app like iphone default measurement app?
i want to make an app exactly like iphone default measurement app in swiftui. I am succeeded in measuring the distance between one entity to another. But i want to detect a real world object what to ...
0
votes
0
answers
37
views
ARKit sceneView.projectPoint return incorrect value
The essence of the problem is that if you rotate the device along the Y axis, for example, to the right, then at some point the object that is to the left of the device, the X value from negative ...
0
votes
1
answer
21
views
How to keep track of only one image in ARKit Image detection
I’m building an image tracking app which displays a plane with AV Player to play a video on top of the image using SCNPlane. When user swipes to next image then next video will play. I was able to ...
0
votes
1
answer
37
views
Programmatically created ARSCNView doesn't work
I have created ARSCNView programmatically as the below code. The app runs on my real iPhone (without crashing) but shows a blank/black screen. It doesn't ask for accessing the camera either (I have ...
0
votes
0
answers
28
views
CoreML Resnet50 Model has poor accuracy in physical device but works well in Xcode CoreML preview
I'm making object recognition app using Resnet50 model provided by apple. I'm integrating it with ARKit so that when ever the model detects an object I will display the identifier of the object using ...
0
votes
1
answer
75
views
ARKit ARWorldTrackingSessionConfiguration cannot find in scope
I am a newbie IOS Developer. When I'm working with ARKit, I get a compiler error:
Cannot find 'ARWorldTrackingSessionConfiguration' in scope
Where is ARWorldTrackingSessionConfiguration in Swift 5.5?...
0
votes
0
answers
22
views
Car model falling through the plane in ARKit plane detection
I'm trying to make a simple drivable car using ARKit. I have found two ways to detect the plane. My first approach is this here in didUpdate delegate method I just take the existing anchor and plane ...
0
votes
0
answers
8
views
How can you add a search bar at the bottom of a AR View?
Say you made an ARView in Storyboard (ArView-aRview with outlet). I tried dragging a search bar under ArView but then it replaces aRview. Do any of you know how to do this?
0
votes
0
answers
21
views
How to make a plane keep still in arview?
ace tracking with ARKit, in my case, I added a mask node to the ARSCNView as the following code:
let planeNode = SCNNode()
planeNode.geometry = SCNPlane(width: 10,height: 10)
planeNode.geometry?....
1
vote
0
answers
62
views
What is the best way to maintain the position of a USDZ model using ARKit in Swift?
I'm trying to build a quality assurance app in Swift using ARKit.
I'd like to position a USDZ model on top of its real world counterpart similar to this video...
I have been able to successfully ...
0
votes
0
answers
23
views
Convert Data to stream of CVPixelBuffer
How to convert Data to stream of CVPixelBuffer,
I am working on CVPixelBuffer output from AVSession and ARSession.
following is the code on which I am converting CVPixelBuffer to Data and able to save ...
0
votes
1
answer
45
views
How to scale down 3D model in ARKit
I was able to make a simple RC Car AR app using ARKit and SceneKit Vehicle physics. But now I need to change the car model. I'm using the SceneKit vehicle demo car model
I was able to import it into ...
0
votes
0
answers
27
views
How do I code multiplayer AR Game for my final year project?
So my professor suggested that I should create a multiplayer AR Game such that it involves one user to hit a ball which makes it change its position and then another player should be able to react to ...
0
votes
0
answers
31
views
Unity iOS AR URP glowing and looks weird
ScreenShotWhen we export our AR application with Unity, it looks like this. We use URP.
Which export setting should i set, and why? Can someone explain me.
I change all the setting from unity, ...
0
votes
0
answers
38
views
ARKit Feature Points Not on Planes
I have run into some interesting behavior. I am trying to have the user click on a point and then put a sphere where the user has clicked. The very first step is of course to get the point where the ...
0
votes
1
answer
42
views
Issue with Audio Playback in ARSCNView Scene
I'm currently working on an AR app using ARKit and SceneKit, and I've encountered an issue with audio playback in my ViewController class. I have a SCNNode that represents a rotating and moving box in ...
2
votes
0
answers
47
views
Align SCNText Along SCNCylinder
I am just starting out with ARKit and trying to make a very simple app where the user selects 2 points shown as SCNSphere, a "line" (SCNCylinder) connects the 2 spheres and some text SCNText ...