It is not convenient to simulate buildings on the phone screen, so this application implements the function of converting the sketch you made on a piece of paper into a 3D model.
For many years, the mobile phone was considered only as a means of outputting already ready information, but this application will show that this is not at all the case. CUBE is implemented on three main modules:
1. Graphic core Unity
2. Google ARCore
3. The core of machine learning on the basis of OpenCV
Each of the modules performs its role when the program is running.
Brief instructions for working with the application:
- It is necessary to have a red and green marker
- The green marker is used to indicate overlapping points on a sheet of paper
- A red marker is used to indicate points of vertical columns on a piece of paper
- You do not need to make a sketch on a piece of paper, it is possible to perform it on any outputting device (monitor, TV, tablet, etc.)
- After the sketch is completed, you need to start the Cube and start the image analysis module, point your phone's camera to the image and take a screenshot. This image serves as the basis for building a 3D model. It is very important to take a picture without subjects in the frame with elements of red or green.
- Next, you need to analyze the resulting image
- After this, the resulting model of the building can be viewed with the help of the usual round of the camera around the model or with the help of the CUBE module based on Google ARCore.
- Any parameters of the building model can be changed in the settings of the application
All necessary calculations take place directly on your phone and therefore the application is very demanding on the CPU, RAM and GPU of your phone, the application does not use any cloud technology and can work without access to the Internet.
First of all, the application is not designed to solve serious problems, but rather serves as little helpers in solving problems related to finding the volume of structures, the area of overlap and various efficiency coefficients. It will also help children and teenagers understand the principles of modeling, scaling models and it is for them that the function of the ability to destroy models in augmented reality is implemented, just not to get bored.
LINK for download