373 lines
18 KiB
HTML
373 lines
18 KiB
HTML
|
||
|
||
<!DOCTYPE html>
|
||
<!--[if IE 8]><html class="no-js lt-ie9" lang="en" > <![endif]-->
|
||
<!--[if gt IE 8]><!--> <html class="no-js" lang="en" > <!--<![endif]-->
|
||
<head>
|
||
<meta charset="utf-8">
|
||
|
||
<meta name="viewport" content="width=device-width, initial-scale=1.0">
|
||
|
||
<title>Smoothing and normal estimation based on polynomial reconstruction — Point Cloud Library 1.12.0 documentation</title>
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
<script type="text/javascript" src="_static/js/modernizr.min.js"></script>
|
||
|
||
|
||
<script type="text/javascript" id="documentation_options" data-url_root="./" src="_static/documentation_options.js"></script>
|
||
<script type="text/javascript" src="_static/jquery.js"></script>
|
||
<script type="text/javascript" src="_static/underscore.js"></script>
|
||
<script type="text/javascript" src="_static/doctools.js"></script>
|
||
<script type="text/javascript" src="_static/language_data.js"></script>
|
||
|
||
<script type="text/javascript" src="_static/js/theme.js"></script>
|
||
|
||
|
||
|
||
|
||
<link rel="stylesheet" href="_static/css/theme.css" type="text/css" />
|
||
<link rel="stylesheet" href="_static/pygments.css" type="text/css" />
|
||
<link rel="index" title="Index" href="genindex.html" />
|
||
<link rel="search" title="Search" href="search.html" />
|
||
</head>
|
||
|
||
<body class="wy-body-for-nav">
|
||
|
||
|
||
<div class="wy-grid-for-nav">
|
||
|
||
<nav data-toggle="wy-nav-shift" class="wy-nav-side">
|
||
<div class="wy-side-scroll">
|
||
<div class="wy-side-nav-search" >
|
||
|
||
|
||
|
||
<a href="index.html" class="icon icon-home"> Point Cloud Library
|
||
|
||
|
||
|
||
</a>
|
||
|
||
|
||
|
||
|
||
<div class="version">
|
||
1.12.0
|
||
</div>
|
||
|
||
|
||
|
||
|
||
<div role="search">
|
||
<form id="rtd-search-form" class="wy-form" action="search.html" method="get">
|
||
<input type="text" name="q" placeholder="Search docs" />
|
||
<input type="hidden" name="check_keywords" value="yes" />
|
||
<input type="hidden" name="area" value="default" />
|
||
</form>
|
||
</div>
|
||
|
||
|
||
</div>
|
||
|
||
<div class="wy-menu wy-menu-vertical" data-spy="affix" role="navigation" aria-label="main navigation">
|
||
|
||
|
||
|
||
|
||
|
||
|
||
<!-- Local TOC -->
|
||
<div class="local-toc"><ul>
|
||
<li><a class="reference internal" href="#">Smoothing and normal estimation based on polynomial reconstruction</a></li>
|
||
<li><a class="reference internal" href="#the-code">The code</a></li>
|
||
<li><a class="reference internal" href="#the-explanation">The explanation</a></li>
|
||
<li><a class="reference internal" href="#compiling-and-running-the-program">Compiling and running the program</a></li>
|
||
</ul>
|
||
</div>
|
||
|
||
|
||
</div>
|
||
</div>
|
||
</nav>
|
||
|
||
<section data-toggle="wy-nav-shift" class="wy-nav-content-wrap">
|
||
|
||
|
||
<nav class="wy-nav-top" aria-label="top navigation">
|
||
|
||
<i data-toggle="wy-nav-top" class="fa fa-bars"></i>
|
||
<a href="index.html">Point Cloud Library</a>
|
||
|
||
</nav>
|
||
|
||
|
||
<div class="wy-nav-content">
|
||
|
||
<div class="rst-content">
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
<div role="navigation" aria-label="breadcrumbs navigation">
|
||
|
||
<ul class="wy-breadcrumbs">
|
||
|
||
<li><a href="index.html">Docs</a> »</li>
|
||
|
||
<li>Smoothing and normal estimation based on polynomial reconstruction</li>
|
||
|
||
|
||
<li class="wy-breadcrumbs-aside">
|
||
|
||
|
||
|
||
</li>
|
||
|
||
</ul>
|
||
|
||
|
||
<hr/>
|
||
</div>
|
||
<div role="main" class="document" itemscope="itemscope" itemtype="http://schema.org/Article">
|
||
<div itemprop="articleBody">
|
||
|
||
<div class="section" id="smoothing-and-normal-estimation-based-on-polynomial-reconstruction">
|
||
<span id="moving-least-squares"></span><h1>Smoothing and normal estimation based on polynomial reconstruction</h1>
|
||
<p>This tutorial explains how a Moving Least Squares (MLS) surface reconstruction
|
||
method can be used to smooth and resample noisy data. Please see an example in
|
||
the video below:</p>
|
||
<iframe title="Smoothing and normal estimation based on polynomial reconstruction" width="480" height="390" src="https://www.youtube.com/embed/FqHroDuo_I8?rel=0" frameborder="0" allowfullscreen></iframe><p>Some of the data irregularities (caused by small distance measurement errors)
|
||
are very hard to remove using statistical analysis. To create complete models,
|
||
glossy surfaces as well as occlusions in the data must be accounted for. In
|
||
situations where additional scans are impossible to acquire, a solution is to
|
||
use a resampling algorithm, which attempts to recreate the missing parts of the
|
||
surface by higher order polynomial interpolations between the surrounding data
|
||
points. By performing resampling, these small errors can be corrected and the
|
||
“double walls” artifacts resulted from registering multiple scans together can
|
||
be smoothed.</p>
|
||
<img alt="_images/resampling_1.jpg" src="_images/resampling_1.jpg" />
|
||
<p>On the left side of the figure above, we see the effect of estimating surface
|
||
normals in a dataset comprised of two registered point clouds together. Due to
|
||
alignment errors, the resultant normals are noisy. On the right side we see the
|
||
effects of surface normal estimation in the same dataset after it has been
|
||
smoothed with a Moving Least Squares algorithm. Plotting the curvatures at each
|
||
point as a measure of the eigenvalue relationship before and after resampling,
|
||
we obtain:</p>
|
||
<img alt="_images/resampling_2.jpg" src="_images/resampling_2.jpg" />
|
||
<p>To approximate the surface defined by a local neighborhood of points
|
||
<strong>p1</strong>, <strong>p2</strong> … <strong>pk</strong> at a point <strong>q</strong> we use a bivariate polynomial height function
|
||
defined on a robustly computed reference plane.</p>
|
||
<iframe title="Removing noisy data through resampling" width="480" height="390" src="https://www.youtube.com/embed/N5AgC0KEcw0?rel=0" frameborder="0" allowfullscreen></iframe></div>
|
||
<div class="section" id="the-code">
|
||
<h1>The code</h1>
|
||
<p>First, download the dataset <a class="reference external" href="https://raw.githubusercontent.com/PointCloudLibrary/pcl/master/test/bun0.pcd">bun0.pcd</a>
|
||
and save it somewhere to disk.</p>
|
||
<p>Then, create a file, let’s say, <code class="docutils literal notranslate"><span class="pre">resampling.cpp</span></code> in your favorite
|
||
editor, and place the following inside it:</p>
|
||
<div class="highlight-cpp notranslate"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre> 1
|
||
2
|
||
3
|
||
4
|
||
5
|
||
6
|
||
7
|
||
8
|
||
9
|
||
10
|
||
11
|
||
12
|
||
13
|
||
14
|
||
15
|
||
16
|
||
17
|
||
18
|
||
19
|
||
20
|
||
21
|
||
22
|
||
23
|
||
24
|
||
25
|
||
26
|
||
27
|
||
28
|
||
29
|
||
30
|
||
31
|
||
32
|
||
33
|
||
34
|
||
35
|
||
36</pre></div></td><td class="code"><div class="highlight"><pre><span></span><span class="cp">#include</span> <span class="cpf"><pcl/point_types.h></span><span class="cp"></span>
|
||
<span class="cp">#include</span> <span class="cpf"><pcl/io/pcd_io.h></span><span class="cp"></span>
|
||
<span class="cp">#include</span> <span class="cpf"><pcl/kdtree/kdtree_flann.h></span><span class="cp"></span>
|
||
<span class="cp">#include</span> <span class="cpf"><pcl/surface/mls.h></span><span class="cp"></span>
|
||
|
||
<span class="kt">int</span>
|
||
<span class="nf">main</span> <span class="p">()</span>
|
||
<span class="p">{</span>
|
||
<span class="c1">// Load input file into a PointCloud<T> with an appropriate type</span>
|
||
<span class="n">pcl</span><span class="o">::</span><span class="n">PointCloud</span><span class="o"><</span><span class="n">pcl</span><span class="o">::</span><span class="n">PointXYZ</span><span class="o">>::</span><span class="n">Ptr</span> <span class="n">cloud</span> <span class="p">(</span><span class="k">new</span> <span class="n">pcl</span><span class="o">::</span><span class="n">PointCloud</span><span class="o"><</span><span class="n">pcl</span><span class="o">::</span><span class="n">PointXYZ</span><span class="o">></span> <span class="p">());</span>
|
||
<span class="c1">// Load bun0.pcd -- should be available with the PCL archive in test </span>
|
||
<span class="n">pcl</span><span class="o">::</span><span class="n">io</span><span class="o">::</span><span class="n">loadPCDFile</span> <span class="p">(</span><span class="s">"bun0.pcd"</span><span class="p">,</span> <span class="o">*</span><span class="n">cloud</span><span class="p">);</span>
|
||
|
||
<span class="c1">// Create a KD-Tree</span>
|
||
<span class="n">pcl</span><span class="o">::</span><span class="n">search</span><span class="o">::</span><span class="n">KdTree</span><span class="o"><</span><span class="n">pcl</span><span class="o">::</span><span class="n">PointXYZ</span><span class="o">>::</span><span class="n">Ptr</span> <span class="n">tree</span> <span class="p">(</span><span class="k">new</span> <span class="n">pcl</span><span class="o">::</span><span class="n">search</span><span class="o">::</span><span class="n">KdTree</span><span class="o"><</span><span class="n">pcl</span><span class="o">::</span><span class="n">PointXYZ</span><span class="o">></span><span class="p">);</span>
|
||
|
||
<span class="c1">// Output has the PointNormal type in order to store the normals calculated by MLS</span>
|
||
<span class="n">pcl</span><span class="o">::</span><span class="n">PointCloud</span><span class="o"><</span><span class="n">pcl</span><span class="o">::</span><span class="n">PointNormal</span><span class="o">></span> <span class="n">mls_points</span><span class="p">;</span>
|
||
|
||
<span class="c1">// Init object (second point type is for the normals, even if unused)</span>
|
||
<span class="n">pcl</span><span class="o">::</span><span class="n">MovingLeastSquares</span><span class="o"><</span><span class="n">pcl</span><span class="o">::</span><span class="n">PointXYZ</span><span class="p">,</span> <span class="n">pcl</span><span class="o">::</span><span class="n">PointNormal</span><span class="o">></span> <span class="n">mls</span><span class="p">;</span>
|
||
|
||
<span class="n">mls</span><span class="p">.</span><span class="n">setComputeNormals</span> <span class="p">(</span><span class="nb">true</span><span class="p">);</span>
|
||
|
||
<span class="c1">// Set parameters</span>
|
||
<span class="n">mls</span><span class="p">.</span><span class="n">setInputCloud</span> <span class="p">(</span><span class="n">cloud</span><span class="p">);</span>
|
||
<span class="n">mls</span><span class="p">.</span><span class="n">setPolynomialOrder</span> <span class="p">(</span><span class="mi">2</span><span class="p">);</span>
|
||
<span class="n">mls</span><span class="p">.</span><span class="n">setSearchMethod</span> <span class="p">(</span><span class="n">tree</span><span class="p">);</span>
|
||
<span class="n">mls</span><span class="p">.</span><span class="n">setSearchRadius</span> <span class="p">(</span><span class="mf">0.03</span><span class="p">);</span>
|
||
|
||
<span class="c1">// Reconstruct</span>
|
||
<span class="n">mls</span><span class="p">.</span><span class="n">process</span> <span class="p">(</span><span class="n">mls_points</span><span class="p">);</span>
|
||
|
||
<span class="c1">// Save output</span>
|
||
<span class="n">pcl</span><span class="o">::</span><span class="n">io</span><span class="o">::</span><span class="n">savePCDFile</span> <span class="p">(</span><span class="s">"bun0-mls.pcd"</span><span class="p">,</span> <span class="n">mls_points</span><span class="p">);</span>
|
||
<span class="p">}</span>
|
||
</pre></div>
|
||
</td></tr></table></div>
|
||
<p>You should be able to find the input file at <em>pcl/test/bun0.pcd</em>.</p>
|
||
</div>
|
||
<div class="section" id="the-explanation">
|
||
<h1>The explanation</h1>
|
||
<p>Now, let’s break down the code piece by piece.</p>
|
||
<div class="highlight-cpp notranslate"><div class="highlight"><pre><span></span> <span class="n">pcl</span><span class="o">::</span><span class="n">PointCloud</span><span class="o"><</span><span class="n">pcl</span><span class="o">::</span><span class="n">PointXYZ</span><span class="o">>::</span><span class="n">Ptr</span> <span class="n">cloud</span> <span class="p">(</span><span class="k">new</span> <span class="n">pcl</span><span class="o">::</span><span class="n">PointCloud</span><span class="o"><</span><span class="n">pcl</span><span class="o">::</span><span class="n">PointXYZ</span><span class="o">></span> <span class="p">());</span>
|
||
<span class="c1">// Load bun0.pcd -- should be available with the PCL archive in test </span>
|
||
<span class="n">pcl</span><span class="o">::</span><span class="n">io</span><span class="o">::</span><span class="n">loadPCDFile</span> <span class="p">(</span><span class="s">"bun0.pcd"</span><span class="p">,</span> <span class="o">*</span><span class="n">cloud</span><span class="p">);</span>
|
||
</pre></div>
|
||
</div>
|
||
<p>as the example PCD has only XYZ coordinates, we load it into a
|
||
PointCloud<PointXYZ>. These fields are mandatory for the method, other ones are
|
||
allowed and will be preserved.</p>
|
||
<div class="highlight-cpp notranslate"><div class="highlight"><pre><span></span> <span class="n">mls</span><span class="p">.</span><span class="n">setComputeNormals</span> <span class="p">(</span><span class="nb">true</span><span class="p">);</span>
|
||
</pre></div>
|
||
</div>
|
||
<p>if normal estimation is not required, this step can be skipped.</p>
|
||
<div class="highlight-cpp notranslate"><div class="highlight"><pre><span></span> <span class="n">pcl</span><span class="o">::</span><span class="n">MovingLeastSquares</span><span class="o"><</span><span class="n">pcl</span><span class="o">::</span><span class="n">PointXYZ</span><span class="p">,</span> <span class="n">pcl</span><span class="o">::</span><span class="n">PointNormal</span><span class="o">></span> <span class="n">mls</span><span class="p">;</span>
|
||
</pre></div>
|
||
</div>
|
||
<p>the first template type is used for the input and output cloud. Only the XYZ
|
||
dimensions of the input are smoothed in the output.</p>
|
||
<div class="highlight-cpp notranslate"><div class="highlight"><pre><span></span> <span class="n">mls</span><span class="p">.</span><span class="n">setPolynomialOrder</span> <span class="p">(</span><span class="mi">2</span><span class="p">);</span>
|
||
</pre></div>
|
||
</div>
|
||
<p>polynomial fitting could be disabled for speeding up smoothing. Please consult
|
||
the code API (<span>MovingLeastSquares</span>) for default
|
||
values and additional parameters to control the smoothing process.</p>
|
||
<div class="highlight-cpp notranslate"><div class="highlight"><pre><span></span> <span class="c1">// Save output</span>
|
||
<span class="n">pcl</span><span class="o">::</span><span class="n">io</span><span class="o">::</span><span class="n">savePCDFile</span> <span class="p">(</span><span class="s">"bun0-mls.pcd"</span><span class="p">,</span> <span class="n">mls_points</span><span class="p">);</span>
|
||
<span class="p">}</span>
|
||
</pre></div>
|
||
</div>
|
||
<p>if the normals and the original dimensions need to be in the same cloud, the
|
||
fields have to be concatenated.</p>
|
||
</div>
|
||
<div class="section" id="compiling-and-running-the-program">
|
||
<h1>Compiling and running the program</h1>
|
||
<p>Add the following lines to your CMakeLists.txt file:</p>
|
||
<div class="highlight-cmake notranslate"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre> 1
|
||
2
|
||
3
|
||
4
|
||
5
|
||
6
|
||
7
|
||
8
|
||
9
|
||
10
|
||
11
|
||
12</pre></div></td><td class="code"><div class="highlight"><pre><span></span><span class="nb">cmake_minimum_required</span><span class="p">(</span><span class="s">VERSION</span> <span class="s">3.5</span> <span class="s">FATAL_ERROR</span><span class="p">)</span>
|
||
|
||
<span class="nb">project</span><span class="p">(</span><span class="s">resampling</span><span class="p">)</span>
|
||
|
||
<span class="nb">find_package</span><span class="p">(</span><span class="s">PCL</span> <span class="s">1.2</span> <span class="s">REQUIRED</span><span class="p">)</span>
|
||
|
||
<span class="nb">include_directories</span><span class="p">(</span><span class="o">${</span><span class="nv">PCL_INCLUDE_DIRS</span><span class="o">}</span><span class="p">)</span>
|
||
<span class="nb">link_directories</span><span class="p">(</span><span class="o">${</span><span class="nv">PCL_LIBRARY_DIRS</span><span class="o">}</span><span class="p">)</span>
|
||
<span class="nb">add_definitions</span><span class="p">(</span><span class="o">${</span><span class="nv">PCL_DEFINITIONS</span><span class="o">}</span><span class="p">)</span>
|
||
|
||
<span class="nb">add_executable</span> <span class="p">(</span><span class="s">resampling</span> <span class="s">resampling.cpp</span><span class="p">)</span>
|
||
<span class="nb">target_link_libraries</span> <span class="p">(</span><span class="s">resampling</span> <span class="o">${</span><span class="nv">PCL_LIBRARIES</span><span class="o">}</span><span class="p">)</span>
|
||
</pre></div>
|
||
</td></tr></table></div>
|
||
<p>After you have made the executable, you can run it. Simply do:</p>
|
||
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span>$ ./resampling
|
||
</pre></div>
|
||
</div>
|
||
<p>You can view the smoothed cloud for example by executing:</p>
|
||
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span>$ pcl_viewer bun0-mls.pcd
|
||
</pre></div>
|
||
</div>
|
||
</div>
|
||
|
||
|
||
</div>
|
||
|
||
</div>
|
||
<footer>
|
||
|
||
|
||
<hr/>
|
||
|
||
<div role="contentinfo">
|
||
<p>
|
||
© Copyright
|
||
|
||
</p>
|
||
</div>
|
||
Built with <a href="http://sphinx-doc.org/">Sphinx</a> using a <a href="https://github.com/rtfd/sphinx_rtd_theme">theme</a> provided by <a href="https://readthedocs.org">Read the Docs</a>.
|
||
|
||
</footer>
|
||
|
||
</div>
|
||
</div>
|
||
|
||
</section>
|
||
|
||
</div>
|
||
|
||
|
||
|
||
<script type="text/javascript">
|
||
jQuery(function () {
|
||
SphinxRtdTheme.Navigation.enable(true);
|
||
});
|
||
</script>
|
||
|
||
|
||
|
||
|
||
|
||
|
||
</body>
|
||
</html> |