digital signal processor (DSP), FPGA implementation provides higher performance in repetitive and massive computations due to inherent architectural parallelism. Thus, in this paper, the position of the pendulum is measured with a machine vision system whose pipelined image processing is implemented on an FPGA device to meet real-time constraints. To enforce robustness to model uncertainty, and to attenuate disturbance and noise due to visual measurements, the mixed H2/H∞ control is applied to design the stabilizing controller.
The rest of this paper is organized as follows. Section 2 describes the relationship between the world coordinates and the image coordinates. The image processing algorithms for determining the displacement of the pendulum from the image data are introduced. Section 3 presents the hardware
implementation and architecture of the image processing algorithms on an FPGA device. In Section 4, the mathematical model of the inverted pendulum system is presented. The design of a mixed H2/H∞ controller is given in Section 5. The experimental results are given in Section 6. Finally, Section 7 contains some concluding remarks.
II. VISUAL MEASUREMENT AND IMAGE PROCESSING
ALGORITHMS
The intrinsic camera parameters are obtained using the camera calibration procedure proposed in [20]. λ is chosen to be the distance from the origin of the camera frame to the pendulum. The intrinsic camera parameters are given in TABLE I.
TABLE I
Intrinsic camera parameters
Parameter

Value
λ 0.16 m fsx 20.3591×10 pixels/msyf -0.2207×10 pixels/mo -0.4186 pixels oy

-0.2136 pixels
To determine the position of the marker on the image plane, the captured images are processed by a series of image processing algorithms. A sample of a raw image with a uniform background captured by the camera is shown in Fig. 1. The essential image processing algorithms [22] are described below.
The machine vision system is used to determine the angular displacement of the pendulum. A circular-shaped marker is A. Edge Detection placed on the top of the pendulum to simplify visual sensing Edges are the pixels at or around which a large change in and to increase the accuracy of visual measurements. gray-level intensity occurs. In most images, edges Determination of the position of the marker is based on the characterize object boundaries and are therefore useful for the perspective pinhole camera model [20, 21], which is given by segmentation [22] and identification of objects in a scene.
p K[R|t]P, (1) Edge detection is the process of locating edges in an image by
where p [x,y,1]T represents the two-dimensional detecting significant intensity changes. Most edge detection homogeneous coordinates of the image point in the image techniques are based on the idea of computing image
gradients. Let f (x, y) denote the grayscale level of the pixel at
coordinate system, P [X,Y,Z,1]Trepresents the
point (x, y) in the image coordinate system.
three-dimensional homogeneous coordinates of the object In this paper, the computation of the image gradient is point in the world coordinate system, and is a scalar factor. based on the Sobel operator [22], which approximates the The 3×3 matrix R and three-dimensional vector t are the partial derivatives by a mask operation. A general 3×3 mask extrinsic camera parameters that describe rotation and structure is defined as translation between the world frame and the camera frame,
respectively. K is the intrinsic camera parameter matrix given by fsxfs ox . K 0fosyy
The corresponding mask operation is given by 01 0 11
fx(x,y) f(x i,y j)wx(i,j) (2) Here, (ox, oy) is the principal point on the image coordinate
j 1i 1
system in pixels. fsx is the size of unit length in horizontal
11
pixels , fsy is the size of unit length in vertical pixels, and fsθ is
fy(x,y) f(x i,y j)wy(i,j) (3)
the skew of the pixels. The world frame is chosen to be j 1i 1coincident with the camera frame. Thus, the extrinsic camera
where wx(i,j) is the coefficient of the horizontal mask, and
parameters are
wy(i,j) is the coefficient of the vertical mask. Since the
1000
background of the scene is uniform and the objects in the [R|t] 0100 . scene are simple, the Sobel edge detector is adequate to
0010 extract the edges of the objects. Sobel edge detection was
Fig. 1. Image with a uniform background captured by the camera.
Simulation and implementation of Costas loop based on FPGA costas pll fpgacostas...III. DESIGN AND SIMULATION OF COSTAS LOOP DSP Builder is a system-level ...
Design and Implementation of an FPGA-Based Real-Time Face Recognition System 隐藏>> IEEE International Symposium on Field-Programmable Custom Computing Machines...
design and implementation of an integrated CMOS imaging system based on DM...diverse, ranging from DSP to FPGA, and to the combination of both [6]....
A Design and Implementation of Real-time Image Processing System Based on FPGA and DSP LU O Ge l i an g, LU X in p in g , LI Ji c h en ...
FPGA-Based Network Traffic Security: Design and Implementation Using C5.0 Decision Tree Classifier_兵器/核科学_工程科技_专业资料。JOURNALOFELECTRONIC SCIENCEAND...
DIGIT-SERIAL DSP LIBRARY... 暂无评价 2页 免费 A DSP- and FPGA-Based In...design techniques and actual practicalities of the implementation of DSP algorit...
2 Design and implementation of a high speed data acquisition system based on DSP and FPGA Jia L ong L in Y an ( Beij ing U nivers ity of A ...
(2012)12-0131-02 Design and Implementation of a Digital RF Transmitter Based on FPGA and DSP (Dept. of Electronics, School of Physics and ...
Design and Implementation of PAL to LVDS Video Adapter Based on FPGA_电子/电路_工程科技_专业资料。Applied Mechanics and Materials Vols. 241-244 (2013) ...
关键词:SOPC 技术,FPGA,Nios II 软核,语音记录 -II- 上海交通大学硕士学位论文 THE DESIGN AND IMPLEMENTATION OF VOICE RECORDING AND PLAYBACK SYSTEM BASED ON...
热门文档